test: record final integrated CI baseline-only failures
v2-ci / unit-tests (pull_request) Has been cancelled
v2-ci / unit-tests (pull_request) Has been cancelled
This commit is contained in:
Joseph Doherty
@@ -456,9 +456,15 @@ closed with validation. [Exact repair evidence](evidence/2026-11-10-opcua2/rebui
|
||||
No product code, expected result, timing budget or skip was changed.
|
||||
|
||||
The complete solution rebuilt at `75057d8c` with **zero warnings/errors**, 26.61 s.
|
||||
Fresh full CI4 is now running with the corrected simulator and completion-barrier
|
||||
repair, under `artifacts/opcua2/75057d8c/solution-tests4/`. Its final result will be
|
||||
recorded without discarding CI3 or relabeling focused corrections as a green full run.
|
||||
Fresh full CI4 with the corrected simulator and completion-barrier repair completed
|
||||
at `75057d8c`: **63 TRX, 19,124 total, 18,489 executed, 18,478 passed, 11 failed,
|
||||
635 existing skips**. Test exit **1**, execution guard **0** at floor12,000.
|
||||
All eleven remaining failures are the established ten PercentGood cases (#796)
|
||||
and one ScriptWorker timing assertion (#798). The fixture and rebuild-ordering
|
||||
cases pass in this same full run, with no additional failure classes or new skips.
|
||||
[Versioned counters, exact failures and per-project hashes](evidence/2026-11-10-opcua2/solution-tests4.json)
|
||||
retain the nonzero status. CI3 remains available; this baseline-matching result
|
||||
is **not a green solution run**. Task-owned simulator was removed after completion.
|
||||
|
||||
## Canonical candidate generated-factory saturation result
|
||||
|
||||
|
||||
@@ -77,13 +77,17 @@ unexecuted operator or duration gates. Keep secrets out of logs and release reco
|
||||
| Production client lifecycle | **7,200.984 seconds,5,420 cycles,43,360 verified manager disposals**, zero weak product survivors and PKI descriptors across543 samples. [Exact source/runtime/counter receipts](../../scripts/validation/opcua-client-lifecycle/evidence/2026-11-10-full/verification.json). This is a client lifecycle pass, not a server RSS or full G4 pass. |
|
||||
| Source review | Independent reviews covered identity, ownership, aggregate preservation, hierarchy and filtered audit paths. [Review scope](2026-11-10-opcua-sdk-2-evidence.md#integrated-implementation-and-source-reviews). Source review is not release approval. |
|
||||
|
||||
The second full CI-equivalent run completed with **63 TRX, 19,121 discovered,
|
||||
18,486 executed, 18,475 passed, 11 failed and 635 existing skips**. Test exit was
|
||||
**1**; execution guard exit was **0** at floor 12,000. It is not green: the exact
|
||||
failures are ten unchanged PercentGood cases and one ShadowMode 250 ms timing
|
||||
assertion (585.7377 ms), independently reproduced on baseline, with no new failure
|
||||
classes. [Versioned CI2 counters and exact failures](evidence/2026-11-10-opcua2/solution-tests2.json); provenance is in the
|
||||
[main evidence](2026-11-10-opcua-sdk-2-evidence.md#solution-performance-and-package-evidence).
|
||||
The final corrected CI-equivalent run at `75057d8c` completed with **63 TRX,
|
||||
19,124 total, 18,489 executed, 18,478 passed, 11 failed and 635 existing skips**.
|
||||
Test exit **1**; execution guard **0** at floor12,000. It is not green: the eleven
|
||||
failures are ten PercentGood cases and one ShadowMode250ms assertion, independently
|
||||
reproduced on baseline. [Final counters/failures/project hashes](evidence/2026-11-10-opcua2/solution-tests4.json).
|
||||
CI3's extra five simulator-advertisement failures were corrected by a directly
|
||||
reachable matching-port fixture; the baseline Runtime test-ordering race was fixed
|
||||
through correlated completion barriers (#805, master52d1373e). Both corrections
|
||||
pass in the final full run. The retained CI3 report and original SDK1.5 NAT parity
|
||||
are in the [main evidence](2026-11-10-opcua-sdk-2-evidence.md#ci3-investigation-and-corrected-final-verification);
|
||||
preexisting browser NAT behavior remains #806.
|
||||
The ten PercentGood failures are tracked in
|
||||
[#796](https://gitea.dohertylan.com/dohertj2/lmxopcua/issues/796), and the separately
|
||||
reproduced baseline ScriptWorker timing failure is
|
||||
@@ -325,7 +329,8 @@ RSS gate is failed (#799), full CI retains the 11 baseline failures (#796/#798),
|
||||
the client lifecycle run completed two hours with cleanup checks passed, secure
|
||||
ScadaBridge interoperability is blocked (ScadaBridge#121), and
|
||||
Windows/live AVEVA/pair/operator gates remain pending (#800/#801). No fleet rollout
|
||||
or rollback has been executed. The fresh post-HG1.0 solution CI3 run remains in
|
||||
progress; its final counters will supplement the retained CI2 failures. The
|
||||
coordinator records remaining decisions in #782 and the main evidence; none is inferred from a
|
||||
or rollback has been executed. The final post-HG1.0 corrected full run retains
|
||||
only the eleven independently reproduced baseline failures; earlier failed runs
|
||||
remain recorded. The coordinator records remaining decisions in #782 and the main
|
||||
evidence; none is inferred from a
|
||||
passing subset or cross-published artifact.
|
||||
|
||||
@@ -0,0 +1,200 @@
|
||||
{
|
||||
"issues": {
|
||||
"ordering": "#805 closed; master52d1373e",
|
||||
"nat": "#806 open; SDK1.5 parity confirms preexisting limitation"
|
||||
},
|
||||
"evidence": {
|
||||
"controlledRed": {
|
||||
"sha256": "986e32c042f8b8525af44647f52d2defbf759ab122eb7494a05d77a0e1e4fbf9",
|
||||
"counters": {
|
||||
"total": "1",
|
||||
"executed": "1",
|
||||
"passed": "0",
|
||||
"failed": "1",
|
||||
"error": "0",
|
||||
"timeout": "0",
|
||||
"aborted": "0",
|
||||
"inconclusive": "0",
|
||||
"passedButRunAborted": "0",
|
||||
"notRunnable": "0",
|
||||
"notExecuted": "0",
|
||||
"disconnected": "0",
|
||||
"warning": "0",
|
||||
"completed": "0",
|
||||
"inProgress": "0",
|
||||
"pending": "0"
|
||||
},
|
||||
"outcomes": {
|
||||
"Passed": 0,
|
||||
"Failed": 1,
|
||||
"NotExecuted": 0
|
||||
}
|
||||
},
|
||||
"controlledGreen": {
|
||||
"sha256": "cbc3bf65bc7ad915f8b8697c260181f3cc01321a4904137dcca6fd4ac09b047d",
|
||||
"counters": {
|
||||
"total": "1",
|
||||
"executed": "1",
|
||||
"passed": "1",
|
||||
"failed": "0",
|
||||
"error": "0",
|
||||
"timeout": "0",
|
||||
"aborted": "0",
|
||||
"inconclusive": "0",
|
||||
"passedButRunAborted": "0",
|
||||
"notRunnable": "0",
|
||||
"notExecuted": "0",
|
||||
"disconnected": "0",
|
||||
"warning": "0",
|
||||
"completed": "0",
|
||||
"inProgress": "0",
|
||||
"pending": "0"
|
||||
},
|
||||
"outcomes": {
|
||||
"Passed": 1,
|
||||
"Failed": 0,
|
||||
"NotExecuted": 0
|
||||
}
|
||||
},
|
||||
"sdk2Runtime": {
|
||||
"sha256": "238ecd1b10df3d9e173d428f2760c35b5e293b4db67f3e9a2a46d2d9988a27f2",
|
||||
"counters": {
|
||||
"total": "1005",
|
||||
"executed": "1002",
|
||||
"passed": "1002",
|
||||
"failed": "0",
|
||||
"error": "0",
|
||||
"timeout": "0",
|
||||
"aborted": "0",
|
||||
"inconclusive": "0",
|
||||
"passedButRunAborted": "0",
|
||||
"notRunnable": "0",
|
||||
"notExecuted": "0",
|
||||
"disconnected": "0",
|
||||
"warning": "0",
|
||||
"completed": "0",
|
||||
"inProgress": "0",
|
||||
"pending": "0"
|
||||
},
|
||||
"outcomes": {
|
||||
"Passed": 1002,
|
||||
"Failed": 0,
|
||||
"NotExecuted": 3
|
||||
}
|
||||
},
|
||||
"sdk1Runtime": {
|
||||
"sha256": "e6b378d324a91d08159b59f675d10af2207a745afc6e0c846564c39ac144b58a",
|
||||
"counters": {
|
||||
"total": "1005",
|
||||
"executed": "1002",
|
||||
"passed": "1002",
|
||||
"failed": "0",
|
||||
"error": "0",
|
||||
"timeout": "0",
|
||||
"aborted": "0",
|
||||
"inconclusive": "0",
|
||||
"passedButRunAborted": "0",
|
||||
"notRunnable": "0",
|
||||
"notExecuted": "0",
|
||||
"disconnected": "0",
|
||||
"warning": "0",
|
||||
"completed": "0",
|
||||
"inProgress": "0",
|
||||
"pending": "0"
|
||||
},
|
||||
"outcomes": {
|
||||
"Passed": 1002,
|
||||
"Failed": 0,
|
||||
"NotExecuted": 3
|
||||
}
|
||||
},
|
||||
"browserCorrectedFixture": {
|
||||
"sha256": "ed9db0d9545fef17e8b43429a962a36936b551c2de03535be4b7983343d42ecd",
|
||||
"counters": {
|
||||
"total": "5",
|
||||
"executed": "5",
|
||||
"passed": "5",
|
||||
"failed": "0",
|
||||
"error": "0",
|
||||
"timeout": "0",
|
||||
"aborted": "0",
|
||||
"inconclusive": "0",
|
||||
"passedButRunAborted": "0",
|
||||
"notRunnable": "0",
|
||||
"notExecuted": "0",
|
||||
"disconnected": "0",
|
||||
"warning": "0",
|
||||
"completed": "0",
|
||||
"inProgress": "0",
|
||||
"pending": "0"
|
||||
},
|
||||
"outcomes": {
|
||||
"Passed": 5,
|
||||
"Failed": 0,
|
||||
"NotExecuted": 0
|
||||
}
|
||||
},
|
||||
"driverCorrectedFixture": {
|
||||
"sha256": "dc2ac55ca296474d767b29ddca2feaa027cec5793ab6ac6a28a10c98dfb2cb56",
|
||||
"counters": {
|
||||
"total": "5",
|
||||
"executed": "5",
|
||||
"passed": "5",
|
||||
"failed": "0",
|
||||
"error": "0",
|
||||
"timeout": "0",
|
||||
"aborted": "0",
|
||||
"inconclusive": "0",
|
||||
"passedButRunAborted": "0",
|
||||
"notRunnable": "0",
|
||||
"notExecuted": "0",
|
||||
"disconnected": "0",
|
||||
"warning": "0",
|
||||
"completed": "0",
|
||||
"inProgress": "0",
|
||||
"pending": "0"
|
||||
},
|
||||
"outcomes": {
|
||||
"Passed": 5,
|
||||
"Failed": 0,
|
||||
"NotExecuted": 0
|
||||
}
|
||||
},
|
||||
"sdk1BrowserNatBaseline": {
|
||||
"sha256": "7111ac68dd46bb1931b0e8c3b4bbb3b85588dbcd94758aec5fcb3e6e205b0487",
|
||||
"counters": {
|
||||
"total": "5",
|
||||
"executed": "5",
|
||||
"passed": "0",
|
||||
"failed": "5",
|
||||
"error": "0",
|
||||
"timeout": "0",
|
||||
"aborted": "0",
|
||||
"inconclusive": "0",
|
||||
"passedButRunAborted": "0",
|
||||
"notRunnable": "0",
|
||||
"notExecuted": "0",
|
||||
"disconnected": "0",
|
||||
"warning": "0",
|
||||
"completed": "0",
|
||||
"inProgress": "0",
|
||||
"pending": "0"
|
||||
},
|
||||
"outcomes": {
|
||||
"Passed": 0,
|
||||
"Failed": 5,
|
||||
"NotExecuted": 0
|
||||
}
|
||||
},
|
||||
"actorMasterCandidateSourceDiff": {
|
||||
"sha256": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
||||
"bytes": 0
|
||||
},
|
||||
"sdk1GetEndpoints": {
|
||||
"sha256": "c4400f696ce3a8e8cdc49a4dedc06e4969584cfb47a6ada28c28bf91f75189f7",
|
||||
"bytes": 858
|
||||
}
|
||||
},
|
||||
"expectedRedFailureRetained": true,
|
||||
"newProductChanges": false
|
||||
}
|
||||
File diff suppressed because it is too large
Load Diff
Reference in New Issue
Block a user