Files
lmxopcua/scripts/validation/opcua-sdk-compatibility/evidence/2026-11-12-880/summary.json
T
Joseph Doherty e5b26f3772
v2-ci / unit-tests (push) Has been cancelled
test(validation): #880 cross-version matrix evidence, fixed and mutated candidate
The baseline is 83ed880e (SDK 1.5.378.182). The candidate is the #880 change (on da948e5f), run twice.
Fixed: every SDK 2 client (Shared, OpcUaClient driver, CLI) logs in to the SDK 1.5
server with a 65-char key. A wrong 65-char key gets BadIdentityTokenRejected. In the
control, the SDK default handler is refused by 1.5 with BadIdentityTokenInvalid and
admitted by SDK 2.
Mutation (the factory reverted to the SDK default handler): the SDK 2 Shared connect,
the driver connect and all three CLI calls fail against 1.5 with
BadIdentityTokenInvalid, and the wrong-key case gets Invalid instead of Rejected. This
is #880 reproduced.
In both runs the UNS cases fail against the master server for every client SDK. That
is a fixture gap since #808 and is tracked as #888.

Claude-Session: https://claude.ai/code/session_01GT67ACmpMR7b9LGRPLijMi
2026-11-12 11:14:15 -05:00

163 lines
5.2 KiB
JSON

{
"issue": "lmxopcua#880",
"dateUtc": "2026-11-12",
"baseline": "83ed880e (SDK 1.5.378.182), host/ and Client.Shared/ published Release from an untouched worktree",
"candidate": {
"fixed": "the #880 fix and matrix cases as a working tree on da948e5f (source-info records da948e5f); the same content landed on master as be28aa44 + 2ad72130 after a rebase onto 3fff439b",
"mutation": "19930411 (pre-rebase commit of that content) with OpcUaUserIdentityFactory.UserName reverted to new UserIdentity(username, bytes), i.e. the SDK default handler"
},
"apiKey": "random per run, ApiKeySecret.Generate shape, 65 chars; never recorded",
"fixed": [
{
"leg": "baseline-client-to-baseline-server",
"status": "passed",
"cases": 13,
"passed": 13,
"failed": [],
"apiKeyLength": 65,
"serverSdk": "1.5.378.0",
"wrongSecretStatus": "BadIdentityTokenRejected"
},
{
"leg": "baseline-client-to-candidate-server",
"status": "failed",
"cases": 13,
"passed": 10,
"failed": [
"raw-UNS-URI-browse",
"scalar-read-write-ns-3",
"typed-array-read-write-ns-3"
],
"apiKeyLength": 65,
"serverSdk": "2.0.1.0",
"wrongSecretStatus": "BadIdentityTokenRejected"
},
{
"leg": "candidate-client-to-baseline-server",
"status": "passed",
"cases": 14,
"passed": 14,
"failed": [],
"apiKeyLength": 65,
"serverSdk": "1.5.378.0",
"wrongSecretStatus": "BadIdentityTokenRejected",
"sdkDefaultFormatStatus": "BadIdentityTokenInvalid"
},
{
"leg": "candidate-client-to-candidate-server",
"status": "failed",
"cases": 14,
"passed": 11,
"failed": [
"raw-UNS-URI-browse",
"scalar-read-write-ns-3",
"typed-array-read-write-ns-3"
],
"apiKeyLength": 65,
"serverSdk": "2.0.1.0",
"wrongSecretStatus": "BadIdentityTokenRejected",
"sdkDefaultFormatStatus": "Good"
},
{
"leg": "candidate-driver-cli-to-baseline-server",
"status": "passed",
"cases": 7,
"passed": 7,
"failed": []
},
{
"leg": "candidate-driver-cli-to-candidate-server",
"status": "failed",
"cases": 7,
"passed": 6,
"failed": [
"driver-raw-UNS-URI-scalar-and-array-read"
]
}
],
"mutation": [
{
"leg": "baseline-client-to-baseline-server",
"status": "passed",
"cases": 13,
"passed": 13,
"failed": [],
"apiKeyLength": 65,
"serverSdk": "1.5.378.0",
"wrongSecretStatus": "BadIdentityTokenRejected"
},
{
"leg": "baseline-client-to-candidate-server",
"status": "failed",
"cases": 13,
"passed": 10,
"failed": [
"raw-UNS-URI-browse",
"scalar-read-write-ns-3",
"typed-array-read-write-ns-3"
],
"apiKeyLength": 65,
"serverSdk": "2.0.1.0",
"wrongSecretStatus": "BadIdentityTokenRejected"
},
{
"leg": "candidate-client-to-baseline-server",
"status": "failed",
"cases": 3,
"passed": 1,
"failed": [
"trusted-SignAndEncrypt-API-key",
"production-length-API-key-wrong-secret-reaches-key-check"
],
"apiKeyLength": 65,
"serverSdk": "1.5.378.0",
"wrongSecretStatus": "BadIdentityTokenInvalid",
"sdkDefaultFormatStatus": "BadIdentityTokenInvalid"
},
{
"leg": "candidate-client-to-candidate-server",
"status": "failed",
"cases": 14,
"passed": 11,
"failed": [
"raw-UNS-URI-browse",
"scalar-read-write-ns-3",
"typed-array-read-write-ns-3"
],
"apiKeyLength": 65,
"serverSdk": "2.0.1.0",
"wrongSecretStatus": "BadIdentityTokenRejected",
"sdkDefaultFormatStatus": "Good"
},
{
"leg": "candidate-driver-cli-to-baseline-server",
"status": "failed",
"cases": 7,
"passed": 0,
"failed": [
"driver-trusted-encrypted-API-key-connect",
"driver-raw-UNS-URI-scalar-and-array-read",
"driver-scalar-array-write-roundtrip",
"driver-monitor-quality-timestamps",
"production-CLI-read",
"production-CLI-raw-history",
"production-CLI-event-history"
]
},
{
"leg": "candidate-driver-cli-to-candidate-server",
"status": "failed",
"cases": 7,
"passed": 6,
"failed": [
"driver-raw-UNS-URI-scalar-and-array-read"
]
}
],
"readout": [
"Fixed: every SDK 2 client (Shared, driver, CLI) logs in to the SDK 1.5 server with the 65-char key; a wrong 65-char key reaches the key check (BadIdentityTokenRejected); the SDK default handler control is refused BadIdentityTokenInvalid by 1.5 and admitted by SDK 2.",
"Mutation: the SDK 2 Shared connect, the wrong-key case (BadIdentityTokenInvalid instead of Rejected), the driver connect and all three CLI calls fail against the SDK 1.5 server exactly as #880 reports; the SDK 2 server legs are unaffected.",
"Both runs: the UNS cases (raw-UNS-URI-browse, scalar/typed-array ns-3, driver UNS read) fail against the master server for every client SDK; a fixture gap since #808 (lmxopcua#888), not #880."
]
}