69a6e0b4c8
v2-ci / unit-tests (push) Waiting to run
Opt-in (Scripting:Runner=OutOfProcess; InProcess stays the default and its code path is unchanged). Implements the P1 slice of docs/plans/2026-11-09-out-of-process-script-runner-design.md with the owner's §14 decisions: - Options: Scripting:Runner (InProcess | Shadow | OutOfProcess), Scripting:Runner:Seams, Scripting:Worker:* (Shards 2, HardGrace max(1 s,T), HeapLimitBytes 512 MiB, QuarantineAfterKills 2, UnavailableGrace 5 s, IsolationProbationRuns 20, PeCacheDir validated absolute + outside the content root (fail closed), ExecutablePath). Shadow is not implemented yet: runs InProcess with a startup Warning. - Core.Scripting: IScriptRunner seam + InProcessScriptRunner (today's guard, the parity baseline). - Core.Scripting.Protocol: protobuf envelopes, 4-byte LE framing (zero/oversize/truncated/garbage refused), Variant carrying the exact CLR type; unsupported types are explicit failures. - ScriptWorker app: compiles in the worker, P-thread scheduler, host-driven soft cancel, fail-fast watchdog, heartbeats, ctx.Logger forwarding, exits on pipe EOF / parent gone, forbidden-assembly self-check; Akka and Grpc.Core.Api excluded from its folder. Shipped in script-worker/ (Build + Publish). - Core.Scripting.OutOfProcess: K shards + isolation worker, soft T / hard T+G kill, attribution (deadline kill = one key; crash = suspects -> isolation; isolation crash = strike), kill-strike quarantine, backoff 250 ms -> 30 s, fail closed, cleared allow-listed env, nonce + pid handshake on a current-user pipe, Windows Job Object. - VirtualTag + Calculation seams use the runner when selected; a runner-side failure (worker restarted / runner unavailable) publishes BadResourceUnavailable (0x80040000) — ScadaBridge#112. Script faults keep BadInternalError. The scripted-alarm seam stays in process (alarms last). Tests: new ZB.MOM.WW.OtOpcUa.ScriptWorker.Tests (Category=ScriptWorker, real processes; green on macOS and on windev/Windows), seam tests in Host/Runtime/Calculation suites; mutation-checked. Claude-Session: https://claude.ai/code/session_01GT67AEHd2Acv1YPwGfXEoV
83 lines
3.4 KiB
C#
83 lines
3.4 KiB
C#
using System.Collections.Concurrent;
|
|
using Serilog;
|
|
using Serilog.Core;
|
|
using Serilog.Events;
|
|
using ZB.MOM.WW.OtOpcUa.Core.Abstractions;
|
|
using ZB.MOM.WW.OtOpcUa.Core.Scripting;
|
|
using ZB.MOM.WW.OtOpcUa.Core.Scripting.OutOfProcess;
|
|
|
|
namespace ZB.MOM.WW.OtOpcUa.ScriptWorker.Tests;
|
|
|
|
/// <summary>Collects Serilog events in memory.</summary>
|
|
internal sealed class CapturingSink : ILogEventSink
|
|
{
|
|
public ConcurrentQueue<LogEvent> Events { get; } = new();
|
|
|
|
public void Emit(LogEvent logEvent) => Events.Enqueue(logEvent);
|
|
|
|
public ILogger CreateLogger() => new LoggerConfiguration().MinimumLevel.Verbose().WriteTo.Sink(this).CreateLogger();
|
|
|
|
public IEnumerable<string> Rendered => Events.Select(e => e.RenderMessage());
|
|
}
|
|
|
|
internal static class Scripts
|
|
{
|
|
public static readonly IReadOnlyDictionary<string, DataValueSnapshot> NoInputs =
|
|
new Dictionary<string, DataValueSnapshot>(StringComparer.Ordinal);
|
|
|
|
public static IReadOnlyDictionary<string, DataValueSnapshot> Input(string path, object? value, uint status = 0)
|
|
=> new Dictionary<string, DataValueSnapshot>(StringComparer.Ordinal)
|
|
{
|
|
[path] = new DataValueSnapshot(value, status, DateTime.UtcNow, DateTime.UtcNow),
|
|
};
|
|
|
|
public static ScriptInvocation Vt(string key, string source, TimeSpan? timeout = null,
|
|
IReadOnlyDictionary<string, DataValueSnapshot>? inputs = null, ILogger? logger = null)
|
|
=> new(key, ScriptContextKind.VirtualTag, source, inputs ?? NoInputs, timeout ?? TimeSpan.FromSeconds(5), logger);
|
|
|
|
/// <summary>Options for a single-shard runner with short budgets, so the containment tests run in seconds.</summary>
|
|
public static ScriptingOptions Options(int shards = 1, TimeSpan? hardGrace = null, int quarantineAfterKills = 2,
|
|
int probation = 20, TimeSpan? unavailableGrace = null, string? workerPath = null, long heapLimit = 256L * 1024 * 1024)
|
|
=> new()
|
|
{
|
|
Runner = ScriptRunnerMode.OutOfProcess,
|
|
QuarantineAfterConsecutiveTimeouts = 100,
|
|
Worker = new ScriptWorkerOptions
|
|
{
|
|
Shards = shards,
|
|
HardGrace = hardGrace ?? TimeSpan.FromMilliseconds(500),
|
|
QuarantineAfterKills = quarantineAfterKills,
|
|
IsolationProbationRuns = probation,
|
|
UnavailableGrace = unavailableGrace ?? TimeSpan.FromSeconds(30),
|
|
ExecutablePath = workerPath,
|
|
HeapLimitBytes = heapLimit,
|
|
},
|
|
};
|
|
|
|
public static OutOfProcessScriptRunner Runner(ScriptingOptions options, ILogger? log = null)
|
|
=> new(options, log ?? new LoggerConfiguration().CreateLogger(), null,
|
|
heartbeatInterval: TimeSpan.FromSeconds(1), loadTimeout: TimeSpan.FromSeconds(60));
|
|
|
|
public static async Task<T> Eventually<T>(Func<T?> probe, TimeSpan timeout, string what) where T : class
|
|
{
|
|
var deadline = DateTime.UtcNow + timeout;
|
|
while (DateTime.UtcNow < deadline)
|
|
{
|
|
if (probe() is { } value) return value;
|
|
await Task.Delay(20);
|
|
}
|
|
throw new TimeoutException($"timed out waiting for {what}");
|
|
}
|
|
|
|
public static async Task Eventually(Func<bool> probe, TimeSpan timeout, string what)
|
|
{
|
|
var deadline = DateTime.UtcNow + timeout;
|
|
while (DateTime.UtcNow < deadline)
|
|
{
|
|
if (probe()) return;
|
|
await Task.Delay(20);
|
|
}
|
|
throw new TimeoutException($"timed out waiting for {what}");
|
|
}
|
|
}
|