Compare commits
4 Commits
| Author | SHA1 | Date | |
|---|---|---|---|
| 0af1427859 | |||
| e2b4dfcb32 | |||
| 3b3e41acf4 | |||
| c1188c6957 |
@@ -0,0 +1,62 @@
|
|||||||
|
# Worker Process Launcher
|
||||||
|
|
||||||
|
The gateway uses `WorkerProcessLauncher` to validate and start one worker
|
||||||
|
process for a gateway session. The launcher owns process start semantics only;
|
||||||
|
pipe handshaking and `WorkerReady` validation remain part of the worker client
|
||||||
|
startup path.
|
||||||
|
|
||||||
|
## Launch Inputs
|
||||||
|
|
||||||
|
`WorkerProcessLaunchRequest` carries the per-session bootstrap values:
|
||||||
|
|
||||||
|
- `SessionId`,
|
||||||
|
- `PipeName`,
|
||||||
|
- `ProtocolVersion`,
|
||||||
|
- `Nonce`,
|
||||||
|
- optional `PipeReservation` cleanup handle.
|
||||||
|
|
||||||
|
The launcher passes `SessionId`, `PipeName`, and `ProtocolVersion` as command
|
||||||
|
line arguments:
|
||||||
|
|
||||||
|
```text
|
||||||
|
--session-id <sessionId> --pipe-name <pipeName> --protocol-version <version>
|
||||||
|
```
|
||||||
|
|
||||||
|
The launcher sets the nonce through the `MXGATEWAY_WORKER_NONCE` environment
|
||||||
|
variable. The nonce is not included in `WorkerProcessCommandLine` so logs and
|
||||||
|
diagnostics can report the launch command without exposing the secret.
|
||||||
|
|
||||||
|
## Validation And Cleanup
|
||||||
|
|
||||||
|
Before starting the process, the launcher validates that the configured worker
|
||||||
|
path exists, has a `.exe` extension, contains a valid Windows Portable
|
||||||
|
Executable header, and matches the configured `RequiredArchitecture`.
|
||||||
|
|
||||||
|
After the process starts, `IWorkerStartupProbe` waits for startup readiness.
|
||||||
|
The default probe only verifies that the worker did not exit immediately. The
|
||||||
|
worker client replaces this probe when pipe connection, hello, and
|
||||||
|
`WorkerReady` handling are implemented.
|
||||||
|
|
||||||
|
If startup fails or exceeds `WorkerOptions.StartupTimeoutSeconds`, the launcher
|
||||||
|
kills the worker process tree, disposes the process handle, disposes the
|
||||||
|
optional pipe reservation, records a worker kill metric, and reports a
|
||||||
|
`WorkerProcessLaunchException`.
|
||||||
|
|
||||||
|
## Verification
|
||||||
|
|
||||||
|
Run the focused launcher tests after changing process launch behavior:
|
||||||
|
|
||||||
|
```bash
|
||||||
|
dotnet test src/MxGateway.Tests/MxGateway.Tests.csproj --filter WorkerProcessLauncherTests
|
||||||
|
```
|
||||||
|
|
||||||
|
Run the gateway build because the launcher is part of `MxGateway.Server`:
|
||||||
|
|
||||||
|
```bash
|
||||||
|
dotnet build src/MxGateway.Server/MxGateway.Server.csproj
|
||||||
|
```
|
||||||
|
|
||||||
|
## Related Documentation
|
||||||
|
|
||||||
|
- [Gateway Process Detailed Design](./gateway-process-design.md)
|
||||||
|
- [Worker Frame Protocol](./WorkerFrameProtocol.md)
|
||||||
@@ -360,6 +360,15 @@ Before launch, validate:
|
|||||||
- worker file version or product version is acceptable,
|
- worker file version or product version is acceptable,
|
||||||
- worker is expected to be x86.
|
- worker is expected to be x86.
|
||||||
|
|
||||||
|
`WorkerProcessLauncher` implements the first validation layer now: it resolves
|
||||||
|
the worker executable path, requires a `.exe`, validates the Windows Portable
|
||||||
|
Executable header, and verifies the configured processor architecture. It passes
|
||||||
|
only `--session-id`, `--pipe-name`, and `--protocol-version` on the command
|
||||||
|
line. The per-session nonce is set through `MXGATEWAY_WORKER_NONCE` so the
|
||||||
|
command line remains safe to log. Startup failures and startup timeouts kill and
|
||||||
|
dispose the worker process and the pre-created pipe reservation before the
|
||||||
|
session manager observes the failure.
|
||||||
|
|
||||||
## Worker IPC
|
## Worker IPC
|
||||||
|
|
||||||
The gateway creates the pipe server before launching the worker.
|
The gateway creates the pipe server before launching the worker.
|
||||||
|
|||||||
@@ -114,6 +114,21 @@ Startup sequence:
|
|||||||
If validation fails before MXAccess creation, exit quickly with a non-zero exit
|
If validation fails before MXAccess creation, exit quickly with a non-zero exit
|
||||||
code. If MXAccess creation fails, send `WorkerFault` when possible and exit.
|
code. If MXAccess creation fails, send `WorkerFault` when possible and exit.
|
||||||
|
|
||||||
|
The bootstrap layer returns structured exit codes before it creates pipes,
|
||||||
|
starts the STA, or touches MXAccess:
|
||||||
|
|
||||||
|
| Exit code | Name | Meaning |
|
||||||
|
|-----------|------|---------|
|
||||||
|
| `0` | `Success` | Required bootstrap options are valid. |
|
||||||
|
| `1` | `UnexpectedFailure` | A non-bootstrap exception reaches the process boundary. |
|
||||||
|
| `2` | `InvalidArguments` | Required arguments are missing or unknown arguments are present. |
|
||||||
|
| `3` | `InvalidProtocolVersion` | `--protocol-version` is not numeric or does not match the supported worker protocol. |
|
||||||
|
| `4` | `MissingNonce` | `MXGATEWAY_WORKER_NONCE` is absent or empty. |
|
||||||
|
|
||||||
|
Bootstrap logs use `WorkerConsoleLogger` key/value output. `WorkerLogRedactor`
|
||||||
|
redacts fields whose names indicate nonce, secret, password, token,
|
||||||
|
credential, or API key values before the message is written.
|
||||||
|
|
||||||
## Internal Components
|
## Internal Components
|
||||||
|
|
||||||
```text
|
```text
|
||||||
|
|||||||
@@ -47,6 +47,8 @@ Detailed follow-up docs:
|
|||||||
security, observability, and test strategy.
|
security, observability, and test strategy.
|
||||||
- `docs/WorkerFrameProtocol.md` covers the gateway-side named-pipe frame
|
- `docs/WorkerFrameProtocol.md` covers the gateway-side named-pipe frame
|
||||||
reader/writer and `WorkerEnvelope` validation rules.
|
reader/writer and `WorkerEnvelope` validation rules.
|
||||||
|
- `docs/WorkerProcessLauncher.md` covers worker executable validation, process
|
||||||
|
launch arguments, nonce handling, and startup cleanup behavior.
|
||||||
- `docs/mxaccess-worker-instance-design.md` covers each .NET Framework 4.8 x86
|
- `docs/mxaccess-worker-instance-design.md` covers each .NET Framework 4.8 x86
|
||||||
MXAccess worker instance, including STA ownership, message pumping, COM
|
MXAccess worker instance, including STA ownership, message pumping, COM
|
||||||
lifetime, command dispatch, event sinks, conversion, and shutdown.
|
lifetime, command dispatch, event sinks, conversion, and shutdown.
|
||||||
|
|||||||
@@ -3,6 +3,7 @@ using MxGateway.Server.Configuration;
|
|||||||
using MxGateway.Server.Diagnostics;
|
using MxGateway.Server.Diagnostics;
|
||||||
using MxGateway.Server.Metrics;
|
using MxGateway.Server.Metrics;
|
||||||
using MxGateway.Server.Security.Authentication;
|
using MxGateway.Server.Security.Authentication;
|
||||||
|
using MxGateway.Server.Workers;
|
||||||
|
|
||||||
namespace MxGateway.Server;
|
namespace MxGateway.Server;
|
||||||
|
|
||||||
@@ -27,6 +28,7 @@ public static class GatewayApplication
|
|||||||
builder.Services.AddSqliteAuthStore();
|
builder.Services.AddSqliteAuthStore();
|
||||||
builder.Services.AddHealthChecks();
|
builder.Services.AddHealthChecks();
|
||||||
builder.Services.AddSingleton<GatewayMetrics>();
|
builder.Services.AddSingleton<GatewayMetrics>();
|
||||||
|
builder.Services.AddWorkerProcessLauncher();
|
||||||
|
|
||||||
return builder;
|
return builder;
|
||||||
}
|
}
|
||||||
|
|||||||
@@ -0,0 +1,14 @@
|
|||||||
|
namespace MxGateway.Server.Workers;
|
||||||
|
|
||||||
|
public interface IWorkerProcess : IDisposable
|
||||||
|
{
|
||||||
|
int Id { get; }
|
||||||
|
|
||||||
|
bool HasExited { get; }
|
||||||
|
|
||||||
|
int? ExitCode { get; }
|
||||||
|
|
||||||
|
ValueTask WaitForExitAsync(CancellationToken cancellationToken);
|
||||||
|
|
||||||
|
void Kill(bool entireProcessTree);
|
||||||
|
}
|
||||||
@@ -0,0 +1,8 @@
|
|||||||
|
using System.Diagnostics;
|
||||||
|
|
||||||
|
namespace MxGateway.Server.Workers;
|
||||||
|
|
||||||
|
public interface IWorkerProcessFactory
|
||||||
|
{
|
||||||
|
IWorkerProcess Start(ProcessStartInfo startInfo);
|
||||||
|
}
|
||||||
@@ -0,0 +1,8 @@
|
|||||||
|
namespace MxGateway.Server.Workers;
|
||||||
|
|
||||||
|
public interface IWorkerProcessLauncher
|
||||||
|
{
|
||||||
|
Task<WorkerProcessHandle> LaunchAsync(
|
||||||
|
WorkerProcessLaunchRequest request,
|
||||||
|
CancellationToken cancellationToken = default);
|
||||||
|
}
|
||||||
@@ -0,0 +1,9 @@
|
|||||||
|
namespace MxGateway.Server.Workers;
|
||||||
|
|
||||||
|
public interface IWorkerStartupProbe
|
||||||
|
{
|
||||||
|
Task WaitUntilReadyAsync(
|
||||||
|
IWorkerProcess process,
|
||||||
|
WorkerProcessLaunchRequest request,
|
||||||
|
CancellationToken cancellationToken);
|
||||||
|
}
|
||||||
@@ -0,0 +1,27 @@
|
|||||||
|
using System.Diagnostics;
|
||||||
|
|
||||||
|
namespace MxGateway.Server.Workers;
|
||||||
|
|
||||||
|
internal sealed class SystemWorkerProcess(Process process) : IWorkerProcess
|
||||||
|
{
|
||||||
|
public int Id => process.Id;
|
||||||
|
|
||||||
|
public bool HasExited => process.HasExited;
|
||||||
|
|
||||||
|
public int? ExitCode => process.HasExited ? process.ExitCode : null;
|
||||||
|
|
||||||
|
public async ValueTask WaitForExitAsync(CancellationToken cancellationToken)
|
||||||
|
{
|
||||||
|
await process.WaitForExitAsync(cancellationToken).ConfigureAwait(false);
|
||||||
|
}
|
||||||
|
|
||||||
|
public void Kill(bool entireProcessTree)
|
||||||
|
{
|
||||||
|
process.Kill(entireProcessTree);
|
||||||
|
}
|
||||||
|
|
||||||
|
public void Dispose()
|
||||||
|
{
|
||||||
|
process.Dispose();
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -0,0 +1,22 @@
|
|||||||
|
using System.Diagnostics;
|
||||||
|
|
||||||
|
namespace MxGateway.Server.Workers;
|
||||||
|
|
||||||
|
public sealed class SystemWorkerProcessFactory : IWorkerProcessFactory
|
||||||
|
{
|
||||||
|
public IWorkerProcess Start(ProcessStartInfo startInfo)
|
||||||
|
{
|
||||||
|
Process process = new()
|
||||||
|
{
|
||||||
|
StartInfo = startInfo,
|
||||||
|
};
|
||||||
|
|
||||||
|
if (!process.Start())
|
||||||
|
{
|
||||||
|
process.Dispose();
|
||||||
|
throw new InvalidOperationException("Worker process failed to start.");
|
||||||
|
}
|
||||||
|
|
||||||
|
return new SystemWorkerProcess(process);
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -0,0 +1,80 @@
|
|||||||
|
using System.Buffers.Binary;
|
||||||
|
using MxGateway.Server.Configuration;
|
||||||
|
|
||||||
|
namespace MxGateway.Server.Workers;
|
||||||
|
|
||||||
|
internal static class WorkerExecutableValidator
|
||||||
|
{
|
||||||
|
private const ushort ImageFileMachineI386 = 0x014c;
|
||||||
|
private const ushort ImageFileMachineAmd64 = 0x8664;
|
||||||
|
private const int DosHeaderSignatureOffset = 0;
|
||||||
|
private const int PeHeaderOffsetPointer = 0x3c;
|
||||||
|
private const int PeSignatureSize = 4;
|
||||||
|
private const int MachineOffsetFromPeHeader = PeSignatureSize;
|
||||||
|
private const int MinimumHeaderSize = 0x40;
|
||||||
|
|
||||||
|
public static void Validate(
|
||||||
|
string executablePath,
|
||||||
|
WorkerArchitecture requiredArchitecture)
|
||||||
|
{
|
||||||
|
ushort machine = ReadMachineType(executablePath);
|
||||||
|
ushort expectedMachine = requiredArchitecture switch
|
||||||
|
{
|
||||||
|
WorkerArchitecture.X86 => ImageFileMachineI386,
|
||||||
|
WorkerArchitecture.X64 => ImageFileMachineAmd64,
|
||||||
|
_ => throw new WorkerProcessLaunchException(
|
||||||
|
WorkerProcessLaunchErrorCode.InvalidExecutable,
|
||||||
|
"Worker executable required architecture is unsupported."),
|
||||||
|
};
|
||||||
|
|
||||||
|
if (machine != expectedMachine)
|
||||||
|
{
|
||||||
|
throw new WorkerProcessLaunchException(
|
||||||
|
WorkerProcessLaunchErrorCode.InvalidExecutable,
|
||||||
|
$"Worker executable architecture does not match required {requiredArchitecture} architecture.");
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
private static ushort ReadMachineType(string executablePath)
|
||||||
|
{
|
||||||
|
byte[] header = new byte[MinimumHeaderSize];
|
||||||
|
using FileStream stream = File.OpenRead(executablePath);
|
||||||
|
if (stream.Read(header) < header.Length)
|
||||||
|
{
|
||||||
|
throw InvalidExecutable("Worker executable is too small to contain a valid PE header.");
|
||||||
|
}
|
||||||
|
|
||||||
|
if (header[DosHeaderSignatureOffset] != 'M' || header[DosHeaderSignatureOffset + 1] != 'Z')
|
||||||
|
{
|
||||||
|
throw InvalidExecutable("Worker executable does not contain an MZ header.");
|
||||||
|
}
|
||||||
|
|
||||||
|
int peHeaderOffset = BinaryPrimitives.ReadInt32LittleEndian(header.AsSpan(PeHeaderOffsetPointer, sizeof(int)));
|
||||||
|
if (peHeaderOffset < MinimumHeaderSize)
|
||||||
|
{
|
||||||
|
throw InvalidExecutable("Worker executable PE header offset is invalid.");
|
||||||
|
}
|
||||||
|
|
||||||
|
byte[] peHeaderBytes = new byte[PeSignatureSize + sizeof(ushort)];
|
||||||
|
stream.Position = peHeaderOffset;
|
||||||
|
if (stream.Read(peHeaderBytes) < peHeaderBytes.Length)
|
||||||
|
{
|
||||||
|
throw InvalidExecutable("Worker executable PE header is missing.");
|
||||||
|
}
|
||||||
|
|
||||||
|
if (peHeaderBytes[0] != 'P' || peHeaderBytes[1] != 'E' || peHeaderBytes[2] != 0 || peHeaderBytes[3] != 0)
|
||||||
|
{
|
||||||
|
throw InvalidExecutable("Worker executable does not contain a PE header.");
|
||||||
|
}
|
||||||
|
|
||||||
|
return BinaryPrimitives.ReadUInt16LittleEndian(
|
||||||
|
peHeaderBytes.AsSpan(MachineOffsetFromPeHeader, sizeof(ushort)));
|
||||||
|
}
|
||||||
|
|
||||||
|
private static WorkerProcessLaunchException InvalidExecutable(string message)
|
||||||
|
{
|
||||||
|
return new WorkerProcessLaunchException(
|
||||||
|
WorkerProcessLaunchErrorCode.InvalidExecutable,
|
||||||
|
message);
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -0,0 +1,30 @@
|
|||||||
|
namespace MxGateway.Server.Workers;
|
||||||
|
|
||||||
|
public sealed class WorkerProcessCommandLine
|
||||||
|
{
|
||||||
|
public WorkerProcessCommandLine(
|
||||||
|
string executablePath,
|
||||||
|
IReadOnlyList<string> arguments)
|
||||||
|
{
|
||||||
|
ExecutablePath = executablePath;
|
||||||
|
Arguments = arguments;
|
||||||
|
}
|
||||||
|
|
||||||
|
public string ExecutablePath { get; }
|
||||||
|
|
||||||
|
public IReadOnlyList<string> Arguments { get; }
|
||||||
|
|
||||||
|
public override string ToString()
|
||||||
|
{
|
||||||
|
return string.Join(
|
||||||
|
" ",
|
||||||
|
new[] { Quote(ExecutablePath) }.Concat(Arguments.Select(Quote)));
|
||||||
|
}
|
||||||
|
|
||||||
|
private static string Quote(string value)
|
||||||
|
{
|
||||||
|
return value.Contains(' ', StringComparison.Ordinal)
|
||||||
|
? $"\"{value}\""
|
||||||
|
: value;
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -0,0 +1,28 @@
|
|||||||
|
namespace MxGateway.Server.Workers;
|
||||||
|
|
||||||
|
public sealed class WorkerProcessHandle : IDisposable
|
||||||
|
{
|
||||||
|
public WorkerProcessHandle(
|
||||||
|
IWorkerProcess process,
|
||||||
|
WorkerProcessCommandLine commandLine,
|
||||||
|
DateTimeOffset launchedAt)
|
||||||
|
{
|
||||||
|
Process = process;
|
||||||
|
ProcessId = process.Id;
|
||||||
|
CommandLine = commandLine;
|
||||||
|
LaunchedAt = launchedAt;
|
||||||
|
}
|
||||||
|
|
||||||
|
public IWorkerProcess Process { get; }
|
||||||
|
|
||||||
|
public int ProcessId { get; }
|
||||||
|
|
||||||
|
public WorkerProcessCommandLine CommandLine { get; }
|
||||||
|
|
||||||
|
public DateTimeOffset LaunchedAt { get; }
|
||||||
|
|
||||||
|
public void Dispose()
|
||||||
|
{
|
||||||
|
Process.Dispose();
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -0,0 +1,13 @@
|
|||||||
|
namespace MxGateway.Server.Workers;
|
||||||
|
|
||||||
|
public enum WorkerProcessLaunchErrorCode
|
||||||
|
{
|
||||||
|
Unknown = 0,
|
||||||
|
InvalidRequest = 1,
|
||||||
|
ExecutableNotFound = 2,
|
||||||
|
InvalidExecutable = 3,
|
||||||
|
InvalidWorkingDirectory = 4,
|
||||||
|
StartFailed = 5,
|
||||||
|
StartupTimeout = 6,
|
||||||
|
StartupFailed = 7,
|
||||||
|
}
|
||||||
@@ -0,0 +1,23 @@
|
|||||||
|
namespace MxGateway.Server.Workers;
|
||||||
|
|
||||||
|
public sealed class WorkerProcessLaunchException : Exception
|
||||||
|
{
|
||||||
|
public WorkerProcessLaunchException(
|
||||||
|
WorkerProcessLaunchErrorCode errorCode,
|
||||||
|
string message)
|
||||||
|
: base(message)
|
||||||
|
{
|
||||||
|
ErrorCode = errorCode;
|
||||||
|
}
|
||||||
|
|
||||||
|
public WorkerProcessLaunchException(
|
||||||
|
WorkerProcessLaunchErrorCode errorCode,
|
||||||
|
string message,
|
||||||
|
Exception innerException)
|
||||||
|
: base(message, innerException)
|
||||||
|
{
|
||||||
|
ErrorCode = errorCode;
|
||||||
|
}
|
||||||
|
|
||||||
|
public WorkerProcessLaunchErrorCode ErrorCode { get; }
|
||||||
|
}
|
||||||
@@ -0,0 +1,8 @@
|
|||||||
|
namespace MxGateway.Server.Workers;
|
||||||
|
|
||||||
|
public sealed record WorkerProcessLaunchRequest(
|
||||||
|
string SessionId,
|
||||||
|
string PipeName,
|
||||||
|
uint ProtocolVersion,
|
||||||
|
string Nonce,
|
||||||
|
IDisposable? PipeReservation = null);
|
||||||
@@ -0,0 +1,262 @@
|
|||||||
|
using System.Diagnostics;
|
||||||
|
using Microsoft.Extensions.Options;
|
||||||
|
using MxGateway.Server.Configuration;
|
||||||
|
using MxGateway.Server.Metrics;
|
||||||
|
|
||||||
|
namespace MxGateway.Server.Workers;
|
||||||
|
|
||||||
|
public sealed class WorkerProcessLauncher : IWorkerProcessLauncher
|
||||||
|
{
|
||||||
|
public const string WorkerNonceEnvironmentVariableName = "MXGATEWAY_WORKER_NONCE";
|
||||||
|
|
||||||
|
private readonly IWorkerProcessFactory _processFactory;
|
||||||
|
private readonly IWorkerStartupProbe _startupProbe;
|
||||||
|
private readonly GatewayMetrics _metrics;
|
||||||
|
private readonly TimeProvider _timeProvider;
|
||||||
|
private readonly WorkerOptions _workerOptions;
|
||||||
|
|
||||||
|
public WorkerProcessLauncher(
|
||||||
|
IOptions<GatewayOptions> gatewayOptions,
|
||||||
|
IWorkerProcessFactory processFactory,
|
||||||
|
IWorkerStartupProbe startupProbe,
|
||||||
|
GatewayMetrics metrics,
|
||||||
|
TimeProvider? timeProvider = null)
|
||||||
|
{
|
||||||
|
ArgumentNullException.ThrowIfNull(gatewayOptions);
|
||||||
|
ArgumentNullException.ThrowIfNull(processFactory);
|
||||||
|
ArgumentNullException.ThrowIfNull(startupProbe);
|
||||||
|
ArgumentNullException.ThrowIfNull(metrics);
|
||||||
|
|
||||||
|
_workerOptions = gatewayOptions.Value.Worker;
|
||||||
|
_processFactory = processFactory;
|
||||||
|
_startupProbe = startupProbe;
|
||||||
|
_metrics = metrics;
|
||||||
|
_timeProvider = timeProvider ?? TimeProvider.System;
|
||||||
|
}
|
||||||
|
|
||||||
|
public async Task<WorkerProcessHandle> LaunchAsync(
|
||||||
|
WorkerProcessLaunchRequest request,
|
||||||
|
CancellationToken cancellationToken = default)
|
||||||
|
{
|
||||||
|
try
|
||||||
|
{
|
||||||
|
return await LaunchCoreAsync(request, cancellationToken).ConfigureAwait(false);
|
||||||
|
}
|
||||||
|
catch
|
||||||
|
{
|
||||||
|
request.PipeReservation?.Dispose();
|
||||||
|
throw;
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
private async Task<WorkerProcessHandle> LaunchCoreAsync(
|
||||||
|
WorkerProcessLaunchRequest request,
|
||||||
|
CancellationToken cancellationToken)
|
||||||
|
{
|
||||||
|
ValidateRequest(request);
|
||||||
|
|
||||||
|
DateTimeOffset startedAt = _timeProvider.GetUtcNow();
|
||||||
|
ProcessStartInfo startInfo = CreateStartInfo(request, out WorkerProcessCommandLine commandLine);
|
||||||
|
|
||||||
|
IWorkerProcess process;
|
||||||
|
try
|
||||||
|
{
|
||||||
|
process = _processFactory.Start(startInfo);
|
||||||
|
}
|
||||||
|
catch (Exception exception) when (exception is not WorkerProcessLaunchException)
|
||||||
|
{
|
||||||
|
throw new WorkerProcessLaunchException(
|
||||||
|
WorkerProcessLaunchErrorCode.StartFailed,
|
||||||
|
"Worker process failed to start.",
|
||||||
|
exception);
|
||||||
|
}
|
||||||
|
|
||||||
|
try
|
||||||
|
{
|
||||||
|
using CancellationTokenSource startupTimeout = CancellationTokenSource.CreateLinkedTokenSource(cancellationToken);
|
||||||
|
startupTimeout.CancelAfter(TimeSpan.FromSeconds(_workerOptions.StartupTimeoutSeconds));
|
||||||
|
|
||||||
|
await _startupProbe
|
||||||
|
.WaitUntilReadyAsync(process, request, startupTimeout.Token)
|
||||||
|
.ConfigureAwait(false);
|
||||||
|
|
||||||
|
_metrics.WorkerStarted(_timeProvider.GetUtcNow() - startedAt);
|
||||||
|
|
||||||
|
return new WorkerProcessHandle(process, commandLine, startedAt);
|
||||||
|
}
|
||||||
|
catch (OperationCanceledException exception) when (!cancellationToken.IsCancellationRequested)
|
||||||
|
{
|
||||||
|
KillAndDispose(process, "StartupTimeout");
|
||||||
|
throw new WorkerProcessLaunchException(
|
||||||
|
WorkerProcessLaunchErrorCode.StartupTimeout,
|
||||||
|
"Worker process did not complete startup before the configured timeout.",
|
||||||
|
exception);
|
||||||
|
}
|
||||||
|
catch (OperationCanceledException)
|
||||||
|
{
|
||||||
|
KillAndDispose(process, "LaunchCanceled");
|
||||||
|
throw;
|
||||||
|
}
|
||||||
|
catch (Exception exception) when (exception is not WorkerProcessLaunchException)
|
||||||
|
{
|
||||||
|
KillAndDispose(process, "StartupFailed");
|
||||||
|
throw new WorkerProcessLaunchException(
|
||||||
|
WorkerProcessLaunchErrorCode.StartupFailed,
|
||||||
|
"Worker process failed during startup.",
|
||||||
|
exception);
|
||||||
|
}
|
||||||
|
catch (WorkerProcessLaunchException)
|
||||||
|
{
|
||||||
|
KillAndDispose(process, "StartupFailed");
|
||||||
|
throw;
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
private ProcessStartInfo CreateStartInfo(
|
||||||
|
WorkerProcessLaunchRequest request,
|
||||||
|
out WorkerProcessCommandLine commandLine)
|
||||||
|
{
|
||||||
|
string executablePath = ResolveExecutablePath();
|
||||||
|
string workingDirectory = ResolveWorkingDirectory(executablePath);
|
||||||
|
string[] arguments =
|
||||||
|
[
|
||||||
|
"--session-id",
|
||||||
|
request.SessionId,
|
||||||
|
"--pipe-name",
|
||||||
|
request.PipeName,
|
||||||
|
"--protocol-version",
|
||||||
|
request.ProtocolVersion.ToString(System.Globalization.CultureInfo.InvariantCulture),
|
||||||
|
];
|
||||||
|
|
||||||
|
ProcessStartInfo startInfo = new()
|
||||||
|
{
|
||||||
|
FileName = executablePath,
|
||||||
|
WorkingDirectory = workingDirectory,
|
||||||
|
UseShellExecute = false,
|
||||||
|
CreateNoWindow = true,
|
||||||
|
ErrorDialog = false,
|
||||||
|
};
|
||||||
|
|
||||||
|
foreach (string argument in arguments)
|
||||||
|
{
|
||||||
|
startInfo.ArgumentList.Add(argument);
|
||||||
|
}
|
||||||
|
|
||||||
|
startInfo.Environment[WorkerNonceEnvironmentVariableName] = request.Nonce;
|
||||||
|
|
||||||
|
commandLine = new WorkerProcessCommandLine(executablePath, arguments);
|
||||||
|
|
||||||
|
return startInfo;
|
||||||
|
}
|
||||||
|
|
||||||
|
private string ResolveExecutablePath()
|
||||||
|
{
|
||||||
|
string executablePath;
|
||||||
|
try
|
||||||
|
{
|
||||||
|
executablePath = Path.GetFullPath(_workerOptions.ExecutablePath);
|
||||||
|
}
|
||||||
|
catch (Exception exception) when (exception is ArgumentException or NotSupportedException or PathTooLongException)
|
||||||
|
{
|
||||||
|
throw new WorkerProcessLaunchException(
|
||||||
|
WorkerProcessLaunchErrorCode.InvalidExecutable,
|
||||||
|
"Worker executable path is not a valid filesystem path.",
|
||||||
|
exception);
|
||||||
|
}
|
||||||
|
|
||||||
|
if (!string.Equals(Path.GetExtension(executablePath), ".exe", StringComparison.OrdinalIgnoreCase))
|
||||||
|
{
|
||||||
|
throw new WorkerProcessLaunchException(
|
||||||
|
WorkerProcessLaunchErrorCode.InvalidExecutable,
|
||||||
|
"Worker executable path must point to a .exe file.");
|
||||||
|
}
|
||||||
|
|
||||||
|
if (!File.Exists(executablePath))
|
||||||
|
{
|
||||||
|
throw new WorkerProcessLaunchException(
|
||||||
|
WorkerProcessLaunchErrorCode.ExecutableNotFound,
|
||||||
|
"Worker executable does not exist.");
|
||||||
|
}
|
||||||
|
|
||||||
|
WorkerExecutableValidator.Validate(executablePath, _workerOptions.RequiredArchitecture);
|
||||||
|
|
||||||
|
return executablePath;
|
||||||
|
}
|
||||||
|
|
||||||
|
private string ResolveWorkingDirectory(string executablePath)
|
||||||
|
{
|
||||||
|
if (string.IsNullOrWhiteSpace(_workerOptions.WorkingDirectory))
|
||||||
|
{
|
||||||
|
return Path.GetDirectoryName(executablePath) ?? Environment.CurrentDirectory;
|
||||||
|
}
|
||||||
|
|
||||||
|
string workingDirectory;
|
||||||
|
try
|
||||||
|
{
|
||||||
|
workingDirectory = Path.GetFullPath(_workerOptions.WorkingDirectory);
|
||||||
|
}
|
||||||
|
catch (Exception exception) when (exception is ArgumentException or NotSupportedException or PathTooLongException)
|
||||||
|
{
|
||||||
|
throw new WorkerProcessLaunchException(
|
||||||
|
WorkerProcessLaunchErrorCode.InvalidWorkingDirectory,
|
||||||
|
"Worker working directory is not a valid filesystem path.",
|
||||||
|
exception);
|
||||||
|
}
|
||||||
|
|
||||||
|
if (!Directory.Exists(workingDirectory))
|
||||||
|
{
|
||||||
|
throw new WorkerProcessLaunchException(
|
||||||
|
WorkerProcessLaunchErrorCode.InvalidWorkingDirectory,
|
||||||
|
"Worker working directory does not exist.");
|
||||||
|
}
|
||||||
|
|
||||||
|
return workingDirectory;
|
||||||
|
}
|
||||||
|
|
||||||
|
private void KillAndDispose(IWorkerProcess process, string reason)
|
||||||
|
{
|
||||||
|
try
|
||||||
|
{
|
||||||
|
if (!process.HasExited)
|
||||||
|
{
|
||||||
|
process.Kill(entireProcessTree: true);
|
||||||
|
_metrics.WorkerKilled(reason);
|
||||||
|
}
|
||||||
|
}
|
||||||
|
finally
|
||||||
|
{
|
||||||
|
process.Dispose();
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
private static void ValidateRequest(WorkerProcessLaunchRequest request)
|
||||||
|
{
|
||||||
|
if (string.IsNullOrWhiteSpace(request.SessionId))
|
||||||
|
{
|
||||||
|
throw new WorkerProcessLaunchException(
|
||||||
|
WorkerProcessLaunchErrorCode.InvalidRequest,
|
||||||
|
"Worker launch requires a session id.");
|
||||||
|
}
|
||||||
|
|
||||||
|
if (string.IsNullOrWhiteSpace(request.PipeName))
|
||||||
|
{
|
||||||
|
throw new WorkerProcessLaunchException(
|
||||||
|
WorkerProcessLaunchErrorCode.InvalidRequest,
|
||||||
|
"Worker launch requires a pipe name.");
|
||||||
|
}
|
||||||
|
|
||||||
|
if (request.ProtocolVersion == 0)
|
||||||
|
{
|
||||||
|
throw new WorkerProcessLaunchException(
|
||||||
|
WorkerProcessLaunchErrorCode.InvalidRequest,
|
||||||
|
"Worker launch requires a non-zero protocol version.");
|
||||||
|
}
|
||||||
|
|
||||||
|
if (string.IsNullOrWhiteSpace(request.Nonce))
|
||||||
|
{
|
||||||
|
throw new WorkerProcessLaunchException(
|
||||||
|
WorkerProcessLaunchErrorCode.InvalidRequest,
|
||||||
|
"Worker launch requires a nonce.");
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -0,0 +1,19 @@
|
|||||||
|
namespace MxGateway.Server.Workers;
|
||||||
|
|
||||||
|
public sealed class WorkerProcessStartedProbe : IWorkerStartupProbe
|
||||||
|
{
|
||||||
|
public Task WaitUntilReadyAsync(
|
||||||
|
IWorkerProcess process,
|
||||||
|
WorkerProcessLaunchRequest request,
|
||||||
|
CancellationToken cancellationToken)
|
||||||
|
{
|
||||||
|
if (process.HasExited)
|
||||||
|
{
|
||||||
|
throw new WorkerProcessLaunchException(
|
||||||
|
WorkerProcessLaunchErrorCode.StartupFailed,
|
||||||
|
$"Worker process exited before startup completed with exit code {process.ExitCode}.");
|
||||||
|
}
|
||||||
|
|
||||||
|
return Task.CompletedTask;
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -0,0 +1,13 @@
|
|||||||
|
namespace MxGateway.Server.Workers;
|
||||||
|
|
||||||
|
public static class WorkerServiceCollectionExtensions
|
||||||
|
{
|
||||||
|
public static IServiceCollection AddWorkerProcessLauncher(this IServiceCollection services)
|
||||||
|
{
|
||||||
|
services.AddSingleton<IWorkerProcessFactory, SystemWorkerProcessFactory>();
|
||||||
|
services.AddSingleton<IWorkerStartupProbe, WorkerProcessStartedProbe>();
|
||||||
|
services.AddSingleton<IWorkerProcessLauncher, WorkerProcessLauncher>();
|
||||||
|
|
||||||
|
return services;
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -0,0 +1,307 @@
|
|||||||
|
using System.Diagnostics;
|
||||||
|
using Microsoft.Extensions.Options;
|
||||||
|
using MxGateway.Contracts;
|
||||||
|
using MxGateway.Server.Configuration;
|
||||||
|
using MxGateway.Server.Metrics;
|
||||||
|
using MxGateway.Server.Workers;
|
||||||
|
|
||||||
|
namespace MxGateway.Tests.Gateway.Workers;
|
||||||
|
|
||||||
|
public sealed class WorkerProcessLauncherTests
|
||||||
|
{
|
||||||
|
private const string SessionId = "session-1";
|
||||||
|
private const string PipeName = "mxaccess-gateway-123-session-1";
|
||||||
|
private const string Nonce = "super-secret-nonce";
|
||||||
|
|
||||||
|
[Fact]
|
||||||
|
public async Task LaunchAsync_WithValidWorker_StartsProcessWithBootstrapArgumentsAndNonceEnvironment()
|
||||||
|
{
|
||||||
|
using TestDirectory directory = TestDirectory.Create();
|
||||||
|
string executablePath = directory.CreateWorkerExecutable(machine: 0x014c);
|
||||||
|
FakeWorkerProcess process = new(processId: 1234);
|
||||||
|
FakePipeReservation pipeReservation = new();
|
||||||
|
FakeWorkerProcessFactory processFactory = new(process);
|
||||||
|
GatewayMetrics metrics = new();
|
||||||
|
WorkerProcessLauncher launcher = CreateLauncher(executablePath, processFactory, new SucceedingStartupProbe(), metrics);
|
||||||
|
|
||||||
|
using WorkerProcessHandle handle = await launcher.LaunchAsync(CreateRequest(pipeReservation));
|
||||||
|
|
||||||
|
Assert.Equal(1234, handle.ProcessId);
|
||||||
|
Assert.Same(process, handle.Process);
|
||||||
|
Assert.NotNull(processFactory.LastStartInfo);
|
||||||
|
Assert.Equal(Path.GetFullPath(executablePath), processFactory.LastStartInfo.FileName);
|
||||||
|
Assert.False(processFactory.LastStartInfo.UseShellExecute);
|
||||||
|
Assert.True(processFactory.LastStartInfo.CreateNoWindow);
|
||||||
|
Assert.Equal(
|
||||||
|
["--session-id", SessionId, "--pipe-name", PipeName, "--protocol-version", "1"],
|
||||||
|
processFactory.LastStartInfo.ArgumentList);
|
||||||
|
Assert.Equal(Nonce, processFactory.LastStartInfo.Environment[WorkerProcessLauncher.WorkerNonceEnvironmentVariableName]);
|
||||||
|
Assert.DoesNotContain(Nonce, handle.CommandLine.ToString(), StringComparison.Ordinal);
|
||||||
|
Assert.DoesNotContain(Nonce, string.Join(" ", handle.CommandLine.Arguments), StringComparison.Ordinal);
|
||||||
|
Assert.False(pipeReservation.DisposeCalled);
|
||||||
|
Assert.Equal(1, metrics.GetSnapshot().WorkersRunning);
|
||||||
|
}
|
||||||
|
|
||||||
|
[Fact]
|
||||||
|
public async Task LaunchAsync_WhenStartupProbeFails_KillsAndDisposesWorker()
|
||||||
|
{
|
||||||
|
using TestDirectory directory = TestDirectory.Create();
|
||||||
|
string executablePath = directory.CreateWorkerExecutable(machine: 0x014c);
|
||||||
|
FakeWorkerProcess process = new(processId: 1234);
|
||||||
|
FakePipeReservation pipeReservation = new();
|
||||||
|
GatewayMetrics metrics = new();
|
||||||
|
WorkerProcessLauncher launcher = CreateLauncher(
|
||||||
|
executablePath,
|
||||||
|
new FakeWorkerProcessFactory(process),
|
||||||
|
new FailingStartupProbe(),
|
||||||
|
metrics);
|
||||||
|
|
||||||
|
WorkerProcessLaunchException exception =
|
||||||
|
await Assert.ThrowsAsync<WorkerProcessLaunchException>(
|
||||||
|
async () => await launcher.LaunchAsync(CreateRequest(pipeReservation)));
|
||||||
|
|
||||||
|
Assert.Equal(WorkerProcessLaunchErrorCode.StartupFailed, exception.ErrorCode);
|
||||||
|
Assert.True(process.KillCalled);
|
||||||
|
Assert.True(process.DisposeCalled);
|
||||||
|
Assert.True(pipeReservation.DisposeCalled);
|
||||||
|
Assert.Equal(1, metrics.GetSnapshot().WorkerKills);
|
||||||
|
}
|
||||||
|
|
||||||
|
[Fact]
|
||||||
|
public async Task LaunchAsync_WhenStartupTimesOut_KillsAndDisposesWorker()
|
||||||
|
{
|
||||||
|
using TestDirectory directory = TestDirectory.Create();
|
||||||
|
string executablePath = directory.CreateWorkerExecutable(machine: 0x014c);
|
||||||
|
FakeWorkerProcess process = new(processId: 1234);
|
||||||
|
GatewayMetrics metrics = new();
|
||||||
|
WorkerProcessLauncher launcher = CreateLauncher(
|
||||||
|
executablePath,
|
||||||
|
new FakeWorkerProcessFactory(process),
|
||||||
|
new WaitingStartupProbe(),
|
||||||
|
metrics,
|
||||||
|
startupTimeoutSeconds: 1);
|
||||||
|
|
||||||
|
WorkerProcessLaunchException exception =
|
||||||
|
await Assert.ThrowsAsync<WorkerProcessLaunchException>(
|
||||||
|
async () => await launcher.LaunchAsync(CreateRequest()));
|
||||||
|
|
||||||
|
Assert.Equal(WorkerProcessLaunchErrorCode.StartupTimeout, exception.ErrorCode);
|
||||||
|
Assert.True(process.KillCalled);
|
||||||
|
Assert.True(process.DisposeCalled);
|
||||||
|
Assert.Equal(1, metrics.GetSnapshot().WorkerKills);
|
||||||
|
}
|
||||||
|
|
||||||
|
[Fact]
|
||||||
|
public async Task LaunchAsync_WhenExecutableDoesNotExist_FailsBeforeStartingProcess()
|
||||||
|
{
|
||||||
|
using TestDirectory directory = TestDirectory.Create();
|
||||||
|
string executablePath = Path.Combine(directory.Path, "missing-worker.exe");
|
||||||
|
FakeWorkerProcessFactory processFactory = new(new FakeWorkerProcess(processId: 1234));
|
||||||
|
WorkerProcessLauncher launcher = CreateLauncher(executablePath, processFactory, new SucceedingStartupProbe());
|
||||||
|
|
||||||
|
WorkerProcessLaunchException exception =
|
||||||
|
await Assert.ThrowsAsync<WorkerProcessLaunchException>(
|
||||||
|
async () => await launcher.LaunchAsync(CreateRequest()));
|
||||||
|
|
||||||
|
Assert.Equal(WorkerProcessLaunchErrorCode.ExecutableNotFound, exception.ErrorCode);
|
||||||
|
Assert.Null(processFactory.LastStartInfo);
|
||||||
|
}
|
||||||
|
|
||||||
|
[Fact]
|
||||||
|
public async Task LaunchAsync_WhenExecutableArchitectureDoesNotMatch_FailsBeforeStartingProcess()
|
||||||
|
{
|
||||||
|
using TestDirectory directory = TestDirectory.Create();
|
||||||
|
string executablePath = directory.CreateWorkerExecutable(machine: 0x8664);
|
||||||
|
FakeWorkerProcessFactory processFactory = new(new FakeWorkerProcess(processId: 1234));
|
||||||
|
WorkerProcessLauncher launcher = CreateLauncher(executablePath, processFactory, new SucceedingStartupProbe());
|
||||||
|
|
||||||
|
WorkerProcessLaunchException exception =
|
||||||
|
await Assert.ThrowsAsync<WorkerProcessLaunchException>(
|
||||||
|
async () => await launcher.LaunchAsync(CreateRequest()));
|
||||||
|
|
||||||
|
Assert.Equal(WorkerProcessLaunchErrorCode.InvalidExecutable, exception.ErrorCode);
|
||||||
|
Assert.Null(processFactory.LastStartInfo);
|
||||||
|
}
|
||||||
|
|
||||||
|
[Fact]
|
||||||
|
public async Task LaunchAsync_WhenWorkerAlreadyExited_FailsAndDisposesWorkerWithoutKill()
|
||||||
|
{
|
||||||
|
using TestDirectory directory = TestDirectory.Create();
|
||||||
|
string executablePath = directory.CreateWorkerExecutable(machine: 0x014c);
|
||||||
|
FakeWorkerProcess process = new(processId: 1234)
|
||||||
|
{
|
||||||
|
HasExited = true,
|
||||||
|
ExitCode = 42,
|
||||||
|
};
|
||||||
|
WorkerProcessLauncher launcher = CreateLauncher(
|
||||||
|
executablePath,
|
||||||
|
new FakeWorkerProcessFactory(process),
|
||||||
|
new WorkerProcessStartedProbe());
|
||||||
|
|
||||||
|
WorkerProcessLaunchException exception =
|
||||||
|
await Assert.ThrowsAsync<WorkerProcessLaunchException>(
|
||||||
|
async () => await launcher.LaunchAsync(CreateRequest()));
|
||||||
|
|
||||||
|
Assert.Equal(WorkerProcessLaunchErrorCode.StartupFailed, exception.ErrorCode);
|
||||||
|
Assert.False(process.KillCalled);
|
||||||
|
Assert.True(process.DisposeCalled);
|
||||||
|
}
|
||||||
|
|
||||||
|
private static WorkerProcessLauncher CreateLauncher(
|
||||||
|
string executablePath,
|
||||||
|
IWorkerProcessFactory processFactory,
|
||||||
|
IWorkerStartupProbe startupProbe,
|
||||||
|
GatewayMetrics? metrics = null,
|
||||||
|
int startupTimeoutSeconds = 30)
|
||||||
|
{
|
||||||
|
GatewayOptions options = new()
|
||||||
|
{
|
||||||
|
Worker = new WorkerOptions
|
||||||
|
{
|
||||||
|
ExecutablePath = executablePath,
|
||||||
|
RequiredArchitecture = WorkerArchitecture.X86,
|
||||||
|
StartupTimeoutSeconds = startupTimeoutSeconds,
|
||||||
|
},
|
||||||
|
};
|
||||||
|
|
||||||
|
return new WorkerProcessLauncher(
|
||||||
|
Options.Create(options),
|
||||||
|
processFactory,
|
||||||
|
startupProbe,
|
||||||
|
metrics ?? new GatewayMetrics());
|
||||||
|
}
|
||||||
|
|
||||||
|
private static WorkerProcessLaunchRequest CreateRequest(IDisposable? pipeReservation = null)
|
||||||
|
{
|
||||||
|
return new WorkerProcessLaunchRequest(
|
||||||
|
SessionId,
|
||||||
|
PipeName,
|
||||||
|
GatewayContractInfo.WorkerProtocolVersion,
|
||||||
|
Nonce,
|
||||||
|
pipeReservation);
|
||||||
|
}
|
||||||
|
|
||||||
|
private sealed class FakeWorkerProcessFactory(IWorkerProcess process) : IWorkerProcessFactory
|
||||||
|
{
|
||||||
|
public ProcessStartInfo? LastStartInfo { get; private set; }
|
||||||
|
|
||||||
|
public IWorkerProcess Start(ProcessStartInfo startInfo)
|
||||||
|
{
|
||||||
|
LastStartInfo = startInfo;
|
||||||
|
return process;
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
private sealed class FakeWorkerProcess(int processId) : IWorkerProcess
|
||||||
|
{
|
||||||
|
public int Id { get; } = processId;
|
||||||
|
|
||||||
|
public bool HasExited { get; set; }
|
||||||
|
|
||||||
|
public int? ExitCode { get; set; }
|
||||||
|
|
||||||
|
public bool DisposeCalled { get; private set; }
|
||||||
|
|
||||||
|
public bool KillCalled { get; private set; }
|
||||||
|
|
||||||
|
public ValueTask WaitForExitAsync(CancellationToken cancellationToken)
|
||||||
|
{
|
||||||
|
return ValueTask.CompletedTask;
|
||||||
|
}
|
||||||
|
|
||||||
|
public void Kill(bool entireProcessTree)
|
||||||
|
{
|
||||||
|
Assert.True(entireProcessTree);
|
||||||
|
KillCalled = true;
|
||||||
|
HasExited = true;
|
||||||
|
}
|
||||||
|
|
||||||
|
public void Dispose()
|
||||||
|
{
|
||||||
|
DisposeCalled = true;
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
private sealed class SucceedingStartupProbe : IWorkerStartupProbe
|
||||||
|
{
|
||||||
|
public Task WaitUntilReadyAsync(
|
||||||
|
IWorkerProcess process,
|
||||||
|
WorkerProcessLaunchRequest request,
|
||||||
|
CancellationToken cancellationToken)
|
||||||
|
{
|
||||||
|
return Task.CompletedTask;
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
private sealed class FailingStartupProbe : IWorkerStartupProbe
|
||||||
|
{
|
||||||
|
public Task WaitUntilReadyAsync(
|
||||||
|
IWorkerProcess process,
|
||||||
|
WorkerProcessLaunchRequest request,
|
||||||
|
CancellationToken cancellationToken)
|
||||||
|
{
|
||||||
|
throw new InvalidOperationException("Fake worker startup failed.");
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
private sealed class WaitingStartupProbe : IWorkerStartupProbe
|
||||||
|
{
|
||||||
|
public async Task WaitUntilReadyAsync(
|
||||||
|
IWorkerProcess process,
|
||||||
|
WorkerProcessLaunchRequest request,
|
||||||
|
CancellationToken cancellationToken)
|
||||||
|
{
|
||||||
|
await Task.Delay(Timeout.InfiniteTimeSpan, cancellationToken);
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
private sealed class FakePipeReservation : IDisposable
|
||||||
|
{
|
||||||
|
public bool DisposeCalled { get; private set; }
|
||||||
|
|
||||||
|
public void Dispose()
|
||||||
|
{
|
||||||
|
DisposeCalled = true;
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
private sealed class TestDirectory : IDisposable
|
||||||
|
{
|
||||||
|
private TestDirectory(string path)
|
||||||
|
{
|
||||||
|
Path = path;
|
||||||
|
}
|
||||||
|
|
||||||
|
public string Path { get; }
|
||||||
|
|
||||||
|
public static TestDirectory Create()
|
||||||
|
{
|
||||||
|
string path = System.IO.Path.Combine(System.IO.Path.GetTempPath(), $"mxgateway-tests-{Guid.NewGuid():N}");
|
||||||
|
Directory.CreateDirectory(path);
|
||||||
|
|
||||||
|
return new TestDirectory(path);
|
||||||
|
}
|
||||||
|
|
||||||
|
public string CreateWorkerExecutable(ushort machine)
|
||||||
|
{
|
||||||
|
string path = System.IO.Path.Combine(Path, "MxGateway.Worker.exe");
|
||||||
|
byte[] bytes = new byte[0x100];
|
||||||
|
bytes[0] = (byte)'M';
|
||||||
|
bytes[1] = (byte)'Z';
|
||||||
|
BitConverter.GetBytes(0x80).CopyTo(bytes, 0x3c);
|
||||||
|
bytes[0x80] = (byte)'P';
|
||||||
|
bytes[0x81] = (byte)'E';
|
||||||
|
bytes[0x82] = 0;
|
||||||
|
bytes[0x83] = 0;
|
||||||
|
BitConverter.GetBytes(machine).CopyTo(bytes, 0x84);
|
||||||
|
File.WriteAllBytes(path, bytes);
|
||||||
|
|
||||||
|
return path;
|
||||||
|
}
|
||||||
|
|
||||||
|
public void Dispose()
|
||||||
|
{
|
||||||
|
Directory.Delete(Path, recursive: true);
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -0,0 +1,37 @@
|
|||||||
|
using System;
|
||||||
|
using System.Collections.Generic;
|
||||||
|
using MxGateway.Worker.Bootstrap;
|
||||||
|
|
||||||
|
namespace MxGateway.Worker.Tests.Bootstrap;
|
||||||
|
|
||||||
|
internal sealed class MemoryWorkerEnvironment : IWorkerEnvironment
|
||||||
|
{
|
||||||
|
private readonly Dictionary<string, string> _values = new();
|
||||||
|
private readonly Exception? _exception;
|
||||||
|
|
||||||
|
public MemoryWorkerEnvironment()
|
||||||
|
{
|
||||||
|
}
|
||||||
|
|
||||||
|
public MemoryWorkerEnvironment(Exception exception)
|
||||||
|
{
|
||||||
|
_exception = exception;
|
||||||
|
}
|
||||||
|
|
||||||
|
public void Set(string name, string value)
|
||||||
|
{
|
||||||
|
_values[name] = value;
|
||||||
|
}
|
||||||
|
|
||||||
|
public string? GetEnvironmentVariable(string name)
|
||||||
|
{
|
||||||
|
if (_exception is not null)
|
||||||
|
{
|
||||||
|
throw _exception;
|
||||||
|
}
|
||||||
|
|
||||||
|
return _values.TryGetValue(name, out string value)
|
||||||
|
? value
|
||||||
|
: null;
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -0,0 +1,22 @@
|
|||||||
|
using System.Collections.Generic;
|
||||||
|
|
||||||
|
namespace MxGateway.Worker.Tests.Bootstrap;
|
||||||
|
|
||||||
|
internal sealed class MemoryWorkerLogEntry
|
||||||
|
{
|
||||||
|
public MemoryWorkerLogEntry(
|
||||||
|
string level,
|
||||||
|
string eventName,
|
||||||
|
IReadOnlyDictionary<string, object?> fields)
|
||||||
|
{
|
||||||
|
Level = level;
|
||||||
|
EventName = eventName;
|
||||||
|
Fields = fields;
|
||||||
|
}
|
||||||
|
|
||||||
|
public string Level { get; }
|
||||||
|
|
||||||
|
public string EventName { get; }
|
||||||
|
|
||||||
|
public IReadOnlyDictionary<string, object?> Fields { get; }
|
||||||
|
}
|
||||||
@@ -0,0 +1,19 @@
|
|||||||
|
using System.Collections.Generic;
|
||||||
|
using MxGateway.Worker.Bootstrap;
|
||||||
|
|
||||||
|
namespace MxGateway.Worker.Tests.Bootstrap;
|
||||||
|
|
||||||
|
internal sealed class MemoryWorkerLogger : IWorkerLogger
|
||||||
|
{
|
||||||
|
public List<MemoryWorkerLogEntry> Entries { get; } = new();
|
||||||
|
|
||||||
|
public void Information(string eventName, IReadOnlyDictionary<string, object?> fields)
|
||||||
|
{
|
||||||
|
Entries.Add(new MemoryWorkerLogEntry("Information", eventName, WorkerLogRedactor.RedactFields(fields)));
|
||||||
|
}
|
||||||
|
|
||||||
|
public void Error(string eventName, IReadOnlyDictionary<string, object?> fields)
|
||||||
|
{
|
||||||
|
Entries.Add(new MemoryWorkerLogEntry("Error", eventName, WorkerLogRedactor.RedactFields(fields)));
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -0,0 +1,113 @@
|
|||||||
|
using System;
|
||||||
|
using MxGateway.Contracts;
|
||||||
|
using MxGateway.Worker.Bootstrap;
|
||||||
|
|
||||||
|
namespace MxGateway.Worker.Tests.Bootstrap;
|
||||||
|
|
||||||
|
public sealed class WorkerApplicationTests
|
||||||
|
{
|
||||||
|
[Fact]
|
||||||
|
public void Run_WithValidBootstrapArguments_ReturnsSuccessAndLogsRedactedNonce()
|
||||||
|
{
|
||||||
|
MemoryWorkerEnvironment environment = CreateEnvironment("nonce-secret");
|
||||||
|
MemoryWorkerLogger logger = new();
|
||||||
|
|
||||||
|
int exitCode = MxGateway.Worker.WorkerApplication.Run(
|
||||||
|
ValidArgs(),
|
||||||
|
environment,
|
||||||
|
logger);
|
||||||
|
|
||||||
|
Assert.Equal((int)WorkerExitCode.Success, exitCode);
|
||||||
|
MemoryWorkerLogEntry entry = Assert.Single(logger.Entries);
|
||||||
|
Assert.Equal("Information", entry.Level);
|
||||||
|
Assert.Equal("WorkerBootstrapSucceeded", entry.EventName);
|
||||||
|
Assert.Equal("session-1", entry.Fields["session_id"]);
|
||||||
|
Assert.Equal("mxaccess-gateway-123-session-1", entry.Fields["pipe_name"]);
|
||||||
|
Assert.Equal(GatewayContractInfo.WorkerProtocolVersion, entry.Fields["protocol_version"]);
|
||||||
|
Assert.Equal("[redacted]", entry.Fields["nonce"]);
|
||||||
|
}
|
||||||
|
|
||||||
|
[Fact]
|
||||||
|
public void Run_WithMissingRequiredArguments_ReturnsInvalidArguments()
|
||||||
|
{
|
||||||
|
MemoryWorkerEnvironment environment = CreateEnvironment("nonce-secret");
|
||||||
|
MemoryWorkerLogger logger = new();
|
||||||
|
|
||||||
|
int exitCode = MxGateway.Worker.WorkerApplication.Run(
|
||||||
|
[],
|
||||||
|
environment,
|
||||||
|
logger);
|
||||||
|
|
||||||
|
Assert.Equal((int)WorkerExitCode.InvalidArguments, exitCode);
|
||||||
|
MemoryWorkerLogEntry entry = Assert.Single(logger.Entries);
|
||||||
|
Assert.Equal("Error", entry.Level);
|
||||||
|
Assert.Equal("WorkerBootstrapFailed", entry.EventName);
|
||||||
|
Assert.Equal(WorkerExitCode.InvalidArguments, entry.Fields["exit_code"]);
|
||||||
|
}
|
||||||
|
|
||||||
|
[Fact]
|
||||||
|
public void Run_WithInvalidProtocolVersion_ReturnsInvalidProtocolVersion()
|
||||||
|
{
|
||||||
|
MemoryWorkerEnvironment environment = CreateEnvironment("nonce-secret");
|
||||||
|
MemoryWorkerLogger logger = new();
|
||||||
|
|
||||||
|
int exitCode = MxGateway.Worker.WorkerApplication.Run(
|
||||||
|
ValidArgs(protocolVersion: "999"),
|
||||||
|
environment,
|
||||||
|
logger);
|
||||||
|
|
||||||
|
Assert.Equal((int)WorkerExitCode.InvalidProtocolVersion, exitCode);
|
||||||
|
}
|
||||||
|
|
||||||
|
[Fact]
|
||||||
|
public void Run_WithMissingNonce_ReturnsMissingNonce()
|
||||||
|
{
|
||||||
|
MemoryWorkerEnvironment environment = new();
|
||||||
|
MemoryWorkerLogger logger = new();
|
||||||
|
|
||||||
|
int exitCode = MxGateway.Worker.WorkerApplication.Run(
|
||||||
|
ValidArgs(),
|
||||||
|
environment,
|
||||||
|
logger);
|
||||||
|
|
||||||
|
Assert.Equal((int)WorkerExitCode.MissingNonce, exitCode);
|
||||||
|
}
|
||||||
|
|
||||||
|
[Fact]
|
||||||
|
public void Run_WithUnexpectedBootstrapFailure_ReturnsUnexpectedFailure()
|
||||||
|
{
|
||||||
|
MemoryWorkerEnvironment environment = new(new InvalidOperationException("environment failed"));
|
||||||
|
MemoryWorkerLogger logger = new();
|
||||||
|
|
||||||
|
int exitCode = MxGateway.Worker.WorkerApplication.Run(
|
||||||
|
ValidArgs(),
|
||||||
|
environment,
|
||||||
|
logger);
|
||||||
|
|
||||||
|
Assert.Equal((int)WorkerExitCode.UnexpectedFailure, exitCode);
|
||||||
|
MemoryWorkerLogEntry entry = Assert.Single(logger.Entries);
|
||||||
|
Assert.Equal("WorkerBootstrapUnexpectedFailure", entry.EventName);
|
||||||
|
Assert.Equal(WorkerExitCode.UnexpectedFailure, entry.Fields["exit_code"]);
|
||||||
|
Assert.Equal(typeof(InvalidOperationException).FullName, entry.Fields["exception_type"]);
|
||||||
|
}
|
||||||
|
|
||||||
|
private static string[] ValidArgs(string? protocolVersion = null)
|
||||||
|
{
|
||||||
|
return
|
||||||
|
[
|
||||||
|
"--session-id",
|
||||||
|
"session-1",
|
||||||
|
"--pipe-name",
|
||||||
|
"mxaccess-gateway-123-session-1",
|
||||||
|
"--protocol-version",
|
||||||
|
protocolVersion ?? GatewayContractInfo.WorkerProtocolVersion.ToString(),
|
||||||
|
];
|
||||||
|
}
|
||||||
|
|
||||||
|
private static MemoryWorkerEnvironment CreateEnvironment(string nonce)
|
||||||
|
{
|
||||||
|
MemoryWorkerEnvironment environment = new();
|
||||||
|
environment.Set(WorkerOptions.NonceEnvironmentVariableName, nonce);
|
||||||
|
return environment;
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -0,0 +1,28 @@
|
|||||||
|
using System.Collections.Generic;
|
||||||
|
using System.IO;
|
||||||
|
using MxGateway.Worker.Bootstrap;
|
||||||
|
|
||||||
|
namespace MxGateway.Worker.Tests.Bootstrap;
|
||||||
|
|
||||||
|
public sealed class WorkerConsoleLoggerTests
|
||||||
|
{
|
||||||
|
[Fact]
|
||||||
|
public void Information_RedactsNonceInStructuredOutput()
|
||||||
|
{
|
||||||
|
StringWriter writer = new();
|
||||||
|
WorkerConsoleLogger logger = new(writer);
|
||||||
|
|
||||||
|
logger.Information("WorkerBootstrapSucceeded", new Dictionary<string, object?>
|
||||||
|
{
|
||||||
|
["session_id"] = "session-1",
|
||||||
|
["nonce"] = "nonce-secret",
|
||||||
|
});
|
||||||
|
|
||||||
|
string output = writer.ToString();
|
||||||
|
|
||||||
|
Assert.Contains("event=WorkerBootstrapSucceeded", output);
|
||||||
|
Assert.Contains("session_id=session-1", output);
|
||||||
|
Assert.Contains("nonce=[redacted]", output);
|
||||||
|
Assert.DoesNotContain("nonce-secret", output);
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -0,0 +1,32 @@
|
|||||||
|
using System.Collections.Generic;
|
||||||
|
using MxGateway.Worker.Bootstrap;
|
||||||
|
|
||||||
|
namespace MxGateway.Worker.Tests.Bootstrap;
|
||||||
|
|
||||||
|
public sealed class WorkerLogRedactorTests
|
||||||
|
{
|
||||||
|
[Fact]
|
||||||
|
public void RedactFields_RedactsNonceSecretPasswordTokenCredentialAndApiKeyFields()
|
||||||
|
{
|
||||||
|
Dictionary<string, object?> fields = new()
|
||||||
|
{
|
||||||
|
["nonce"] = "nonce-secret",
|
||||||
|
["client_secret"] = "secret",
|
||||||
|
["password"] = "password",
|
||||||
|
["auth_token"] = "token",
|
||||||
|
["credential_value"] = "credential",
|
||||||
|
["api_key"] = "key",
|
||||||
|
["session_id"] = "session-1",
|
||||||
|
};
|
||||||
|
|
||||||
|
Dictionary<string, object?> redacted = WorkerLogRedactor.RedactFields(fields);
|
||||||
|
|
||||||
|
Assert.Equal("[redacted]", redacted["nonce"]);
|
||||||
|
Assert.Equal("[redacted]", redacted["client_secret"]);
|
||||||
|
Assert.Equal("[redacted]", redacted["password"]);
|
||||||
|
Assert.Equal("[redacted]", redacted["auth_token"]);
|
||||||
|
Assert.Equal("[redacted]", redacted["credential_value"]);
|
||||||
|
Assert.Equal("[redacted]", redacted["api_key"]);
|
||||||
|
Assert.Equal("session-1", redacted["session_id"]);
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -0,0 +1,115 @@
|
|||||||
|
using MxGateway.Contracts;
|
||||||
|
using MxGateway.Worker.Bootstrap;
|
||||||
|
|
||||||
|
namespace MxGateway.Worker.Tests.Bootstrap;
|
||||||
|
|
||||||
|
public sealed class WorkerOptionsParserTests
|
||||||
|
{
|
||||||
|
[Fact]
|
||||||
|
public void Parse_WithAllRequiredInputs_ReturnsWorkerOptions()
|
||||||
|
{
|
||||||
|
WorkerOptionsParser parser = new(CreateEnvironment("nonce-secret"));
|
||||||
|
|
||||||
|
WorkerBootstrapResult result = parser.Parse(ValidArgs());
|
||||||
|
|
||||||
|
Assert.True(result.Succeeded);
|
||||||
|
Assert.Equal(WorkerExitCode.Success, result.ExitCode);
|
||||||
|
Assert.NotNull(result.Options);
|
||||||
|
Assert.Equal("session-1", result.Options.SessionId);
|
||||||
|
Assert.Equal("mxaccess-gateway-123-session-1", result.Options.PipeName);
|
||||||
|
Assert.Equal(GatewayContractInfo.WorkerProtocolVersion, result.Options.ProtocolVersion);
|
||||||
|
Assert.Equal("nonce-secret", result.Options.Nonce);
|
||||||
|
}
|
||||||
|
|
||||||
|
[Fact]
|
||||||
|
public void Parse_WithMissingSessionId_ReturnsInvalidArguments()
|
||||||
|
{
|
||||||
|
WorkerOptionsParser parser = new(CreateEnvironment("nonce-secret"));
|
||||||
|
|
||||||
|
WorkerBootstrapResult result = parser.Parse(
|
||||||
|
[
|
||||||
|
"--pipe-name",
|
||||||
|
"mxaccess-gateway-123-session-1",
|
||||||
|
"--protocol-version",
|
||||||
|
GatewayContractInfo.WorkerProtocolVersion.ToString(),
|
||||||
|
]);
|
||||||
|
|
||||||
|
Assert.False(result.Succeeded);
|
||||||
|
Assert.Equal(WorkerExitCode.InvalidArguments, result.ExitCode);
|
||||||
|
Assert.Contains(result.Errors, error => error.Contains("--session-id"));
|
||||||
|
}
|
||||||
|
|
||||||
|
[Fact]
|
||||||
|
public void Parse_WithUnknownOption_ReturnsInvalidArguments()
|
||||||
|
{
|
||||||
|
WorkerOptionsParser parser = new(CreateEnvironment("nonce-secret"));
|
||||||
|
|
||||||
|
WorkerBootstrapResult result = parser.Parse(
|
||||||
|
[
|
||||||
|
"--session-id",
|
||||||
|
"session-1",
|
||||||
|
"--pipe-name",
|
||||||
|
"mxaccess-gateway-123-session-1",
|
||||||
|
"--protocol-version",
|
||||||
|
GatewayContractInfo.WorkerProtocolVersion.ToString(),
|
||||||
|
"--unexpected",
|
||||||
|
"value",
|
||||||
|
]);
|
||||||
|
|
||||||
|
Assert.Equal(WorkerExitCode.InvalidArguments, result.ExitCode);
|
||||||
|
Assert.Contains(result.Errors, error => error.Contains("Unknown option"));
|
||||||
|
}
|
||||||
|
|
||||||
|
[Fact]
|
||||||
|
public void Parse_WithNonNumericProtocolVersion_ReturnsInvalidProtocolVersion()
|
||||||
|
{
|
||||||
|
WorkerOptionsParser parser = new(CreateEnvironment("nonce-secret"));
|
||||||
|
|
||||||
|
WorkerBootstrapResult result = parser.Parse(ValidArgs(protocolVersion: "abc"));
|
||||||
|
|
||||||
|
Assert.False(result.Succeeded);
|
||||||
|
Assert.Equal(WorkerExitCode.InvalidProtocolVersion, result.ExitCode);
|
||||||
|
}
|
||||||
|
|
||||||
|
[Fact]
|
||||||
|
public void Parse_WithUnsupportedProtocolVersion_ReturnsInvalidProtocolVersion()
|
||||||
|
{
|
||||||
|
WorkerOptionsParser parser = new(CreateEnvironment("nonce-secret"));
|
||||||
|
|
||||||
|
WorkerBootstrapResult result = parser.Parse(ValidArgs(protocolVersion: "999"));
|
||||||
|
|
||||||
|
Assert.False(result.Succeeded);
|
||||||
|
Assert.Equal(WorkerExitCode.InvalidProtocolVersion, result.ExitCode);
|
||||||
|
}
|
||||||
|
|
||||||
|
[Fact]
|
||||||
|
public void Parse_WithMissingNonce_ReturnsMissingNonce()
|
||||||
|
{
|
||||||
|
WorkerOptionsParser parser = new(new MemoryWorkerEnvironment());
|
||||||
|
|
||||||
|
WorkerBootstrapResult result = parser.Parse(ValidArgs());
|
||||||
|
|
||||||
|
Assert.False(result.Succeeded);
|
||||||
|
Assert.Equal(WorkerExitCode.MissingNonce, result.ExitCode);
|
||||||
|
}
|
||||||
|
|
||||||
|
private static string[] ValidArgs(string? protocolVersion = null)
|
||||||
|
{
|
||||||
|
return
|
||||||
|
[
|
||||||
|
"--session-id",
|
||||||
|
"session-1",
|
||||||
|
"--pipe-name",
|
||||||
|
"mxaccess-gateway-123-session-1",
|
||||||
|
"--protocol-version",
|
||||||
|
protocolVersion ?? GatewayContractInfo.WorkerProtocolVersion.ToString(),
|
||||||
|
];
|
||||||
|
}
|
||||||
|
|
||||||
|
private static MemoryWorkerEnvironment CreateEnvironment(string nonce)
|
||||||
|
{
|
||||||
|
MemoryWorkerEnvironment environment = new();
|
||||||
|
environment.Set(WorkerOptions.NonceEnvironmentVariableName, nonce);
|
||||||
|
return environment;
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -1 +0,0 @@
|
|||||||
|
|
||||||
@@ -0,0 +1,11 @@
|
|||||||
|
using System;
|
||||||
|
|
||||||
|
namespace MxGateway.Worker.Bootstrap;
|
||||||
|
|
||||||
|
public sealed class EnvironmentVariableWorkerEnvironment : IWorkerEnvironment
|
||||||
|
{
|
||||||
|
public string? GetEnvironmentVariable(string name)
|
||||||
|
{
|
||||||
|
return Environment.GetEnvironmentVariable(name);
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -0,0 +1,6 @@
|
|||||||
|
namespace MxGateway.Worker.Bootstrap;
|
||||||
|
|
||||||
|
public interface IWorkerEnvironment
|
||||||
|
{
|
||||||
|
string? GetEnvironmentVariable(string name);
|
||||||
|
}
|
||||||
@@ -0,0 +1,10 @@
|
|||||||
|
using System.Collections.Generic;
|
||||||
|
|
||||||
|
namespace MxGateway.Worker.Bootstrap;
|
||||||
|
|
||||||
|
public interface IWorkerLogger
|
||||||
|
{
|
||||||
|
void Information(string eventName, IReadOnlyDictionary<string, object?> fields);
|
||||||
|
|
||||||
|
void Error(string eventName, IReadOnlyDictionary<string, object?> fields);
|
||||||
|
}
|
||||||
@@ -0,0 +1,35 @@
|
|||||||
|
using System.Collections.Generic;
|
||||||
|
using System.Linq;
|
||||||
|
|
||||||
|
namespace MxGateway.Worker.Bootstrap;
|
||||||
|
|
||||||
|
public sealed class WorkerBootstrapResult
|
||||||
|
{
|
||||||
|
private WorkerBootstrapResult(
|
||||||
|
WorkerExitCode exitCode,
|
||||||
|
WorkerOptions? options,
|
||||||
|
IReadOnlyList<string> errors)
|
||||||
|
{
|
||||||
|
ExitCode = exitCode;
|
||||||
|
Options = options;
|
||||||
|
Errors = errors;
|
||||||
|
}
|
||||||
|
|
||||||
|
public WorkerExitCode ExitCode { get; }
|
||||||
|
|
||||||
|
public WorkerOptions? Options { get; }
|
||||||
|
|
||||||
|
public IReadOnlyList<string> Errors { get; }
|
||||||
|
|
||||||
|
public bool Succeeded => ExitCode == WorkerExitCode.Success;
|
||||||
|
|
||||||
|
public static WorkerBootstrapResult Success(WorkerOptions options)
|
||||||
|
{
|
||||||
|
return new WorkerBootstrapResult(WorkerExitCode.Success, options, []);
|
||||||
|
}
|
||||||
|
|
||||||
|
public static WorkerBootstrapResult Failure(WorkerExitCode exitCode, IEnumerable<string> errors)
|
||||||
|
{
|
||||||
|
return new WorkerBootstrapResult(exitCode, null, errors.ToArray());
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -0,0 +1,44 @@
|
|||||||
|
using System;
|
||||||
|
using System.Collections.Generic;
|
||||||
|
using System.IO;
|
||||||
|
using System.Linq;
|
||||||
|
|
||||||
|
namespace MxGateway.Worker.Bootstrap;
|
||||||
|
|
||||||
|
public sealed class WorkerConsoleLogger : IWorkerLogger
|
||||||
|
{
|
||||||
|
private readonly TextWriter _writer;
|
||||||
|
|
||||||
|
public WorkerConsoleLogger(TextWriter writer)
|
||||||
|
{
|
||||||
|
_writer = writer ?? throw new ArgumentNullException(nameof(writer));
|
||||||
|
}
|
||||||
|
|
||||||
|
public void Information(string eventName, IReadOnlyDictionary<string, object?> fields)
|
||||||
|
{
|
||||||
|
Write("Information", eventName, fields);
|
||||||
|
}
|
||||||
|
|
||||||
|
public void Error(string eventName, IReadOnlyDictionary<string, object?> fields)
|
||||||
|
{
|
||||||
|
Write("Error", eventName, fields);
|
||||||
|
}
|
||||||
|
|
||||||
|
private void Write(
|
||||||
|
string level,
|
||||||
|
string eventName,
|
||||||
|
IReadOnlyDictionary<string, object?> fields)
|
||||||
|
{
|
||||||
|
Dictionary<string, object?> redactedFields = WorkerLogRedactor.RedactFields(fields);
|
||||||
|
string fieldText = string.Join(
|
||||||
|
" ",
|
||||||
|
redactedFields.Select(field => $"{field.Key}={FormatValue(field.Value)}"));
|
||||||
|
|
||||||
|
_writer.WriteLine($"level={level} event={eventName} {fieldText}".TrimEnd());
|
||||||
|
}
|
||||||
|
|
||||||
|
private static string FormatValue(object? value)
|
||||||
|
{
|
||||||
|
return value?.ToString() ?? string.Empty;
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -0,0 +1,10 @@
|
|||||||
|
namespace MxGateway.Worker.Bootstrap;
|
||||||
|
|
||||||
|
public enum WorkerExitCode
|
||||||
|
{
|
||||||
|
Success = 0,
|
||||||
|
UnexpectedFailure = 1,
|
||||||
|
InvalidArguments = 2,
|
||||||
|
InvalidProtocolVersion = 3,
|
||||||
|
MissingNonce = 4,
|
||||||
|
}
|
||||||
@@ -0,0 +1,50 @@
|
|||||||
|
using System;
|
||||||
|
using System.Collections.Generic;
|
||||||
|
|
||||||
|
namespace MxGateway.Worker.Bootstrap;
|
||||||
|
|
||||||
|
public static class WorkerLogRedactor
|
||||||
|
{
|
||||||
|
public const string RedactedValue = "[redacted]";
|
||||||
|
|
||||||
|
private static readonly string[] SensitiveFieldNameParts =
|
||||||
|
[
|
||||||
|
"nonce",
|
||||||
|
"secret",
|
||||||
|
"password",
|
||||||
|
"token",
|
||||||
|
"credential",
|
||||||
|
"apikey",
|
||||||
|
"api_key",
|
||||||
|
];
|
||||||
|
|
||||||
|
public static Dictionary<string, object?> RedactFields(IReadOnlyDictionary<string, object?> fields)
|
||||||
|
{
|
||||||
|
Dictionary<string, object?> redactedFields = [];
|
||||||
|
|
||||||
|
foreach (KeyValuePair<string, object?> field in fields)
|
||||||
|
{
|
||||||
|
redactedFields[field.Key] = RedactValue(field.Key, field.Value);
|
||||||
|
}
|
||||||
|
|
||||||
|
return redactedFields;
|
||||||
|
}
|
||||||
|
|
||||||
|
public static object? RedactValue(string fieldName, object? value)
|
||||||
|
{
|
||||||
|
if (value is null)
|
||||||
|
{
|
||||||
|
return null;
|
||||||
|
}
|
||||||
|
|
||||||
|
foreach (string sensitiveFieldNamePart in SensitiveFieldNameParts)
|
||||||
|
{
|
||||||
|
if (fieldName.IndexOf(sensitiveFieldNamePart, StringComparison.OrdinalIgnoreCase) >= 0)
|
||||||
|
{
|
||||||
|
return RedactedValue;
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
return value;
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -0,0 +1,26 @@
|
|||||||
|
namespace MxGateway.Worker.Bootstrap;
|
||||||
|
|
||||||
|
public sealed class WorkerOptions
|
||||||
|
{
|
||||||
|
public const string NonceEnvironmentVariableName = "MXGATEWAY_WORKER_NONCE";
|
||||||
|
|
||||||
|
public WorkerOptions(
|
||||||
|
string sessionId,
|
||||||
|
string pipeName,
|
||||||
|
uint protocolVersion,
|
||||||
|
string nonce)
|
||||||
|
{
|
||||||
|
SessionId = sessionId;
|
||||||
|
PipeName = pipeName;
|
||||||
|
ProtocolVersion = protocolVersion;
|
||||||
|
Nonce = nonce;
|
||||||
|
}
|
||||||
|
|
||||||
|
public string SessionId { get; }
|
||||||
|
|
||||||
|
public string PipeName { get; }
|
||||||
|
|
||||||
|
public uint ProtocolVersion { get; }
|
||||||
|
|
||||||
|
public string Nonce { get; }
|
||||||
|
}
|
||||||
@@ -0,0 +1,101 @@
|
|||||||
|
using System;
|
||||||
|
using System.Collections.Generic;
|
||||||
|
using MxGateway.Contracts;
|
||||||
|
|
||||||
|
namespace MxGateway.Worker.Bootstrap;
|
||||||
|
|
||||||
|
public sealed class WorkerOptionsParser
|
||||||
|
{
|
||||||
|
private const string SessionIdOptionName = "--session-id";
|
||||||
|
private const string PipeNameOptionName = "--pipe-name";
|
||||||
|
private const string ProtocolVersionOptionName = "--protocol-version";
|
||||||
|
|
||||||
|
private readonly IWorkerEnvironment _environment;
|
||||||
|
|
||||||
|
public WorkerOptionsParser(IWorkerEnvironment environment)
|
||||||
|
{
|
||||||
|
_environment = environment ?? throw new ArgumentNullException(nameof(environment));
|
||||||
|
}
|
||||||
|
|
||||||
|
public WorkerBootstrapResult Parse(string[] args)
|
||||||
|
{
|
||||||
|
if (args is null)
|
||||||
|
{
|
||||||
|
throw new ArgumentNullException(nameof(args));
|
||||||
|
}
|
||||||
|
|
||||||
|
Dictionary<string, string> values = new(StringComparer.OrdinalIgnoreCase);
|
||||||
|
List<string> errors = [];
|
||||||
|
|
||||||
|
for (int index = 0; index < args.Length; index++)
|
||||||
|
{
|
||||||
|
string arg = args[index];
|
||||||
|
if (!IsKnownOption(arg))
|
||||||
|
{
|
||||||
|
errors.Add($"Unknown option '{arg}'.");
|
||||||
|
continue;
|
||||||
|
}
|
||||||
|
|
||||||
|
if (index + 1 >= args.Length || args[index + 1].StartsWith("--", StringComparison.Ordinal))
|
||||||
|
{
|
||||||
|
errors.Add($"Option '{arg}' requires a value.");
|
||||||
|
continue;
|
||||||
|
}
|
||||||
|
|
||||||
|
values[arg] = args[index + 1];
|
||||||
|
index++;
|
||||||
|
}
|
||||||
|
|
||||||
|
string? sessionId = ReadRequired(values, SessionIdOptionName, errors);
|
||||||
|
string? pipeName = ReadRequired(values, PipeNameOptionName, errors);
|
||||||
|
string? protocolVersionText = ReadRequired(values, ProtocolVersionOptionName, errors);
|
||||||
|
|
||||||
|
if (errors.Count > 0)
|
||||||
|
{
|
||||||
|
return WorkerBootstrapResult.Failure(WorkerExitCode.InvalidArguments, errors);
|
||||||
|
}
|
||||||
|
|
||||||
|
if (!uint.TryParse(protocolVersionText, out uint protocolVersion)
|
||||||
|
|| protocolVersion != GatewayContractInfo.WorkerProtocolVersion)
|
||||||
|
{
|
||||||
|
return WorkerBootstrapResult.Failure(
|
||||||
|
WorkerExitCode.InvalidProtocolVersion,
|
||||||
|
[$"Unsupported protocol version '{protocolVersionText}'."]);
|
||||||
|
}
|
||||||
|
|
||||||
|
string? nonce = _environment.GetEnvironmentVariable(WorkerOptions.NonceEnvironmentVariableName);
|
||||||
|
|
||||||
|
if (string.IsNullOrWhiteSpace(nonce))
|
||||||
|
{
|
||||||
|
return WorkerBootstrapResult.Failure(
|
||||||
|
WorkerExitCode.MissingNonce,
|
||||||
|
["Required worker nonce environment variable is missing."]);
|
||||||
|
}
|
||||||
|
|
||||||
|
return WorkerBootstrapResult.Success(new WorkerOptions(
|
||||||
|
sessionId!,
|
||||||
|
pipeName!,
|
||||||
|
protocolVersion,
|
||||||
|
nonce!));
|
||||||
|
}
|
||||||
|
|
||||||
|
private static string? ReadRequired(
|
||||||
|
IReadOnlyDictionary<string, string> values,
|
||||||
|
string optionName,
|
||||||
|
List<string> errors)
|
||||||
|
{
|
||||||
|
if (!values.TryGetValue(optionName, out string value)
|
||||||
|
|| string.IsNullOrWhiteSpace(value))
|
||||||
|
{
|
||||||
|
errors.Add($"Required option '{optionName}' is missing.");
|
||||||
|
return null;
|
||||||
|
}
|
||||||
|
|
||||||
|
return value;
|
||||||
|
}
|
||||||
|
|
||||||
|
private static bool IsKnownOption(string optionName)
|
||||||
|
{
|
||||||
|
return optionName is SessionIdOptionName or PipeNameOptionName or ProtocolVersionOptionName;
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -1,16 +1,77 @@
|
|||||||
using System;
|
using System;
|
||||||
|
using System.Collections.Generic;
|
||||||
|
using MxGateway.Worker.Bootstrap;
|
||||||
|
|
||||||
namespace MxGateway.Worker;
|
namespace MxGateway.Worker;
|
||||||
|
|
||||||
public static class WorkerApplication
|
public static class WorkerApplication
|
||||||
{
|
{
|
||||||
public static int Run(string[] args)
|
public static int Run(string[] args)
|
||||||
|
{
|
||||||
|
return Run(
|
||||||
|
args,
|
||||||
|
new EnvironmentVariableWorkerEnvironment(),
|
||||||
|
new WorkerConsoleLogger(Console.Error));
|
||||||
|
}
|
||||||
|
|
||||||
|
public static int Run(
|
||||||
|
string[] args,
|
||||||
|
IWorkerEnvironment environment,
|
||||||
|
IWorkerLogger logger)
|
||||||
{
|
{
|
||||||
if (args is null)
|
if (args is null)
|
||||||
{
|
{
|
||||||
throw new ArgumentNullException(nameof(args));
|
throw new ArgumentNullException(nameof(args));
|
||||||
}
|
}
|
||||||
|
|
||||||
return 0;
|
if (environment is null)
|
||||||
|
{
|
||||||
|
throw new ArgumentNullException(nameof(environment));
|
||||||
|
}
|
||||||
|
|
||||||
|
if (logger is null)
|
||||||
|
{
|
||||||
|
throw new ArgumentNullException(nameof(logger));
|
||||||
|
}
|
||||||
|
|
||||||
|
try
|
||||||
|
{
|
||||||
|
WorkerOptionsParser parser = new(environment);
|
||||||
|
WorkerBootstrapResult result = parser.Parse(args);
|
||||||
|
|
||||||
|
if (!result.Succeeded)
|
||||||
|
{
|
||||||
|
logger.Error("WorkerBootstrapFailed", new Dictionary<string, object?>
|
||||||
|
{
|
||||||
|
["exit_code"] = result.ExitCode,
|
||||||
|
["errors"] = string.Join(";", result.Errors),
|
||||||
|
});
|
||||||
|
|
||||||
|
return (int)result.ExitCode;
|
||||||
|
}
|
||||||
|
|
||||||
|
WorkerOptions options = result.Options
|
||||||
|
?? throw new InvalidOperationException("Successful bootstrap result did not include worker options.");
|
||||||
|
|
||||||
|
logger.Information("WorkerBootstrapSucceeded", new Dictionary<string, object?>
|
||||||
|
{
|
||||||
|
["session_id"] = options.SessionId,
|
||||||
|
["pipe_name"] = options.PipeName,
|
||||||
|
["protocol_version"] = options.ProtocolVersion,
|
||||||
|
["nonce"] = options.Nonce,
|
||||||
|
});
|
||||||
|
|
||||||
|
return (int)WorkerExitCode.Success;
|
||||||
|
}
|
||||||
|
catch (Exception exception)
|
||||||
|
{
|
||||||
|
logger.Error("WorkerBootstrapUnexpectedFailure", new Dictionary<string, object?>
|
||||||
|
{
|
||||||
|
["exit_code"] = WorkerExitCode.UnexpectedFailure,
|
||||||
|
["exception_type"] = exception.GetType().FullName,
|
||||||
|
});
|
||||||
|
|
||||||
|
return (int)WorkerExitCode.UnexpectedFailure;
|
||||||
|
}
|
||||||
}
|
}
|
||||||
}
|
}
|
||||||
|
|||||||
Reference in New Issue
Block a user