dohertj2/natsnet
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
436 Commits 3 Branches 0 Tags
60422ab85f61a763bbd1fc047bfcbe51749551f6
Commit Graph

436 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Joseph Doherty
60422ab85f docs: add deferred integration tests design 
884 deferred tests across 34 Go test files. Plan: build shared test
harness (Batch 48), then port all tests in 12 parallel batches (49-60)
using Sonnet agents in isolated worktrees.
 2026-03-01 11:08:13 -05:00
Joseph Doherty
41ea272c8a chore(batch42-47): reconcile porting.db after all deferred feature batches 
- Promoted 226 deferred features to verified (audit name mismatches)
- 1 stub remains (mqtt transferUniqueSessStreamsToMuxed — needs running server)
- Features: 3626 verified + 22 complete + 24 n/a + 1 stub = 3673 total (98.7%)
- Tests: 2066 verified + 307 n/a + 884 deferred = 3257 total
- Overall: 6057/6942 items complete (87.3%)
 2026-03-01 10:18:54 -05:00
Joseph Doherty
9690275287 Merge branch 'worktree-agent-adb1298d' 
# Conflicts:
#	dotnet/src/ZB.MOM.NatsNet.Server/Internal/Subscription.cs
 2026-03-01 10:16:19 -05:00
Joseph Doherty
6a030151fc feat(batch47): implement MQTT full runtime — JSA bridge, sessions, account manager, protocol handlers 
- MqttJsa.cs: full JetStream API bridge (22 features, Sub-batch A 2269-2290)
  - Async request/response helpers, consumer/stream CRUD, msg store/load/delete
  - Send queue via Channel<MqttJsPubMsg>, ConcurrentDictionary reply tracking

- MqttAccountSessionManager.cs: per-account MQTT session manager (26 features, Sub-batch C 2292-2322)
  - Session add/remove/lock/unlock, flapper tracking with cleanup timer
  - Retained message in-memory cache with TTL eviction (ConcurrentDictionary)
  - JSA reply dispatch, retained msg processing, session persist detection
  - Subscription creation, retained message subject matching (SubscriptionIndex)
  - createOrRestoreSession async (JetStream load + fallback to new session)
  - processSubs builds NATS subscriptions with retained message delivery
  - Stream migration stubs (transferUniqueSessStreamsToMuxed, transferRetained...)

- MqttTypes.cs: add Client and Seq to MqttSession; ExpiresFromCache to MqttRetainedMsg
  - Remove stubs for MqttJsa and MqttAccountSessionManager

- MqttHelpers.cs: standalone helpers (Sub-batch F 2264-2268)
  - IsMqttReservedSubscription, DecodeRetainedMessage, GeneratePubPerms,
    CheckPubRetainedPerms, TopicFilterContainsWildcard, TopicToNatsSubject

- ClientConnection.Mqtt.cs: Mqtt property stub on ClientConnection (Sub-batch E entry)

- Subscription.cs: add internal Mqtt (MqttSub?) and InternalCallback fields

All 2660 unit tests pass, 0 failures.
 2026-03-01 10:14:47 -05:00
Joseph Doherty
a321f96c6d Merge branch 'worktree-agent-a4679340' 
# Conflicts:
#	dotnet/src/ZB.MOM.NatsNet.Server/Events/EventHelpers.cs
#	dotnet/src/ZB.MOM.NatsNet.Server/Events/EventTypes.cs
#	dotnet/src/ZB.MOM.NatsNet.Server/NatsServer.Events.cs
#	dotnet/src/ZB.MOM.NatsNet.Server/NatsServerTypes.cs
#	reports/current.md
 2026-03-01 09:53:22 -05:00
Joseph Doherty
65c8e932e2 feat(batch45): implement events server methods — stats, remote tracking, connection events 
Port 80 features from server/events.go including the full events infrastructure:
internal send/receive loops, system subscription machinery, statsz heartbeats,
remote server tracking, connection event advisories, user-info handler, OCSP peer
reject events, remote latency merge, kick/ldm client, and helper functions.

Add ClearConnectionHeartbeatTimer/SetConnectionHeartbeatTimer to Account,
add MsgHandler/SysMsgHandler delegates and supporting types (ServerApiResponse,
EventFilterOptions, StatszEventOptions, UserInfo, KickClientReq, LdmClientReq,
AccNumSubsReq) to EventTypes.cs, and add Seq field to ServerInfo for heartbeat
sequence tracking.
 2026-03-01 09:41:20 -05:00
Joseph Doherty
01c47b1b35 fix: remove duplicate gateway types from MonitorTypes.cs 
GatewayzOptions, Gatewayz, RemoteGatewayz, AccountGatewayz were defined
in both MonitorHelpers.cs (batch 42) and MonitorTypes.cs (batch 46).
Removed duplicates from MonitorTypes.cs, keeping the versions in
MonitorHelpers.cs.
 2026-03-01 09:18:02 -05:00
Joseph Doherty
ab71f03b46 Merge branch 'worktree-agent-ad124859' 2026-03-01 09:16:26 -05:00
Joseph Doherty
743a89fecf feat(batch46): implement monitor endpoints — varz, connz, routez, healthz, etc. 
Adds NatsServer.Monitor.cs with all monitoring endpoint implementations
(Connz, Routez, Subsz, Gatewayz, Leafz, AccountStatz, Accountz, Varz,
Healthz, Raftz, Expvarz, Profilez, Stacksz, IPQueuesz, Root) and updates
Monitor/MonitorTypes.cs with the full set of monitoring response types.
 2026-03-01 09:16:03 -05:00
Joseph Doherty
bad323a803 Merge branch 'worktree-agent-ae787158' 2026-03-01 09:01:43 -05:00
Joseph Doherty
dff3000461 feat(batch44): implement events core dispatch — Groups A-G from events.go 
Port 46 deferred features from server/events.go covering the internal event
system foundation:

- Group A (EventHelpers.cs): NewPubMsg/pool, RouteStat, GetHash/GetHashSize,
  GetAcceptEncoding, RemoteLatencySubjectForResponse, TotalSubs, AccForClient,
  IssuerForClient, ClearTimer; CompressionType enum
- Group B (NatsServerTypes.cs): ServerInfo advisory fields (Seq, Time,
  Capabilities, Tags, Metadata) + capability methods (SetJetStreamEnabled,
  IsJetStreamEnabled, SetBinaryStreamSnapshot, IsBinaryStreamSnapshot,
  SetAccountNrg, IsAccountNrg)
- Group C (ClientTypes.cs): ForAssignmentSnap, ForProposal, ForAdvisory on
  ClientInfo
- Group D (EventTypes.cs): PubMsg.ReturnToPool; PubMsg.Client typed as
  ClientConnection?; InternalState.Client typed as ClientConnection?;
  InternalState.Seq changed to long field for Interlocked.Increment
- Group E (ClientConnection.Events.cs): SendInternalMsg delegates to server
- Group F (Account.Events.cs): AccountTrafficStats/Set + Account.Statz()
- Group G (NatsServer.Events.cs): InternalReceiveLoop, InternalSendLoop,
  SendShutdownEvent, SendInternalAccountSysMsg, SendInternalMsgLocked,
  SendInternalMsg, SendInternalMsgFromClient, SendInternalResponse,
  EventsRunning, EventsEnabled, Node, InitEventTracking, FilterRequest,
  NoInlineCallback*, SysSubscribe*, SystemSubscribe, SysUnsubscribe,
  InboxReply, NewRespInbox, WrapChk; EventFilterOptions, ServerApiResponse,
  ApiError types
- Subscription.SysMsgCb field added for system subscription dispatch
 2026-03-01 09:01:03 -05:00
Joseph Doherty
be301e2e5a Merge branch 'worktree-agent-a5ce7551' 2026-03-01 08:43:24 -05:00
Joseph Doherty
4e63820e7a feat(batch42): implement foundation helpers — msgtrace, monitor helpers, scheduler 
Group A: Create MsgTrace.cs with TraceCompressionType, MsgTraceState (factory
methods, pipeline event helpers, sendEvent/sendEventFromJetStream, trace header
injection) and MsgTraceHelper (sample, genHeaderMapIfTraceHeadersPresent,
initAndSendIngressErrEvent, isMsgTraceEnabled, msgTraceSupport). Adds Trace field
to PublishArgument and Trace accessor to ParseContext.

Group C: Create MonitorHelpers.cs with GatewayzOptions, Gatewayz, RemoteGatewayz,
AccountGatewayz, ExtImport, ExtServiceLatency types; plus 25 standalone helper
functions (newSubsDetailList, newSubsList, createProxyInfo, makePeerCerts,
decodeBool, decodeUint64, decodeInt, decodeState, decodeSubs, newSubDetail,
newClientSubDetail, myUptime, tlsCertNotAfter, urlsToStrings, getPinnedCertsAsSlice,
getMonitorGWOptions, createOutboundRemoteGatewayz, createOutboundAccountsGatewayz,
createAccountOutboundGatewayz, createInboundAccountsGatewayz,
createInboundAccountGatewayz, ResponseHandler, handleResponse, newExtServiceLatency,
newExtImport).

Group D: Implement GetScheduledMessages in MsgScheduling; add Seq field to InMsg
for out-of-band scheduling sort. Group B (GatewayInterestMode.String) already complete.
 2026-03-01 08:42:50 -05:00
Joseph Doherty
96e395a113 feat(batch43): implement account resolvers and service latency tracking 
Implements 37 deferred features from Batch 43:

Group A - Type methods:
- ServiceRespType.String: already existed via ToNatsString extension
- NewMapDest: already existed as MapDest.New factory
- ServiceLatency.merge → ServiceLatencyExtensions.Merge + Sanitize

Group B - Tracing headers (new TracingHeaders static class in AccountTypes.cs):
- newB3Header → TracingHeaders.NewB3Header
- newUberHeader → TracingHeaders.NewUberHeader
- newTraceCtxHeader → TracingHeaders.NewTraceCtxHeader
- shouldSample → TracingHeaders.ShouldSample

Group C - Service export timers (new extension methods in AccountTypes.cs):
- serviceImport.isRespServiceImport → ServiceImportEntryExtensions.IsRespServiceImport
- serviceExport.setResponseThresholdTimer → ServiceExportEntryExtensions.SetResponseThresholdTimer
- serviceExport.clearResponseThresholdTimer → ServiceExportEntryExtensions.ClearResponseThresholdTimer
- serviceExport.checkExpiredResponses → ServiceExportEntryExtensions.CheckExpiredResponses

Group D - Latency & client updates:
- sanitizeLatencyMetric → ServiceLatencyExtensions.SanitizeLatencyMetric
- updateAllClientsServiceExportResponseTime → ServiceExportClientHelpers.UpdateAllClientsServiceExportResponseTime
- ClientConnection.UpdateRrTrackingThreshold (helper for above)

Group E - Account resolvers (NatsServer.AccountResolvers.cs):
- authAccounts → NatsServer.AuthAccounts
- Server.SetAccountResolver + GetAccountResolver
- Server.UpdateAccountClaims + UpdateAccountClaimsWithRefresh
- buildPermissionsFromJwt → NatsServer.BuildPermissionsFromJwt (with JwtPermissions stub types)
- buildInternalNkeyUser → NatsServer.BuildInternalNkeyUser (with JwtUserClaims stub type)
- fetchAccount → NatsServer.FetchAccountFromResolverAsync
- respondToUpdate → NatsServer.RespondToUpdate (with ClaimUpdateResponse/Status/Error types)
- handleListRequest → NatsServer.HandleListRequest
- handleDeleteRequest → NatsServer.HandleDeleteRequest
- getOperatorKeys → NatsServer.GetOperatorKeys
- claimValidate → NatsServer.ClaimValidate
- removeCb → NatsServer.RemoveCb

Group F - Directory resolvers:
- Server.fetch → NatsServer.ServerFetch (stub falls back to direct resolver)
- DirAccResolver.Fetch, NewDirAccResolver, FetchTimeout already in AccountResolver.cs
- NewCacheDirAccResolver, CacheDirAccResolver.Reload already in AccountResolver.cs

Supporting changes:
- Account.cs: expose ExpiredTimeout as internal, add ReadLock/ReadUnlock/WriteLock/WriteUnlock
  helpers plus GetResponseCount/GetResponseEntries for CheckExpiredResponses
- AccountTypes.cs: add using System.Globalization for hex parsing
- NatsServerTypes.cs: add AccountClaims.Name property (JWT name tag)
 2026-03-01 08:32:40 -05:00
Joseph Doherty
ecd18cf1a9 chore: re-audit all batch 16-41 features and tests after merge 
Reset deferred items to unknown and re-ran Roslyn audit.
Features: 428 promoted to verified, 363 remain deferred.
Tests: 209 promoted to verified, 880 remain deferred.
Overall progress: 82.0% (5694/6942).
 2026-03-01 07:56:43 -05:00
Joseph Doherty
552e58cb26 chore: update report timestamp after all batches 16-41 complete 2026-03-01 06:39:17 -05:00
Joseph Doherty
214b145d76 chore(batch35): reconcile porting.db after merge 2026-03-01 02:45:50 -05:00
Joseph Doherty
037fb4bfc8 feat(batch35): merge js-cluster-remaining 2026-03-01 02:45:38 -05:00
Joseph Doherty
6a14aa816b batch35: finalize audits, batch completion, and report 2026-03-01 02:42:45 -05:00
Joseph Doherty
788abc1702 batch35: add and verify raft test waves T2-T4 2026-03-01 02:41:03 -05:00
Joseph Doherty
9e4405c2a1 batch35: add and verify test wave T1 2026-03-01 02:37:07 -05:00
Joseph Doherty
4c3a3fad69 chore(batch25): reconcile porting.db after merge 2026-03-01 02:32:08 -05:00
Joseph Doherty
73d9871be6 feat(batch25): merge gateways 2026-03-01 02:31:54 -05:00
Joseph Doherty
8baa604dce batch35: implement and verify feature group C 2026-03-01 02:30:35 -05:00
Joseph Doherty
c6363745bc feat(batch25): complete gateways implementation and verification 2026-03-01 02:30:25 -05:00
Joseph Doherty
ee1ab96d7c feat(batch25): verify gateway features and tests 2026-03-01 02:28:43 -05:00
Joseph Doherty
015b19b6f6 test(batch25): port cross-module gateway integration tests 2026-03-01 02:26:30 -05:00
Joseph Doherty
35becf549a batch35: implement and verify feature group B 2026-03-01 02:25:57 -05:00
Joseph Doherty
6ddad39b4a test(batch25): port gateway edge, reload, and slow-consumer tests 2026-03-01 02:23:37 -05:00
Joseph Doherty
cf9f40ab0c batch35: implement and verify feature group A 2026-03-01 02:21:30 -05:00
Joseph Doherty
3412ec6d5c test(batch25): port gateway interest and service-import tests 2026-03-01 02:21:23 -05:00
Joseph Doherty
a0763cd248 test(batch25): port gateway connect and tls baseline tests 2026-03-01 02:19:11 -05:00
Joseph Doherty
0d6e040450 batch35: task1 preflight and baseline evidence 2026-03-01 02:13:45 -05:00
Joseph Doherty
e9be0751ec feat(batch25): implement gateway reply map and inbound message pipeline 2026-03-01 02:07:25 -05:00
Joseph Doherty
f0b50c0b4c chore(batch29): reconcile porting.db after merge 2026-03-01 02:03:16 -05:00
Joseph Doherty
59fa600b3c feat(batch25): implement gateway interest and outbound send logic 2026-03-01 02:00:08 -05:00
Joseph Doherty
073ee6b0ee chore(batch29): complete batch tracking and refresh status report 2026-03-01 01:58:00 -05:00
Joseph Doherty
e88f780033 test(batch29): add mapped raft node tests for batching behavior 2026-03-01 01:55:05 -05:00
Joseph Doherty
0fece7f2f3 feat(batch25): implement gateway URL and registry bookkeeping 2026-03-01 01:53:51 -05:00
Joseph Doherty
6ae023d4a7 feat(batch29): implement jetstream batching group-b validation and apply state 2026-03-01 01:51:17 -05:00
Joseph Doherty
1763304e28 feat(batch25): implement gateway handshake and gossip 2026-03-01 01:50:40 -05:00
Joseph Doherty
a83339fe71 feat(batch25): implement gateway bootstrap and solicitation 2026-03-01 01:47:07 -05:00
Joseph Doherty
02d3b610a1 feat(batch29): implement jetstream batching group-a lifecycle/store methods 2026-03-01 01:45:35 -05:00
Joseph Doherty
6cf904cc7d chore(batch29): run preflight and baseline gates 2026-03-01 01:39:31 -05:00
Joseph Doherty
93f34c4782 chore(batch39): reconcile porting.db after merge 2026-03-01 01:35:35 -05:00
Joseph Doherty
58db8adbc7 feat(batch39): merge consumer-dispatch 2026-03-01 01:35:20 -05:00
Joseph Doherty
a99fa837b2 chore(batch24): reconcile porting.db after merge 2026-03-01 01:35:03 -05:00
Joseph Doherty
8dcd582e8d chore(batch24): remove generated build artifacts 2026-03-01 01:32:08 -05:00
Joseph Doherty
3e9ad16033 feat(batch24): complete leaf nodes implementation and verification 2026-03-01 01:31:57 -05:00
Joseph Doherty
6d87a5a147 feat(batch39): complete consumer dispatch batch and verify all mappings 2026-03-01 01:31:48 -05:00