feat: port session 07 — Protocol Parser, Auth extras (TPM/certidp/certstore), Internal utilities & data structures

Session 07 scope (5 features, 17 tests, ~1165 Go LOC):
- Protocol/ParserTypes.cs: ParserState enum (79 states), PublishArgument, ParseContext
- Protocol/IProtocolHandler.cs: handler interface decoupling parser from client
- Protocol/ProtocolParser.cs: Parse(), ProtoSnippet(), OverMaxControlLineLimit(),
  ProcessPub/HeaderPub/RoutedMsgArgs/RoutedHeaderMsgArgs, ClonePubArg(), GetHeader()
- tests/Protocol/ProtocolParserTests.cs: 17 tests via TestProtocolHandler stub

Auth extras from session 06 (committed separately):
- Auth/TpmKeyProvider.cs, Auth/CertificateIdentityProvider/, Auth/CertificateStore/

Internal utilities & data structures (session 06 overflow):
- Internal/AccessTimeService.cs, ElasticPointer.cs, SystemMemory.cs, ProcessStatsProvider.cs
- Internal/DataStructures/GenericSublist.cs, HashWheel.cs
- Internal/DataStructures/SubjectTree.cs, SubjectTreeNode.cs, SubjectTreeParts.cs

All 461 tests pass (460 unit + 1 integration). DB updated for features 2588-2592 and tests 2598-2614.
This commit is contained in:
Joseph Doherty
2026-02-26 13:16:56 -05:00
parent 0a54d342ba
commit 88b1391ef0
56 changed files with 9006 additions and 6 deletions

View File

@@ -0,0 +1,70 @@
# Session 20: JetStream Cluster & Raft
## Summary
Raft consensus algorithm implementation and JetStream clustering — how streams and consumers are replicated across server nodes.
## Scope
| Go File | Features | Feature IDs | Go LOC |
|---------|----------|-------------|--------|
| server/raft.go | 198 | 25992796 | 4,078 |
| server/jetstream_cluster.go | 231 | 15201750 | 10,098 |
| **Total** | **429** | | **14,176** |
## .NET Classes
- `RaftNode` — Raft consensus implementation (169 features)
- `AppendEntry`, `AppendEntryResponse` — Raft log entries
- `Checkpoint` — Raft snapshots
- `CommittedEntry`, `Entry`, `EntryType` — entry types
- `VoteRequest`, `VoteResponse`, `RaftState` — election types
- `RaftGroup` — Raft group configuration
- `JetStreamCluster` — cluster-wide JetStream coordination (51 features)
- `Consumer` (cluster) — consumer assignment tracking (7 features)
- `ConsumerAssignment` — consumer placement
- `StreamAssignment`, `UnsupportedStreamAssignment` — stream placement
- Plus ~69 `JetStreamEngine` methods for cluster operations
## Test Files
| Test File | Tests | Test IDs |
|-----------|-------|----------|
| server/raft_test.go | 104 | 26162719 |
| server/jetstream_cluster_1_test.go | 151 | 757907 |
| server/jetstream_cluster_2_test.go | 123 | 9081030 |
| server/jetstream_cluster_3_test.go | 97 | 10311127 |
| server/jetstream_cluster_4_test.go | 85 | 11281212 |
| server/jetstream_cluster_long_test.go | 7 | 12131219 |
| server/jetstream_super_cluster_test.go | 47 | 14191465 |
| server/jetstream_meta_benchmark_test.go | 2 | 14161417 |
| server/jetstream_sourcing_scaling_test.go | 1 | 1418 |
| **Total** | **617** | |
## Dependencies
- Session 01 (Foundation Types)
- Session 08 (Client Connection)
- Session 09 (Server Core Part 1)
- Session 14 (Routes)
- Session 17 (Store Interfaces)
- Session 19 (JetStream Core)
## .NET Target Location
- `dotnet/src/ZB.MOM.NatsNet.Server/JetStream/Cluster/`
- `dotnet/src/ZB.MOM.NatsNet.Server/Raft/`
## Notes
- **This is a multi-sitting session** — 14.2K Go LOC and 617 tests (the largest session)
- Suggested sub-batching:
- **20a**: Raft types and election (entries, votes, state — ~30 features)
- **20b**: Raft core (log replication, append, commit — ~85 features)
- **20c**: Raft remaining (snapshots, checkpoints, recovery — ~83 features)
- **20d**: JetStream cluster types and assignments (~30 features)
- **20e**: JetStream cluster operations Part 1 (~130 features)
- **20f**: JetStream cluster operations Part 2 (~71 features)
- **20g**: Tests (617 tests, batched by test file)
- Raft is the most algorithmically complex code in the server
- Cluster tests often require multi-server setups — integration test candidates