Files
3yearplan/schemas/docs/consumer-integration.md
Joseph Doherty 98bf2d0da4 Expand SnowBridge to own ingest + in-process transform; drop dbt
SnowBridge now owns machine-data ingest, in-process .NET transformation,
and direct writes to curated tables in Snowflake. Collapses the previous
ingest/transform split into a single service; no dbt, no external
orchestrator, no Snowflake landing tier. Keeps the in-house .NET pattern
consistent with ScadaBridge and OtOpcUa.

The "Snowflake dbt Transform Layer" roadmap workstream merges into
SnowBridge (7 → 6 workstreams); Year 2 canonical-state-based OEE moves
with it. Canonical model still has three surfaces — the third is
renamed from "dbt curated layer" to "SnowBridge curated layer in
Snowflake"; mechanics unchanged.
2026-04-24 14:53:16 -04:00

3.4 KiB

Consumer Integration

How each of the three canonical-model consumers integrates with this repo.

OtOpcUa equipment namespace

Reference: lmxopcua/docs/v2/plan.md decisions #112, #115; lmxopcua/docs/v2/config-db-schema.md Equipment table.

What it pulls: equipment-class templates from classes/ keyed by Equipment.EquipmentClassRef in the central config DB.

Integration points:

  • At Admin UI draft-publish time: sp_ValidateDraft checks that every Equipment row's tag set satisfies the referenced class's required-signal list. Missing required signals = draft validation error.
  • At cluster runtime: each OtOpcUa node fetches the relevant class templates at startup (cached locally per the LiteDB cache pattern) and uses them to validate the applied generation.

Versioning: each EquipmentClassRef value carries a classId@version form (e.g. fanuc-cnc@0.1.0). Pinning to a specific version protects against breaking changes in the schemas repo.

Status (2026-04-17): Equipment.EquipmentClassRef ships as a nullable hook column in OtOpcUa Phase 1 with no validation enforcement. Enforcement lands when the schemas repo is publishable and the OtOpcUa team wires the validator into sp_ValidateDraft.

Redpanda topics + Protobuf schemas

What it pulls: equipment-class templates derive Protobuf message definitions for canonical equipment events (equipment.state.transitioned, equipment.signal.changed, etc.).

Integration points:

  • A code-generation step in the Redpanda team's CI reads classes/*.json and emits .proto files for each class.
  • The generated .proto files publish to a Schema Registry (or equivalent) for runtime consumers.
  • Versioning: Protobuf schema versions track this repo's tag versions one-for-one.

Status (2026-04-17): not wired. Redpanda team to design the codegen step when the schemas repo has a stable initial class set.

SnowBridge curated layer in Snowflake

What it pulls: equipment-class templates derive column definitions for the curated equipment-state and equipment-signal tables SnowBridge writes into Snowflake. SnowBridge owns ingest + in-process transform + write — there is no separate dbt layer.

Integration points:

  • A SnowBridge codegen step reads classes/*.json and generates per-class transform definitions + curated-table DDL with the canonical signal columns.
  • UNS subtree definitions (uns/*.json) drive the dim_site / dim_area / dim_line dimension tables written by SnowBridge.
  • Versioning: the SnowBridge build pins to a specific schemas-repo tag; updates require an explicit SnowBridge release.

Status (2026-04-24): not wired. SnowBridge team to design the codegen step when the schemas repo has a stable initial class set.

Cross-consumer compatibility

A breaking change in a class template (major version bump per CONTRIBUTING.md) requires:

  1. Schemas repo PR with the change + rationale
  2. Each consumer team confirms the impact on their integration
  3. All three consumers either upgrade simultaneously OR pin to the prior major version until they can upgrade
  4. OtOpcUa specifically: a breaking change to a class with existing equipment in production requires a config-generation publish that updates the equipment's EquipmentClassRef to the new version + reconciles tag changes

Breaking changes should be rare. Preferred pattern: add new optional signals (minor bump) + deprecate old ones across multiple minor releases before removing in a major.