Files
scadaproj/infra/otel-collector/otelsum.py
T
Joseph Doherty e1a2df83f7 feat(infra): shared dev OTel collector; OTLP proven end to end for all four apps (#13)
- infra/otel-collector/: zb-otel-collector (otelcol-contrib 0.162.0) on 10.100.0.35 —
  OTLP gRPC :4317 / HTTP :4318, debug + file exporters, Prometheus re-export :8889,
  health :13133; README runbook + otelsum.py summariser. Deployed.
- components/observability/2026-11-12-otlp-end-to-end-evidence.md: metrics + traces
  received from OtOpcUa, HistorianGateway, ScadaBridge (Site) and MxAccessGateway;
  OtOpcUa Galaxy driver allowlist defect fixed in lmxopcua#892 (db86b996).
- GAPS.md, current-state banners, index row, Telemetry CLAUDE.md: #13 closed; follow-ups
  #54 (wonder-tier collector), #55 (resource identity + logs over OTLP), ScadaBridge#133
  (Central role). Telemetry 0.2.1 deliberately left unpublished (no lib change needed).

Claude-Session: https://claude.ai/code/session_01GT67ACmpMR7b9LGRPLijMi
2026-11-12 20:48:36 -05:00

29 lines
1.7 KiB
Python

#!/usr/bin/env python3
# Summarise what zb-otel-collector received: per service.name, the Resource attributes, the
# metric names per instrumentation scope, and span counts per (scope, name).
# Usage on the collector host: cd ~/zb-otel-collector/data && python3 ../otelsum.py [service.name]
import json,sys,collections
svc_filter=sys.argv[1] if len(sys.argv)>1 else None
def attrs(r): return {a["key"]:list(a["value"].values())[0] if a["value"] else None for a in r.get("attributes",[])}
res={}; mets=collections.defaultdict(set); spans=collections.Counter()
for f,key in (("metrics.jsonl","resourceMetrics"),("traces.jsonl","resourceSpans"),("logs.jsonl","resourceLogs")):
try: lines=open(f)
except FileNotFoundError: continue
for l in lines:
d=json.loads(l)
for r in d.get(key,[]):
a=attrs(r["resource"]); s=a.get("service.name")
if svc_filter and s!=svc_filter: continue
res[s]={k:v for k,v in a.items() if not k.startswith("telemetry.sdk")} | {"_sdk":a.get("telemetry.sdk.version")}
if key=="resourceMetrics":
for sm in r["scopeMetrics"]:
for m in sm["metrics"]: mets[(s,sm["scope"]["name"])].add(m["name"])
elif key=="resourceSpans":
for ss in r["scopeSpans"]:
for sp in ss["spans"]: spans[(s,ss["scope"]["name"],sp["name"])]+=1
else:
for sl in r["scopeLogs"]: spans[(s,"<logs>",sl["scope"].get("name",""))]+=len(sl["logRecords"])
for s,a in res.items(): print("RESOURCE",s,json.dumps(a))
for (s,sc),names in sorted(mets.items()): print("METRICS",s,sc,len(names),sorted(names))
for k,v in sorted(spans.items()): print("SPANS",v,k)