4b6817381b
CI (OpenClaw E2E) / openclaw test (push) Has been cancelled
CI / coverage-report (push) Has been cancelled
CI / test-kubernetes (push) Has been cancelled
CI / should-run-thorough (push) Has been cancelled
CI / test-thorough (cloudwatch-demo) (push) Has been cancelled
CI / test-thorough (flink-ecs) (push) Has been cancelled
CI / test-thorough (upstream-lambda) (push) Has been cancelled
CI / test-thorough (prefect-ecs-fargate) (push) Has been cancelled
Release / build-binaries (zip, opensre.exe, onefile, windows-latest, windows-x64) (push) Has been cancelled
Benchmark image — build + push to ECR (any adapter) / build + push (push) Has been cancelled
CI / quality (ubuntu-latest) (push) Has been cancelled
CI / test (tools-runtime) (push) Has been cancelled
CI / test (e2e-general) (push) Has been cancelled
CI / test (cli-runtime) (push) Has been cancelled
CI / test (e2e-provider-and-openclaw) (push) Has been cancelled
CI / test (integrations-and-misc) (push) Has been cancelled
Release / verify (push) Has been cancelled
Release / build-python-dist (push) Has been cancelled
Release / build-binaries (tar.gz, opensre, onedir, macos-15-intel, darwin-x64) (push) Has been cancelled
Release / build-binaries (tar.gz, opensre, onedir, macos-latest, darwin-arm64) (push) Has been cancelled
Release / build-binaries (tar.gz, opensre, onedir, ubuntu-22.04, linux-x64) (push) Has been cancelled
Release / publish-release (push) Has been cancelled
Release / publish-main-release (push) Has been cancelled
Interactive Shell Live (PR + post-merge) / turn-checks (no-LLM) (push) Has been cancelled
CodeQL / Analyze (python) (push) Has been cancelled
Interactive Shell Live (PR + post-merge) / turn-live shard ${{ matrix.shard_index }} (push) Has been cancelled
Release / prepare (push) Has been cancelled
Release / build-binaries (tar.gz, opensre, onedir, ubuntu-22.04-arm, linux-arm64) (push) Has been cancelled
Synthetic Deterministic Tests / Synthetic offline (deterministic) (push) Has been cancelled
48 lines
1.8 KiB
Python
48 lines
1.8 KiB
Python
"""OpenSRE pipeline-span vocabulary and projection.
|
|
|
|
Owns two pieces of OpenSRE domain knowledge:
|
|
|
|
* ``_PIPELINE_SPAN_NAMES`` — the set of span names that count as
|
|
named OpenSRE pipeline stages (``extract_data``, ``validate_data``,
|
|
``transform_data``, ``load_data``).
|
|
* :func:`extract_pipeline_spans` — projects those spans into the
|
|
``{span_name, execution_run_id, record_count}`` shape every
|
|
downstream investigation node consumes.
|
|
|
|
Both ``integrations.grafana.tools`` (live Grafana / Tempo queries) and
|
|
``integrations.opensre.seed_evidence`` (offline OpenRCA / HuggingFace
|
|
fixtures) need this projection. Lives in ``core.domain`` so neither
|
|
side has to import the other, and so the OpenSRE-specific span-name
|
|
vocabulary stays out of the infrastructure layer (``platform/common``).
|
|
"""
|
|
|
|
from __future__ import annotations
|
|
|
|
from typing import Any
|
|
|
|
_PIPELINE_SPAN_NAMES: frozenset[str] = frozenset(
|
|
{"extract_data", "validate_data", "transform_data", "load_data"}
|
|
)
|
|
|
|
|
|
def extract_pipeline_spans(traces: list[dict[str, Any]]) -> list[dict[str, Any]]:
|
|
"""Return one record per pipeline-stage span found across ``traces``.
|
|
|
|
Each record carries the span name, the originating ``execution.run_id``
|
|
attribute, and the ``record_count`` attribute when present.
|
|
"""
|
|
pipeline_spans: list[dict[str, Any]] = []
|
|
for trace in traces:
|
|
for span in trace.get("spans", []):
|
|
if span.get("name") not in _PIPELINE_SPAN_NAMES:
|
|
continue
|
|
attributes = span.get("attributes", {})
|
|
pipeline_spans.append(
|
|
{
|
|
"span_name": span.get("name"),
|
|
"execution_run_id": attributes.get("execution.run_id"),
|
|
"record_count": attributes.get("record_count"),
|
|
}
|
|
)
|
|
return pipeline_spans
|