wehub-resource-sync
4b6817381b
Benchmark image — build + push to ECR (any adapter) / build + push (push) Waiting to run
CI / quality (ubuntu-latest) (push) Waiting to run
CI / test (tools-runtime) (push) Waiting to run
CI / test (e2e-general) (push) Waiting to run
CI / test (cli-runtime) (push) Waiting to run
CI / test (e2e-provider-and-openclaw) (push) Waiting to run
CI / test (integrations-and-misc) (push) Waiting to run
CI / coverage-report (push) Blocked by required conditions
CI / test-kubernetes (push) Waiting to run
CI / should-run-thorough (push) Waiting to run
CI / test-thorough (cloudwatch-demo) (push) Blocked by required conditions
CI / test-thorough (flink-ecs) (push) Blocked by required conditions
CI / test-thorough (upstream-lambda) (push) Blocked by required conditions
CI / test-thorough (prefect-ecs-fargate) (push) Blocked by required conditions
CodeQL / Analyze (python) (push) Waiting to run
Release / build-binaries (zip, opensre.exe, onefile, windows-latest, windows-x64) (push) Blocked by required conditions
Release / publish-release (push) Blocked by required conditions
Release / publish-main-release (push) Blocked by required conditions
Release / prepare (push) Waiting to run
Release / verify (push) Blocked by required conditions
Release / build-python-dist (push) Blocked by required conditions
Release / build-binaries (tar.gz, opensre, onedir, macos-15-intel, darwin-x64) (push) Blocked by required conditions
Release / build-binaries (tar.gz, opensre, onedir, macos-latest, darwin-arm64) (push) Blocked by required conditions
Release / build-binaries (tar.gz, opensre, onedir, ubuntu-22.04, linux-x64) (push) Blocked by required conditions
Release / build-binaries (tar.gz, opensre, onedir, ubuntu-22.04-arm, linux-arm64) (push) Blocked by required conditions
Synthetic Deterministic Tests / Synthetic offline (deterministic) (push) Waiting to run
Interactive Shell Live (PR + post-merge) / turn-checks (no-LLM) (push) Waiting to run
Interactive Shell Live (PR + post-merge) / turn-live shard ${{ matrix.shard_index }} (push) Waiting to run
CI (OpenClaw E2E) / openclaw test (push) Has been cancelled
85 lines
2.3 KiB
YAML
85 lines
2.3 KiB
YAML
name: Synthetic Deterministic Tests
|
|
|
|
# Regression guardrail: run every offline (no-LLM) synthetic test on every
|
|
# PR and merge so pipeline refactors can't silently break investigations.
|
|
#
|
|
# Tests that need a live LLM are excluded via the marker filter below.
|
|
# Those suites live in interactive-shell-live.yml and hermes-tests.yml instead.
|
|
|
|
on:
|
|
push:
|
|
branches: [main]
|
|
paths:
|
|
- "surfaces/**"
|
|
- "config/**"
|
|
- "core/**"
|
|
- "integrations/**"
|
|
- "platform/**"
|
|
- "tools/**"
|
|
- "tests/synthetic/**"
|
|
- "pyproject.toml"
|
|
- "uv.lock"
|
|
- "pytest.ini"
|
|
- ".github/workflows/synthetic-deterministic.yml"
|
|
pull_request:
|
|
branches: [main]
|
|
paths:
|
|
- "surfaces/**"
|
|
- "config/**"
|
|
- "core/**"
|
|
- "integrations/**"
|
|
- "platform/**"
|
|
- "tools/**"
|
|
- "tests/synthetic/**"
|
|
- "pyproject.toml"
|
|
- "uv.lock"
|
|
- "pytest.ini"
|
|
- ".github/workflows/synthetic-deterministic.yml"
|
|
workflow_dispatch:
|
|
|
|
permissions:
|
|
contents: read
|
|
|
|
concurrency:
|
|
group: synthetic-det-${{ github.ref }}
|
|
cancel-in-progress: true
|
|
|
|
jobs:
|
|
offline:
|
|
name: Synthetic offline (deterministic)
|
|
runs-on: ubuntu-latest
|
|
timeout-minutes: 20
|
|
|
|
steps:
|
|
- uses: actions/checkout@v5
|
|
|
|
- name: Install uv
|
|
uses: astral-sh/setup-uv@v8.1.0
|
|
with:
|
|
enable-cache: true
|
|
cache-dependency-glob: |
|
|
pyproject.toml
|
|
uv.lock
|
|
|
|
- name: Set up Python
|
|
uses: actions/setup-python@v6
|
|
with:
|
|
python-version: "3.13"
|
|
|
|
- name: Install dependencies
|
|
run: uv sync --frozen --extra dev
|
|
|
|
- name: Run deterministic synthetic tests
|
|
# Excludes markers that require a live LLM:
|
|
# synthetic — full RCA scenario suites (EKS, RDS, Hermes, Dagster …)
|
|
# axis2 — adversarial scenario suites (also call the LLM)
|
|
# live_llm — explicit live-credential gate
|
|
# e2e — requires live infrastructure
|
|
run: |
|
|
uv run pytest tests/synthetic \
|
|
-m "not synthetic and not live_llm and not e2e and not axis2" \
|
|
-q
|
|
|
|
- name: Run hermes_rca offline scenario suite
|
|
run: uv run python -m tests.synthetic.hermes_rca.run_suite --offline-only
|