wehub-resource-sync
4b6817381b
CI (OpenClaw E2E) / openclaw test (push) Has been cancelled
CI / coverage-report (push) Has been cancelled
CI / test-kubernetes (push) Has been cancelled
CI / should-run-thorough (push) Has been cancelled
CI / test-thorough (cloudwatch-demo) (push) Has been cancelled
CI / test-thorough (flink-ecs) (push) Has been cancelled
CI / test-thorough (upstream-lambda) (push) Has been cancelled
CI / test-thorough (prefect-ecs-fargate) (push) Has been cancelled
Release / build-binaries (zip, opensre.exe, onefile, windows-latest, windows-x64) (push) Has been cancelled
Benchmark image — build + push to ECR (any adapter) / build + push (push) Has been cancelled
CI / quality (ubuntu-latest) (push) Has been cancelled
CI / test (tools-runtime) (push) Has been cancelled
CI / test (e2e-general) (push) Has been cancelled
CI / test (cli-runtime) (push) Has been cancelled
CI / test (e2e-provider-and-openclaw) (push) Has been cancelled
CI / test (integrations-and-misc) (push) Has been cancelled
Release / verify (push) Has been cancelled
Release / build-python-dist (push) Has been cancelled
Release / build-binaries (tar.gz, opensre, onedir, macos-15-intel, darwin-x64) (push) Has been cancelled
Release / build-binaries (tar.gz, opensre, onedir, macos-latest, darwin-arm64) (push) Has been cancelled
Release / build-binaries (tar.gz, opensre, onedir, ubuntu-22.04, linux-x64) (push) Has been cancelled
Release / publish-release (push) Has been cancelled
Release / publish-main-release (push) Has been cancelled
Interactive Shell Live (PR + post-merge) / turn-checks (no-LLM) (push) Has been cancelled
CodeQL / Analyze (python) (push) Has been cancelled
Interactive Shell Live (PR + post-merge) / turn-live shard ${{ matrix.shard_index }} (push) Has been cancelled
Release / prepare (push) Has been cancelled
Release / build-binaries (tar.gz, opensre, onedir, ubuntu-22.04-arm, linux-arm64) (push) Has been cancelled
Synthetic Deterministic Tests / Synthetic offline (deterministic) (push) Has been cancelled
OpenClaw end-to-end test suite
Boots a real local OpenClaw instance, injects a fault, drives a real OpenClaw conversation that hits the broken path, captures the failure, and asserts the OpenSRE investigation pipeline names OpenClaw + the specific failure mode.
Parent issue: #1484.
Prerequisites
- The
openclawCLI installed and on$PATH. Tests skip cleanly when it's not present, so contributors who haven't installed it can still runmake test-covwithout these failing. - Node
22.12+active in the current shell. OpenClaw requires it. Withasdf/mise: runasdf install(the repo pins the version in.tool-versions). Without a version manager:brew install node@22 && brew link --overwrite node@22. - Docker daemon running (for any future container-backed fault scenarios — not required for the initial gateway-down scenario).
How to run locally
make test-openclaw
Equivalent to:
.venv/bin/python -m pytest -m e2e -v tests/e2e/openclaw/
make test-openclaw is excluded from make test-cov — the unit suite
stays runnable without the OpenClaw CLI installed.
Layout
tests/e2e/openclaw/
├── __init__.py
├── README.md (this file)
├── infrastructure_sdk/
│ ├── __init__.py
│ ├── local.py boot/teardown helpers, OpenClawHandle
│ └── fault_injection.py gateway-down / sleeping-tool / wrong-endpoint injectors
├── fixtures/
│ └── sleeping_mcp_server.py stdio MCP fixture used by the timeout scenario
├── use_case.py drives an OpenClaw conversation, captures failure
├── orchestrator.py builds alert, invokes OpenSRE pipeline
├── test_local.py scaffold + boot/teardown smoke
├── test_gateway_down.py gateway-down scenario
├── test_wrong_endpoint.py wrong-endpoint scenario
└── test_tool_call_timeout.py tool-call timeout scenario
Each fault scenario lives in its own test_<scenario>.py next to
test_local.py. Every scenario has two sub-tests: a fast use-case
assertion that doesn't need an LLM, and a full RCA assertion that
calls the investigation pipeline (gated on
ANTHROPIC_API_KEY / OPENAI_API_KEY / GEMINI_API_KEY).
Conventions followed
@pytest.mark.e2emarker on every test (excluded frommake test-cov).pytest.skip(...)with a clear reason when theopenclawCLI is absent — same pattern astests/e2e/upstream_lambda/conftest.py::infrastructure_available.- Separation of concerns: boot helpers stay in
infrastructure_sdk/, business logic inuse_case.py, RCA invocation inorchestrator.py, assertions intest_<scenario>.py. - Uses
tests/fixtures/openclaw_e2e_alert.jsonas the alert template (parallelstests/fixtures/openclaw_test_alert.jsonshape).
References
- Parent issue: #1484
- Existing patterns:
tests/e2e/crashloop/test_local.py,tests/e2e/upstream_lambda/test_agent_e2e.py - OpenClaw integration code:
integrations/openclaw.py - Existing unit coverage (do not duplicate):
tests/integrations/openclaw/test_integration.py - Test conventions: tests/e2e/AGENTS.md