wehub-resource-sync
4b6817381b
CI (OpenClaw E2E) / openclaw test (push) Has been cancelled
CI / coverage-report (push) Has been cancelled
CI / test-kubernetes (push) Has been cancelled
CI / should-run-thorough (push) Has been cancelled
CI / test-thorough (cloudwatch-demo) (push) Has been cancelled
CI / test-thorough (flink-ecs) (push) Has been cancelled
CI / test-thorough (upstream-lambda) (push) Has been cancelled
CI / test-thorough (prefect-ecs-fargate) (push) Has been cancelled
Release / build-binaries (zip, opensre.exe, onefile, windows-latest, windows-x64) (push) Has been cancelled
Benchmark image — build + push to ECR (any adapter) / build + push (push) Has been cancelled
CI / quality (ubuntu-latest) (push) Has been cancelled
CI / test (tools-runtime) (push) Has been cancelled
CI / test (e2e-general) (push) Has been cancelled
CI / test (cli-runtime) (push) Has been cancelled
CI / test (e2e-provider-and-openclaw) (push) Has been cancelled
CI / test (integrations-and-misc) (push) Has been cancelled
Release / verify (push) Has been cancelled
Release / build-python-dist (push) Has been cancelled
Release / build-binaries (tar.gz, opensre, onedir, macos-15-intel, darwin-x64) (push) Has been cancelled
Release / build-binaries (tar.gz, opensre, onedir, macos-latest, darwin-arm64) (push) Has been cancelled
Release / build-binaries (tar.gz, opensre, onedir, ubuntu-22.04, linux-x64) (push) Has been cancelled
Release / publish-release (push) Has been cancelled
Release / publish-main-release (push) Has been cancelled
Interactive Shell Live (PR + post-merge) / turn-checks (no-LLM) (push) Has been cancelled
CodeQL / Analyze (python) (push) Has been cancelled
Interactive Shell Live (PR + post-merge) / turn-live shard ${{ matrix.shard_index }} (push) Has been cancelled
Release / prepare (push) Has been cancelled
Release / build-binaries (tar.gz, opensre, onedir, ubuntu-22.04-arm, linux-arm64) (push) Has been cancelled
Synthetic Deterministic Tests / Synthetic offline (deterministic) (push) Has been cancelled
40 lines
1.8 KiB
YAML
40 lines
1.8 KiB
YAML
root_cause_category: cpu_saturation_bad_query
|
|
equivalent_root_cause_categories:
|
|
- cpu_saturation
|
|
required_keywords:
|
|
- rollout
|
|
- query
|
|
- sequential scan
|
|
- cpu
|
|
- performance insights
|
|
required_evidence_sources:
|
|
- aws_performance_insights
|
|
- aws_cloudwatch_metrics
|
|
- k8s_rollout
|
|
- k8s_pod_metrics
|
|
forbidden_categories:
|
|
- infrastructure
|
|
- connection_exhaustion
|
|
optimal_trajectory:
|
|
- query_grafana_metrics
|
|
- query_grafana_logs
|
|
- query_grafana_alert_rules
|
|
- describe_rds_instance
|
|
- describe_rds_events
|
|
max_investigation_loops: 3
|
|
model_response: |
|
|
ROOT_CAUSE: A query regression introduced in the latest checkout-api rollout caused cpu_saturation_bad_query on payments-prod. The new endpoint query removed a selective index predicate, triggering repeated sequential scans on orders and driving RDS CPU to 96%. This is application-query behavior correlated to rollout revision checkout-api-9bdaf, not an infrastructure failover.
|
|
ROOT_CAUSE_CATEGORY: cpu_saturation_bad_query
|
|
|
|
VALIDATED_CLAIMS:
|
|
- Kubernetes rollout checkout-api-9bdaf completed 6 minutes before the CPU inflection, and no other service revisions changed. [evidence: k8s_rollout]
|
|
- Performance Insights top SQL is a high-frequency SELECT with Seq Scan on orders and dominant CPU waits. [evidence: aws_performance_insights]
|
|
- CloudWatch CPUUtilization increased from 38% to 96% while connections rose only moderately, ruling out pure connection exhaustion. [evidence: aws_cloudwatch_metrics]
|
|
- Pod metrics show steady traffic growth, but the slope change aligns with rollout timing and SQL regression, not retry amplification. [evidence: k8s_pod_metrics]
|
|
|
|
CAUSAL_CHAIN:
|
|
- Rollout introduced query-plan regression.
|
|
- Repeated sequential scans increased per-request DB work.
|
|
- CPU saturated and request latency exceeded SLO.
|
|
|