426e9eeabd
Voice Workbench / headless workbench (mocked backends) (push) Has been cancelled
Voice Workbench / real acoustic lane (nightly, provisioned only) (push) Has been cancelled
ci / test (push) Has been cancelled
ci / lint-and-format (push) Has been cancelled
ci / build (push) Has been cancelled
ci / dev-startup (push) Has been cancelled
gitleaks / gitleaks (push) Has been cancelled
Markdown Links / Relative Markdown Links (push) Has been cancelled
Quality (Extended) / Homepage Build (PR smoke) (push) Has been cancelled
Quality (Extended) / Comment-only diff guard (push) Has been cancelled
Quality (Extended) / Format + Type Safety Ratchet (push) Has been cancelled
Quality (Extended) / Develop Gate (secret scan + UI determinism) (push) Has been cancelled
Quality (Extended) / Develop Gate (lint) (push) Has been cancelled
Chat shell gestures / Chat shell gesture + parity e2e (push) Has been cancelled
Cloud Gateway Discord / Test (push) Has been cancelled
Benchmark Bridge Tests / benchmark (bunx @biomejs/biome check packages/lifeops-bench/src, benchmark-lint) (push) Has been cancelled
Benchmark Bridge Tests / benchmark (bunx vitest run --config packages/lifeops-bench/vitest.config.ts --root packages/lifeops-bench --passWithNoTests, benchmark-tests) (push) Has been cancelled
Build Agent Image / build-and-push (push) Has been cancelled
Dev Smoke / bun run dev onboarding chat (push) Has been cancelled
Dev Smoke / Vite HMR dependency-level smoke (push) Has been cancelled
Electrobun Submodule Guard / electrobun gitlink is fetchable (push) Has been cancelled
Publish @elizaos/example-code / check_npm (push) Has been cancelled
Publish @elizaos/example-code / publish_npm (push) Has been cancelled
Publish @elizaos/plugin-elizacloud / verify_version (push) Has been cancelled
Publish @elizaos/plugin-elizacloud / publish_npm (push) Has been cancelled
Sandbox Live Smoke / Sandbox live smoke (push) Has been cancelled
Snap Build & Test / Build Snap (amd64) (push) Has been cancelled
Snap Build & Test / Build Snap (arm64) (push) Has been cancelled
Test Packaging / elizaos CLI global-install smoke (node + bun) (push) Has been cancelled
Cloud Gateway Webhook / Test (push) Has been cancelled
Cloud Tests / lint-and-types (push) Has been cancelled
Cloud Tests / unit-tests (push) Has been cancelled
Cloud Tests / integration-tests (push) Has been cancelled
Cloud Tests / e2e-tests (push) Has been cancelled
CodeQL Advanced / Analyze (javascript-typescript) (push) Has been cancelled
Deploy Apps Worker (Product 2) / Determine environment (push) Has been cancelled
Deploy Apps Worker (Product 2) / Deploy apps worker to apps-control host (${{ needs.determine-env.outputs.environment }}) (push) Has been cancelled
Deploy Eliza Provisioning Worker / Determine environment (push) Has been cancelled
Deploy Eliza Provisioning Worker / Deploy worker to Hetzner host (${{ needs.determine-env.outputs.environment }} @ ${{ needs.determine-env.outputs.deployment_sha }}) (push) Has been cancelled
Dev Smoke / Classify changed paths (push) Has been cancelled
supply-chain / sbom (push) Has been cancelled
supply-chain / vulnerability-scan (push) Has been cancelled
Build, Push & Deploy to Phala Cloud / build-and-push (push) Has been cancelled
Test Packaging / Validate Packaging Configs (push) Has been cancelled
Test Packaging / Build & Test PyPI Package (push) Has been cancelled
Test Packaging / PyPI on Python ${{ matrix.python }} (push) Has been cancelled
Test Packaging / Pack & Test JS Tarballs (push) Has been cancelled
UI Fixture E2E / ui-fixture-e2e (push) Has been cancelled
UI Fixture E2E / fixture-e2e (push) Has been cancelled
UI Story Gate / story-gate (push) Has been cancelled
vault-ci / test (macos-latest) (push) Has been cancelled
vault-ci / test (ubuntu-latest) (push) Has been cancelled
vault-ci / test (windows-latest) (push) Has been cancelled
vault-ci / app-core wiring tests (push) Has been cancelled
verify-patches / verify patches/CHECKSUMS.sha256 (push) Has been cancelled
Voice Benchmark Smoke / voice-emotion fixture smoke (push) Has been cancelled
Voice Benchmark Smoke / voiceagentbench fixture smoke (push) Has been cancelled
Voice Benchmark Smoke / voicebench-quality unit smoke (push) Has been cancelled
Voice Benchmark Smoke / voicebench TypeScript unit (no audio) (push) Has been cancelled
Voice Benchmark Smoke / voice bench smoke summary (push) Has been cancelled
Windows CI / windows ([bun run --cwd packages/app-core test bun run --cwd packages/elizaos test bun run --cwd packages/cloud/shared test], app-and-cli) (push) Has been cancelled
Windows CI / windows ([bun run --cwd packages/scenario-runner test bun run --cwd packages/vault test bun run --cwd packages/security test bun run --cwd plugins/plugin-coding-tools test], framework-packages) (push) Has been cancelled
Windows CI / windows ([bun run --cwd plugins/plugin-elizacloud test bun run --cwd plugins/plugin-discord test bun run --cwd plugins/plugin-anthropic test bun run --cwd plugins/plugin-openai test bun run --cwd plugins/plugin-app-control test bun run --cwd plugins/pl… (push) Has been cancelled
Windows CI / windows ([node packages/scripts/run-turbo.mjs run build --filter=@elizaos/core --filter=@elizaos/shared --filter=@elizaos/agent --concurrency=4 node packages/scripts/run-bash-linux-only.mjs scripts/verify-riscv64-buildpaths.sh node packages/scripts/run… (push) Has been cancelled
Windows CI / windows ([node packages/scripts/run-turbo.mjs run typecheck --filter=@elizaos/core --filter=@elizaos/shared --filter=@elizaos/cloud-shared --concurrency=4 bun run --cwd packages/core test bun run --cwd packages/shared test], core-runtime, 75) (push) Has been cancelled
70 lines
1.6 KiB
JSON
70 lines
1.6 KiB
JSON
{
|
|
"$schema": "./gpu-config.schema.json",
|
|
"id": "h200",
|
|
"name": "NVIDIA H200 (SXM 141 GiB)",
|
|
"match_names": ["H200", "NVIDIA H200"],
|
|
"vram_gb": 141,
|
|
"compute_capability": "9.0",
|
|
"arch": "hopper",
|
|
"memory_bandwidth_gbs": 4800,
|
|
"fp8": true,
|
|
"fp4": false,
|
|
"flash_attn_3": true,
|
|
"llama_server_flags": {
|
|
"n_gpu_layers": 999,
|
|
"ctx_size": 262144,
|
|
"batch_size": 4096,
|
|
"ubatch_size": 2048,
|
|
"n_parallel": 16,
|
|
"cache_type_k": "qjl1_256",
|
|
"cache_type_v": "q4_polar",
|
|
"flash_attn": true,
|
|
"split_mode": "none",
|
|
"main_gpu": 0,
|
|
"mlock": true,
|
|
"no_mmap": false,
|
|
"no_kv_offload": false,
|
|
"ctx_checkpoints": 16,
|
|
"ctx_checkpoint_interval": 8192,
|
|
"draft_max": 32,
|
|
"draft_min": 8,
|
|
"draft_p_min": 0.5
|
|
},
|
|
"bundle_recommendations": {
|
|
"voice": {
|
|
"ctx_size": 16384,
|
|
"max_parallel": 32,
|
|
"batch_size": 2048,
|
|
"ubatch_size": 512
|
|
},
|
|
"eliza-1-2b": {
|
|
"ctx_size": 1048576,
|
|
"max_parallel": 64
|
|
},
|
|
"eliza-1-4b": {
|
|
"ctx_size": 1048576,
|
|
"max_parallel": 32
|
|
},
|
|
"eliza-1-9b": {
|
|
"ctx_size": 1048576,
|
|
"max_parallel": 32
|
|
},
|
|
"eliza-1-27b": {
|
|
"ctx_size": 131072,
|
|
"max_parallel": 16
|
|
}
|
|
},
|
|
"expected_metrics": {
|
|
"ttfa_p50_ms": 110,
|
|
"ttfa_p95_ms": 180,
|
|
"rtf": 0.2,
|
|
"tokens_per_second_decode": 320,
|
|
"_provenance": "extrapolated"
|
|
},
|
|
"known_limits": [
|
|
"FP4 not supported on sm_90 (Blackwell-only)",
|
|
"PCIe spill path defeats the bandwidth advantage; keep KV in HBM"
|
|
],
|
|
"_provenance": "extrapolated; numbers derived from VRAM + mem-bw math in SPECS.md"
|
|
}
|