23f7624596
ADR-166 MCP Bridge Security Lock / Static-source security lock (push) Failing after 0s
ADR-166 MCP Bridge Security Lock / Compose default binds loopback + Mongo has auth (push) Failing after 2s
CodeQL Advanced / Analyze (rust) (push) Failing after 0s
ADR-166 MCP Bridge Security Lock / plugin-agent-federation bindHost default (push) Failing after 1s
ADR-166 MCP Bridge Security Lock / Runtime behavior — 401 + terminal gate + fail-closed (push) Failing after 4s
business-pods-smoke / smoke (push) Failing after 1s
all-plugins-smoke / smoke-all (push) Failing after 2s
CI/CD Pipeline / Security & Code Quality (push) Failing after 1s
CI/CD Pipeline / Test Suite (ubuntu-latest) (push) Failing after 1s
CI/CD Pipeline / Build & Package (macos-latest) (push) Has been skipped
CI/CD Pipeline / Build & Package (ubuntu-latest) (push) Has been skipped
CI/CD Pipeline / Build & Package (windows-latest) (push) Has been skipped
CI/CD Pipeline / Documentation & Examples (push) Failing after 1s
Clone Tracker (14-day rolling) / Snapshot clones for ruflo ecosystem (push) Failing after 1s
CodeQL Advanced / Analyze (actions) (push) Failing after 1s
CodeQL Advanced / Analyze (javascript-typescript) (push) Failing after 1s
federation-peer-rust / stable-noop (push) Failing after 1s
metaharness-ci / score (push) Failing after 1s
metaharness-ci / router-compat (push) Failing after 0s
metaharness-ci / similarity-tests (push) Failing after 0s
no-agentbbs-smoke / smoke-without-agentbbs (push) Failing after 1s
V3 CI/CD Pipeline / Build V3 (windows-latest) (push) Has been skipped
codex-integration-audit / Codex integration audit (push) Failing after 1s
helpers-manifest-guard / guard (push) Failing after 1s
🔗 Cross-Agent Integration Tests / 🤝 Agent Coordination Tests (push) Has been skipped
🔗 Cross-Agent Integration Tests / 🧠 Memory Sharing Integration (push) Has been skipped
🔗 Cross-Agent Integration Tests / 🛡️ Fault Tolerance Tests (push) Has been skipped
🔗 Cross-Agent Integration Tests / ⚡ Performance Integration Tests (push) Has been skipped
metaharness-ci / mcp-scan (push) Failing after 1s
metaharness-ci / eject-dryrun (push) Failing after 1s
metaharness-ci / metaharness-real-data (push) Failing after 0s
no-cli-optdep-bloat-2561 / guard (push) Failing after 1s
no-metaharness-smoke / smoke-without-metaharness (push) Failing after 1s
no-phantom-agentic-flow-subpath / guard (push) Failing after 1s
🔄 Automated Rollback Manager / 🚨 Failure Detection (push) Failing after 1s
V3 CI/CD Pipeline / Plugin hooks smoke / ubuntu-latest / Node 22 (push) Failing after 1s
V3 CI/CD Pipeline / ruflo-graph-intelligence build + test smoke (#2044, ADR-123) (push) Failing after 1s
CVE Audit Gate / Audit root (critical-blocking) (push) Failing after 2s
cost-tracker-smoke / smoke (push) Failing after 3s
oia-audit-weekly / audit (push) Failing after 2s
ruflo-agent-smoke / ruflo-agent structural smoke (push) Failing after 1s
📊 Status Badges Update / 📊 Update Status Badges (push) Failing after 1s
V3 CI/CD Pipeline / Static regression guards (#2267 YAML + (push) Failing after 1s
V3 CI/CD Pipeline / Test V3 Packages (push) Failing after 0s
V3 CI/CD Pipeline / agent_execute provider routing smoke (#2042) (push) Failing after 0s
CVE Audit Gate / Audit v3 (critical-blocking) (push) Failing after 1s
federation-peer-rust / stable-native (push) Failing after 2s
🔗 Cross-Agent Integration Tests / 🚀 Integration Test Setup (push) Failing after 2s
neural-trader-smoke / runtime-smoke (push) Failing after 1s
V3 CI/CD Pipeline / Build V3 (macos-latest) (push) Has been skipped
V3 CI/CD Pipeline / Build V3 (ubuntu-latest) (push) Has been skipped
V3 CI/CD Pipeline / Type Check V3 (push) Failing after 1s
V3 CI/CD Pipeline / Smoke (no better-sqlite3) / ubuntu-latest / Node 24 (push) Failing after 1s
V3 CI/CD Pipeline / Smoke (no better-sqlite3) / ubuntu-latest / Node 22 (push) Failing after 2s
V3 CI/CD Pipeline / browser rvf create flag smoke (#2015) (push) Failing after 0s
V3 CI/CD Pipeline / Dependency review (#2046) (push) Has been skipped
V3 CI/CD Pipeline / Supply-chain audit (#2046) (push) Failing after 0s
V3 CI/CD Pipeline / witness marker drift smoke (#2021) (push) Failing after 1s
V3 CI/CD Pipeline / neural-trader portfolio CG smoke (#2068, ADR-126 Phase 3) (push) Failing after 1s
V3 CI/CD Pipeline / neural-trader backtest signing smoke (#2068, ADR-126 Phase 4) (push) Failing after 1s
V3 CI/CD Pipeline / kg-extract type-import classification smoke (#2049) (push) Failing after 0s
V3 CI/CD Pipeline / witness verify precondition smoke (#1880) (push) Failing after 2s
V3 CI/CD Pipeline / neural-trader pipeline risk-gate smoke (#2068, ADR-126 Phase 5) (push) Failing after 0s
V3 CI/CD Pipeline / neural-trader feature attribution smoke (#2068, ADR-126 Phase 6) (push) Failing after 0s
V3 CI/CD Pipeline / plugin-registry signature verification smoke (#1922, CWE-347) (push) Failing after 4s
V3 CI/CD Pipeline / memory stats legacy-DB smoke (#2120) (push) Failing after 4s
V3 CI/CD Pipeline / github deprecated actions smoke (#2089, ADR-127 Phase 3) (push) Failing after 1s
V3 CI/CD Pipeline / graph query + pathfinder smoke (ADR-130 P2+P5) (push) Has been skipped
V3 CI/CD Pipeline / graph trajectory hooks smoke (ADR-130 P3) (push) Has been skipped
V3 CI/CD Pipeline / graph plugin adapter smoke (ADR-130 P4) (push) Has been skipped
V3 CI/CD Pipeline / graph benchmark (ADR-130 P6) (push) Has been skipped
V3 CI/CD Pipeline / statusline generator delegation smoke (#2195) (push) Failing after 1s
V3 CI/CD Pipeline / wizard init regression guard (#2206 (push) Failing after 1s
V3 CI/CD Pipeline / memory no-stray-db smoke (ADR-125 P7) (push) Failing after 1s
V3 CI/CD Pipeline / github-safe injection smoke (#2089, ADR-127 Phase 1) (push) Failing after 1s
V3 CI/CD Pipeline / github actions pin smoke (#2089, ADR-127 Phase 1) (push) Failing after 1s
V3 CI/CD Pipeline / github attribution opt-in smoke (#2089, ADR-127 Phase 4) (push) Failing after 1s
V3 CI/CD Pipeline / pre-bash hook safety smoke (#2017) (push) Failing after 1s
V3 CI/CD Pipeline / Memory import smoke / ubuntu-latest (push) Failing after 0s
V3 CI/CD Pipeline / MCP protocol smoke / ubuntu-latest (push) Failing after 2s
V3 CI/CD Pipeline / ruvllm WASM auto-init smoke (#2086) (push) Failing after 4s
V3 CI/CD Pipeline / MCP paired-tool round-trip smoke (#1889) (push) Failing after 1s
V3 CI/CD Pipeline / Plugin package install-safety (#1902/#1903/#1904) (push) Failing after 1s
V3 CI/CD Pipeline / Tool description discoverability (ADR-112) (push) Failing after 3s
V3 CI/CD Pipeline / CLI npx-install smoke (#1147 / (22) (push) Failing after 1s
V3 CI/CD Pipeline / CLI npx-install smoke (#1147 / (24) (push) Failing after 1s
V3 CI/CD Pipeline / Windows hook shim smoke (#2132) / ubuntu-latest (push) Failing after 2s
V3 CI/CD Pipeline / Windows hook execution smoke (#2132) / ubuntu-latest (push) Failing after 1s
V3 CI/CD Pipeline / Windows init hooks smoke (#2132) / ubuntu-latest (push) Failing after 1s
V3 CI/CD Pipeline / Vector-index dimension audit (#1947) (push) Failing after 0s
V3 CI/CD Pipeline / Hook-command install safety (#1921) (push) Failing after 1s
V3 CI/CD Pipeline / ToolOutputGuardrail smoke (ADR-131, (push) Failing after 1s
V3 CI/CD Pipeline / init-bundle invariants smoke (#2095, ADR-128 Phase 5) (push) Failing after 1s
V3 CI/CD Pipeline / wasm provider bridge smoke (ADR-129 P1) (push) Failing after 2s
V3 CI/CD Pipeline / wasm gallery CRUD smoke (ADR-129 P3) (push) Failing after 1s
V3 CI/CD Pipeline / wasm plugin bridge smoke (ADR-129 P4) (push) Failing after 0s
V3 CI/CD Pipeline / wasm compose smoke (ADR-129 P2) (push) Failing after 4s
V3 CI/CD Pipeline / graph schema smoke (ADR-130 P1) (push) Failing after 0s
Validate Marketplace / validate (push) Failing after 1s
🔍 Verification Pipeline / 🚀 Setup Verification (push) Failing after 1s
🔍 Verification Pipeline / 🛡️ Security Verification (push) Has been skipped
🔍 Verification Pipeline / 📝 Code Quality (push) Has been skipped
🔍 Verification Pipeline / 🧪 Test Verification (${{ matrix.os }}, Node ${{ matrix.node }}) (push) Has been skipped
🔍 Verification Pipeline / 🏗️ Build Verification (push) Has been skipped
🔍 Verification Pipeline / 📚 Documentation Verification (push) Has been skipped
CVE Audit Gate / High-severity report (warn only) (push) Has been cancelled
🔄 Automated Rollback Manager / 🔄 Execute Rollback (push) Has been cancelled
🔄 Automated Rollback Manager / ✅ Post-Rollback Verification (push) Has been cancelled
🔄 Automated Rollback Manager / 📊 Rollback Monitoring (push) Has been cancelled
V3 CI/CD Pipeline / Windows init hooks smoke (#2132) / windows-latest (push) Has been cancelled
V3 CI/CD Pipeline / Windows hook execution smoke (#2132) / macos-latest (push) Has been cancelled
V3 CI/CD Pipeline / Windows hook execution smoke (#2132) / windows-latest (push) Has been cancelled
🔄 Automated Rollback Manager / ⏳ Manual Rollback Approval (push) Has been cancelled
V3 CI/CD Pipeline / MCP protocol smoke / macos-latest (push) Has been cancelled
V3 CI/CD Pipeline / Memory import smoke / macos-latest (push) Has been cancelled
V3 CI/CD Pipeline / Windows hook shim smoke (#2132) / macos-latest (push) Has been cancelled
V3 CI/CD Pipeline / Windows hook shim smoke (#2132) / windows-latest (push) Has been cancelled
V3 CI/CD Pipeline / Windows init hooks smoke (#2132) / macos-latest (push) Has been cancelled
V3 CI/CD Pipeline / Witness verify (signed manifest) / macos-latest (push) Has been cancelled
V3 CI/CD Pipeline / Witness verify (signed manifest) / ubuntu-latest (push) Has been cancelled
V3 CI/CD Pipeline / Witness verify (signed manifest) / windows-latest (push) Has been cancelled
V3 CI/CD Pipeline / Publish to npm (alpha) (push) Has been cancelled
V3 CI/CD Pipeline / Smoke (no better-sqlite3) / macos-latest / Node 22 (push) Has been cancelled
V3 CI/CD Pipeline / Plugin hooks smoke / macos-latest / Node 22 (push) Has been cancelled
CI/CD Pipeline / Deploy & Release (push) Has been cancelled
CI/CD Pipeline / CI Status (push) Has been cancelled
🔗 Cross-Agent Integration Tests / 📊 Integration Test Report (push) Has been cancelled
🔄 Automated Rollback Manager / 🔍 Pre-Rollback Validation (push) Has been cancelled
🔍 Verification Pipeline / ⚡ Performance Verification (push) Has been cancelled
🔍 Verification Pipeline / 📊 Verification Report (push) Has been cancelled
6.2 KiB
6.2 KiB
Integration Tests - Quick Start Guide
Overview
This directory contains 75 comprehensive integration tests across 5 test files covering all major V3 modules and their interactions.
Test Files
| File | Tests | Coverage |
|---|---|---|
memory-integration.test.ts |
15 | HybridBackend (SQLite + AgentDB) |
swarm-integration.test.ts |
15 | Agent coordination and topologies |
mcp-integration.test.ts |
15 | MCP tools (agent, memory, config) |
plugin-integration.test.ts |
15 | Plugin system and extension points |
workflow-integration.test.ts |
15 | End-to-end workflows and pipelines |
Quick Commands
Run all integration tests
npm run test:integration
Run specific test file
npm run test:integration:memory # Memory integration
npm run test:integration:swarm # Swarm coordination
npm run test:integration:mcp # MCP tools
npm run test:integration:plugin # Plugin system
npm run test:integration:workflow # Full workflows
Watch mode (auto-rerun on changes)
npm run test:integration:watch
Run with coverage
npm run test:coverage:integration
Run single test
npx vitest run -t "should execute end-to-end agent workflow"
Test Structure
Each test follows this pattern:
describe('Module Integration Tests', () => {
let module: Module;
beforeEach(async () => {
// Setup: Initialize fresh instances
module = new Module();
await module.initialize();
});
afterEach(async () => {
// Cleanup: Shutdown and cleanup resources
await module.shutdown();
});
it('should test specific integration', async () => {
// Arrange: Setup test data
const data = createTestData();
// Act: Execute the operation
const result = await module.execute(data);
// Assert: Verify the outcome
expect(result).toBeDefined();
});
});
Test Utilities
Import from /v3/__tests__/integration/setup.ts:
import { TestUtils, MockData, PerfUtils } from './setup';
// Create test database paths
const dbPath = TestUtils.createTestDbPath('test');
// Generate mock data
const agents = MockData.generateAgents(5);
const tasks = MockData.generateTasks(10);
// Measure performance
const { duration } = await TestUtils.measureTime(async () => {
await someOperation();
});
// Benchmark operations
const stats = await PerfUtils.benchmark('operation', async () => {
await operation();
}, 10);
Debugging Tests
Enable verbose output
DEBUG=claude-flow:* npm run test:integration
Run in watch mode with specific test
npx vitest watch -t "should handle concurrent memory operations"
Generate HTML coverage report
npm run test:coverage:integration
# Open __tests__/coverage/index.html
Use VS Code debugger
- Set breakpoint in test file
- Open "Run and Debug" panel (Ctrl+Shift+D)
- Select "Debug Vitest Tests"
- Click "Start Debugging" (F5)
Common Issues
Database lock errors
- Cause: Previous test didn't clean up properly
- Fix: Delete
/v3/__tests__/integration/.test-dbs/directory
Timeout errors
- Cause: Operation taking longer than 10s (default timeout)
- Fix: Increase timeout in specific test:
it('slow test', async () => { // ... }, 30000); // 30 second timeout
Port already in use
- Cause: Previous test server still running
- Fix: Kill the process or restart terminal
Memory leaks
- Cause: Not cleaning up event listeners or connections
- Fix: Ensure
afterEachproperly cleans up:afterEach(async () => { await module.shutdown(); eventBus.removeAllListeners(); });
Performance Expectations
| Operation | Target Time |
|---|---|
| Memory store | <10ms |
| Memory query | <50ms |
| Vector search | <100ms |
| Agent spawn | <50ms |
| Task execution | <200ms |
| Workflow execution | <500ms |
Coverage Targets
From V3 ADR-008 (Vitest over Jest):
- Lines: >80%
- Branches: >75%
- Functions: >80%
- Statements: >80%
Current integration test coverage:
- All major integration points: 100%
- Cross-module interactions: >90%
CI/CD Integration
These tests run automatically on:
- Push to
v3branch - Pull requests to
main - Nightly builds
Expected CI execution time: <5 minutes
Best Practices
- Isolation: Each test should be independent
- Cleanup: Always cleanup in
afterEach - Deterministic: No random behavior (use fixed seeds)
- Fast: Keep tests under 10 seconds each
- Clear: Use descriptive test names
- Focused: Test one integration point per test
Example Test Sessions
First time running tests
# Install dependencies (if not done)
cd /workspaces/claude-flow/v3
npm install
# Run all integration tests
npm run test:integration
Development workflow
# Start watch mode
npm run test:integration:watch
# Edit integration code in src/
# Tests auto-rerun on save
# Check coverage
npm run test:coverage:integration
Before committing
# Run all tests with coverage
npm run test:coverage:integration
# Verify coverage thresholds met
# Fix any failing tests
# Commit changes
Getting Help
- Read test file comments for specific integration details
- Check
/v3/__tests__/integration/README.mdfor full documentation - Review
/v3/docs/architecture/for ADR decisions - See
/CLAUDE.mdfor development guidelines
Next Steps
After running integration tests:
- Review coverage report:
__tests__/coverage/index.html - Check for uncovered code paths
- Add tests for new features
- Update this guide if adding new test files
Quick Reference
# Common commands
npm run test:integration # Run all
npm run test:integration:watch # Watch mode
npm run test:integration:memory # Memory only
npm run test:coverage:integration # With coverage
# Debugging
DEBUG=* npm run test:integration # Verbose logs
npx vitest run -t "test name" # Single test
npx vitest run --reporter=verbose # Detailed output
# Cleanup
rm -rf __tests__/integration/.test-dbs/ # Clean test DBs
rm -rf __tests__/coverage/ # Clean coverage