Files
wehub-resource-sync 23f7624596
ADR-166 MCP Bridge Security Lock / Static-source security lock (push) Failing after 0s
ADR-166 MCP Bridge Security Lock / Compose default binds loopback + Mongo has auth (push) Failing after 2s
CodeQL Advanced / Analyze (rust) (push) Failing after 0s
ADR-166 MCP Bridge Security Lock / plugin-agent-federation bindHost default (push) Failing after 1s
ADR-166 MCP Bridge Security Lock / Runtime behavior — 401 + terminal gate + fail-closed (push) Failing after 4s
business-pods-smoke / smoke (push) Failing after 1s
all-plugins-smoke / smoke-all (push) Failing after 2s
CI/CD Pipeline / Security & Code Quality (push) Failing after 1s
CI/CD Pipeline / Test Suite (ubuntu-latest) (push) Failing after 1s
CI/CD Pipeline / Build & Package (macos-latest) (push) Has been skipped
CI/CD Pipeline / Build & Package (ubuntu-latest) (push) Has been skipped
CI/CD Pipeline / Build & Package (windows-latest) (push) Has been skipped
CI/CD Pipeline / Documentation & Examples (push) Failing after 1s
Clone Tracker (14-day rolling) / Snapshot clones for ruflo ecosystem (push) Failing after 1s
CodeQL Advanced / Analyze (actions) (push) Failing after 1s
CodeQL Advanced / Analyze (javascript-typescript) (push) Failing after 1s
federation-peer-rust / stable-noop (push) Failing after 1s
metaharness-ci / score (push) Failing after 1s
metaharness-ci / router-compat (push) Failing after 0s
metaharness-ci / similarity-tests (push) Failing after 0s
no-agentbbs-smoke / smoke-without-agentbbs (push) Failing after 1s
V3 CI/CD Pipeline / Build V3 (windows-latest) (push) Has been skipped
codex-integration-audit / Codex integration audit (push) Failing after 1s
helpers-manifest-guard / guard (push) Failing after 1s
🔗 Cross-Agent Integration Tests / 🤝 Agent Coordination Tests (push) Has been skipped
🔗 Cross-Agent Integration Tests / 🧠 Memory Sharing Integration (push) Has been skipped
🔗 Cross-Agent Integration Tests / 🛡️ Fault Tolerance Tests (push) Has been skipped
🔗 Cross-Agent Integration Tests / ⚡ Performance Integration Tests (push) Has been skipped
metaharness-ci / mcp-scan (push) Failing after 1s
metaharness-ci / eject-dryrun (push) Failing after 1s
metaharness-ci / metaharness-real-data (push) Failing after 0s
no-cli-optdep-bloat-2561 / guard (push) Failing after 1s
no-metaharness-smoke / smoke-without-metaharness (push) Failing after 1s
no-phantom-agentic-flow-subpath / guard (push) Failing after 1s
🔄 Automated Rollback Manager / 🚨 Failure Detection (push) Failing after 1s
V3 CI/CD Pipeline / Plugin hooks smoke / ubuntu-latest / Node 22 (push) Failing after 1s
V3 CI/CD Pipeline / ruflo-graph-intelligence build + test smoke (#2044, ADR-123) (push) Failing after 1s
CVE Audit Gate / Audit root (critical-blocking) (push) Failing after 2s
cost-tracker-smoke / smoke (push) Failing after 3s
oia-audit-weekly / audit (push) Failing after 2s
ruflo-agent-smoke / ruflo-agent structural smoke (push) Failing after 1s
📊 Status Badges Update / 📊 Update Status Badges (push) Failing after 1s
V3 CI/CD Pipeline / Static regression guards (#2267 YAML + (push) Failing after 1s
V3 CI/CD Pipeline / Test V3 Packages (push) Failing after 0s
V3 CI/CD Pipeline / agent_execute provider routing smoke (#2042) (push) Failing after 0s
CVE Audit Gate / Audit v3 (critical-blocking) (push) Failing after 1s
federation-peer-rust / stable-native (push) Failing after 2s
🔗 Cross-Agent Integration Tests / 🚀 Integration Test Setup (push) Failing after 2s
neural-trader-smoke / runtime-smoke (push) Failing after 1s
V3 CI/CD Pipeline / Build V3 (macos-latest) (push) Has been skipped
V3 CI/CD Pipeline / Build V3 (ubuntu-latest) (push) Has been skipped
V3 CI/CD Pipeline / Type Check V3 (push) Failing after 1s
V3 CI/CD Pipeline / Smoke (no better-sqlite3) / ubuntu-latest / Node 24 (push) Failing after 1s
V3 CI/CD Pipeline / Smoke (no better-sqlite3) / ubuntu-latest / Node 22 (push) Failing after 2s
V3 CI/CD Pipeline / browser rvf create flag smoke (#2015) (push) Failing after 0s
V3 CI/CD Pipeline / Dependency review (#2046) (push) Has been skipped
V3 CI/CD Pipeline / Supply-chain audit (#2046) (push) Failing after 0s
V3 CI/CD Pipeline / witness marker drift smoke (#2021) (push) Failing after 1s
V3 CI/CD Pipeline / neural-trader portfolio CG smoke (#2068, ADR-126 Phase 3) (push) Failing after 1s
V3 CI/CD Pipeline / neural-trader backtest signing smoke (#2068, ADR-126 Phase 4) (push) Failing after 1s
V3 CI/CD Pipeline / kg-extract type-import classification smoke (#2049) (push) Failing after 0s
V3 CI/CD Pipeline / witness verify precondition smoke (#1880) (push) Failing after 2s
V3 CI/CD Pipeline / neural-trader pipeline risk-gate smoke (#2068, ADR-126 Phase 5) (push) Failing after 0s
V3 CI/CD Pipeline / neural-trader feature attribution smoke (#2068, ADR-126 Phase 6) (push) Failing after 0s
V3 CI/CD Pipeline / plugin-registry signature verification smoke (#1922, CWE-347) (push) Failing after 4s
V3 CI/CD Pipeline / memory stats legacy-DB smoke (#2120) (push) Failing after 4s
V3 CI/CD Pipeline / github deprecated actions smoke (#2089, ADR-127 Phase 3) (push) Failing after 1s
V3 CI/CD Pipeline / graph query + pathfinder smoke (ADR-130 P2+P5) (push) Has been skipped
V3 CI/CD Pipeline / graph trajectory hooks smoke (ADR-130 P3) (push) Has been skipped
V3 CI/CD Pipeline / graph plugin adapter smoke (ADR-130 P4) (push) Has been skipped
V3 CI/CD Pipeline / graph benchmark (ADR-130 P6) (push) Has been skipped
V3 CI/CD Pipeline / statusline generator delegation smoke (#2195) (push) Failing after 1s
V3 CI/CD Pipeline / wizard init regression guard (#2206 (push) Failing after 1s
V3 CI/CD Pipeline / memory no-stray-db smoke (ADR-125 P7) (push) Failing after 1s
V3 CI/CD Pipeline / github-safe injection smoke (#2089, ADR-127 Phase 1) (push) Failing after 1s
V3 CI/CD Pipeline / github actions pin smoke (#2089, ADR-127 Phase 1) (push) Failing after 1s
V3 CI/CD Pipeline / github attribution opt-in smoke (#2089, ADR-127 Phase 4) (push) Failing after 1s
V3 CI/CD Pipeline / pre-bash hook safety smoke (#2017) (push) Failing after 1s
V3 CI/CD Pipeline / Memory import smoke / ubuntu-latest (push) Failing after 0s
V3 CI/CD Pipeline / MCP protocol smoke / ubuntu-latest (push) Failing after 2s
V3 CI/CD Pipeline / ruvllm WASM auto-init smoke (#2086) (push) Failing after 4s
V3 CI/CD Pipeline / MCP paired-tool round-trip smoke (#1889) (push) Failing after 1s
V3 CI/CD Pipeline / Plugin package install-safety (#1902/#1903/#1904) (push) Failing after 1s
V3 CI/CD Pipeline / Tool description discoverability (ADR-112) (push) Failing after 3s
V3 CI/CD Pipeline / CLI npx-install smoke (#1147 / (22) (push) Failing after 1s
V3 CI/CD Pipeline / CLI npx-install smoke (#1147 / (24) (push) Failing after 1s
V3 CI/CD Pipeline / Windows hook shim smoke (#2132) / ubuntu-latest (push) Failing after 2s
V3 CI/CD Pipeline / Windows hook execution smoke (#2132) / ubuntu-latest (push) Failing after 1s
V3 CI/CD Pipeline / Windows init hooks smoke (#2132) / ubuntu-latest (push) Failing after 1s
V3 CI/CD Pipeline / Vector-index dimension audit (#1947) (push) Failing after 0s
V3 CI/CD Pipeline / Hook-command install safety (#1921) (push) Failing after 1s
V3 CI/CD Pipeline / ToolOutputGuardrail smoke (ADR-131, (push) Failing after 1s
V3 CI/CD Pipeline / init-bundle invariants smoke (#2095, ADR-128 Phase 5) (push) Failing after 1s
V3 CI/CD Pipeline / wasm provider bridge smoke (ADR-129 P1) (push) Failing after 2s
V3 CI/CD Pipeline / wasm gallery CRUD smoke (ADR-129 P3) (push) Failing after 1s
V3 CI/CD Pipeline / wasm plugin bridge smoke (ADR-129 P4) (push) Failing after 0s
V3 CI/CD Pipeline / wasm compose smoke (ADR-129 P2) (push) Failing after 4s
V3 CI/CD Pipeline / graph schema smoke (ADR-130 P1) (push) Failing after 0s
Validate Marketplace / validate (push) Failing after 1s
🔍 Verification Pipeline / 🚀 Setup Verification (push) Failing after 1s
🔍 Verification Pipeline / 🛡️ Security Verification (push) Has been skipped
🔍 Verification Pipeline / 📝 Code Quality (push) Has been skipped
🔍 Verification Pipeline / 🧪 Test Verification (${{ matrix.os }}, Node ${{ matrix.node }}) (push) Has been skipped
🔍 Verification Pipeline / 🏗️ Build Verification (push) Has been skipped
🔍 Verification Pipeline / 📚 Documentation Verification (push) Has been skipped
CVE Audit Gate / High-severity report (warn only) (push) Has been cancelled
🔄 Automated Rollback Manager / 🔄 Execute Rollback (push) Has been cancelled
🔄 Automated Rollback Manager / ✅ Post-Rollback Verification (push) Has been cancelled
🔄 Automated Rollback Manager / 📊 Rollback Monitoring (push) Has been cancelled
V3 CI/CD Pipeline / Windows init hooks smoke (#2132) / windows-latest (push) Has been cancelled
V3 CI/CD Pipeline / Windows hook execution smoke (#2132) / macos-latest (push) Has been cancelled
V3 CI/CD Pipeline / Windows hook execution smoke (#2132) / windows-latest (push) Has been cancelled
🔄 Automated Rollback Manager / ⏳ Manual Rollback Approval (push) Has been cancelled
V3 CI/CD Pipeline / MCP protocol smoke / macos-latest (push) Has been cancelled
V3 CI/CD Pipeline / Memory import smoke / macos-latest (push) Has been cancelled
V3 CI/CD Pipeline / Windows hook shim smoke (#2132) / macos-latest (push) Has been cancelled
V3 CI/CD Pipeline / Windows hook shim smoke (#2132) / windows-latest (push) Has been cancelled
V3 CI/CD Pipeline / Windows init hooks smoke (#2132) / macos-latest (push) Has been cancelled
V3 CI/CD Pipeline / Witness verify (signed manifest) / macos-latest (push) Has been cancelled
V3 CI/CD Pipeline / Witness verify (signed manifest) / ubuntu-latest (push) Has been cancelled
V3 CI/CD Pipeline / Witness verify (signed manifest) / windows-latest (push) Has been cancelled
V3 CI/CD Pipeline / Publish to npm (alpha) (push) Has been cancelled
V3 CI/CD Pipeline / Smoke (no better-sqlite3) / macos-latest / Node 22 (push) Has been cancelled
V3 CI/CD Pipeline / Plugin hooks smoke / macos-latest / Node 22 (push) Has been cancelled
CI/CD Pipeline / Deploy & Release (push) Has been cancelled
CI/CD Pipeline / CI Status (push) Has been cancelled
🔗 Cross-Agent Integration Tests / 📊 Integration Test Report (push) Has been cancelled
🔄 Automated Rollback Manager / 🔍 Pre-Rollback Validation (push) Has been cancelled
🔍 Verification Pipeline / ⚡ Performance Verification (push) Has been cancelled
🔍 Verification Pipeline / 📊 Verification Report (push) Has been cancelled
chore: import upstream snapshot with attribution
2026-07-13 12:02:19 +08:00

6.2 KiB

Integration Tests - Quick Start Guide

Overview

This directory contains 75 comprehensive integration tests across 5 test files covering all major V3 modules and their interactions.

Test Files

File Tests Coverage
memory-integration.test.ts 15 HybridBackend (SQLite + AgentDB)
swarm-integration.test.ts 15 Agent coordination and topologies
mcp-integration.test.ts 15 MCP tools (agent, memory, config)
plugin-integration.test.ts 15 Plugin system and extension points
workflow-integration.test.ts 15 End-to-end workflows and pipelines

Quick Commands

Run all integration tests

npm run test:integration

Run specific test file

npm run test:integration:memory      # Memory integration
npm run test:integration:swarm       # Swarm coordination
npm run test:integration:mcp         # MCP tools
npm run test:integration:plugin      # Plugin system
npm run test:integration:workflow    # Full workflows

Watch mode (auto-rerun on changes)

npm run test:integration:watch

Run with coverage

npm run test:coverage:integration

Run single test

npx vitest run -t "should execute end-to-end agent workflow"

Test Structure

Each test follows this pattern:

describe('Module Integration Tests', () => {
  let module: Module;

  beforeEach(async () => {
    // Setup: Initialize fresh instances
    module = new Module();
    await module.initialize();
  });

  afterEach(async () => {
    // Cleanup: Shutdown and cleanup resources
    await module.shutdown();
  });

  it('should test specific integration', async () => {
    // Arrange: Setup test data
    const data = createTestData();

    // Act: Execute the operation
    const result = await module.execute(data);

    // Assert: Verify the outcome
    expect(result).toBeDefined();
  });
});

Test Utilities

Import from /v3/__tests__/integration/setup.ts:

import { TestUtils, MockData, PerfUtils } from './setup';

// Create test database paths
const dbPath = TestUtils.createTestDbPath('test');

// Generate mock data
const agents = MockData.generateAgents(5);
const tasks = MockData.generateTasks(10);

// Measure performance
const { duration } = await TestUtils.measureTime(async () => {
  await someOperation();
});

// Benchmark operations
const stats = await PerfUtils.benchmark('operation', async () => {
  await operation();
}, 10);

Debugging Tests

Enable verbose output

DEBUG=claude-flow:* npm run test:integration

Run in watch mode with specific test

npx vitest watch -t "should handle concurrent memory operations"

Generate HTML coverage report

npm run test:coverage:integration
# Open __tests__/coverage/index.html

Use VS Code debugger

  1. Set breakpoint in test file
  2. Open "Run and Debug" panel (Ctrl+Shift+D)
  3. Select "Debug Vitest Tests"
  4. Click "Start Debugging" (F5)

Common Issues

Database lock errors

  • Cause: Previous test didn't clean up properly
  • Fix: Delete /v3/__tests__/integration/.test-dbs/ directory

Timeout errors

  • Cause: Operation taking longer than 10s (default timeout)
  • Fix: Increase timeout in specific test:
    it('slow test', async () => {
      // ...
    }, 30000); // 30 second timeout
    

Port already in use

  • Cause: Previous test server still running
  • Fix: Kill the process or restart terminal

Memory leaks

  • Cause: Not cleaning up event listeners or connections
  • Fix: Ensure afterEach properly cleans up:
    afterEach(async () => {
      await module.shutdown();
      eventBus.removeAllListeners();
    });
    

Performance Expectations

Operation Target Time
Memory store <10ms
Memory query <50ms
Vector search <100ms
Agent spawn <50ms
Task execution <200ms
Workflow execution <500ms

Coverage Targets

From V3 ADR-008 (Vitest over Jest):

  • Lines: >80%
  • Branches: >75%
  • Functions: >80%
  • Statements: >80%

Current integration test coverage:

  • All major integration points: 100%
  • Cross-module interactions: >90%

CI/CD Integration

These tests run automatically on:

  • Push to v3 branch
  • Pull requests to main
  • Nightly builds

Expected CI execution time: <5 minutes

Best Practices

  1. Isolation: Each test should be independent
  2. Cleanup: Always cleanup in afterEach
  3. Deterministic: No random behavior (use fixed seeds)
  4. Fast: Keep tests under 10 seconds each
  5. Clear: Use descriptive test names
  6. Focused: Test one integration point per test

Example Test Sessions

First time running tests

# Install dependencies (if not done)
cd /workspaces/claude-flow/v3
npm install

# Run all integration tests
npm run test:integration

Development workflow

# Start watch mode
npm run test:integration:watch

# Edit integration code in src/
# Tests auto-rerun on save

# Check coverage
npm run test:coverage:integration

Before committing

# Run all tests with coverage
npm run test:coverage:integration

# Verify coverage thresholds met
# Fix any failing tests
# Commit changes

Getting Help

  • Read test file comments for specific integration details
  • Check /v3/__tests__/integration/README.md for full documentation
  • Review /v3/docs/architecture/ for ADR decisions
  • See /CLAUDE.md for development guidelines

Next Steps

After running integration tests:

  1. Review coverage report: __tests__/coverage/index.html
  2. Check for uncovered code paths
  3. Add tests for new features
  4. Update this guide if adding new test files

Quick Reference

# Common commands
npm run test:integration              # Run all
npm run test:integration:watch        # Watch mode
npm run test:integration:memory       # Memory only
npm run test:coverage:integration     # With coverage

# Debugging
DEBUG=* npm run test:integration      # Verbose logs
npx vitest run -t "test name"        # Single test
npx vitest run --reporter=verbose    # Detailed output

# Cleanup
rm -rf __tests__/integration/.test-dbs/  # Clean test DBs
rm -rf __tests__/coverage/              # Clean coverage