426e9eeabd
Voice Workbench / headless workbench (mocked backends) (push) Has been cancelled
Voice Workbench / real acoustic lane (nightly, provisioned only) (push) Has been cancelled
ci / test (push) Has been cancelled
ci / lint-and-format (push) Has been cancelled
ci / build (push) Has been cancelled
ci / dev-startup (push) Has been cancelled
gitleaks / gitleaks (push) Has been cancelled
Markdown Links / Relative Markdown Links (push) Has been cancelled
Quality (Extended) / Homepage Build (PR smoke) (push) Has been cancelled
Quality (Extended) / Comment-only diff guard (push) Has been cancelled
Quality (Extended) / Format + Type Safety Ratchet (push) Has been cancelled
Quality (Extended) / Develop Gate (secret scan + UI determinism) (push) Has been cancelled
Quality (Extended) / Develop Gate (lint) (push) Has been cancelled
Chat shell gestures / Chat shell gesture + parity e2e (push) Has been cancelled
Cloud Gateway Discord / Test (push) Has been cancelled
Benchmark Bridge Tests / benchmark (bunx @biomejs/biome check packages/lifeops-bench/src, benchmark-lint) (push) Has been cancelled
Benchmark Bridge Tests / benchmark (bunx vitest run --config packages/lifeops-bench/vitest.config.ts --root packages/lifeops-bench --passWithNoTests, benchmark-tests) (push) Has been cancelled
Build Agent Image / build-and-push (push) Has been cancelled
Dev Smoke / bun run dev onboarding chat (push) Has been cancelled
Dev Smoke / Vite HMR dependency-level smoke (push) Has been cancelled
Electrobun Submodule Guard / electrobun gitlink is fetchable (push) Has been cancelled
Publish @elizaos/example-code / check_npm (push) Has been cancelled
Publish @elizaos/example-code / publish_npm (push) Has been cancelled
Publish @elizaos/plugin-elizacloud / verify_version (push) Has been cancelled
Publish @elizaos/plugin-elizacloud / publish_npm (push) Has been cancelled
Sandbox Live Smoke / Sandbox live smoke (push) Has been cancelled
Snap Build & Test / Build Snap (amd64) (push) Has been cancelled
Snap Build & Test / Build Snap (arm64) (push) Has been cancelled
Test Packaging / elizaos CLI global-install smoke (node + bun) (push) Has been cancelled
Cloud Gateway Webhook / Test (push) Has been cancelled
Cloud Tests / lint-and-types (push) Has been cancelled
Cloud Tests / unit-tests (push) Has been cancelled
Cloud Tests / integration-tests (push) Has been cancelled
Cloud Tests / e2e-tests (push) Has been cancelled
CodeQL Advanced / Analyze (javascript-typescript) (push) Has been cancelled
Deploy Apps Worker (Product 2) / Determine environment (push) Has been cancelled
Deploy Apps Worker (Product 2) / Deploy apps worker to apps-control host (${{ needs.determine-env.outputs.environment }}) (push) Has been cancelled
Deploy Eliza Provisioning Worker / Determine environment (push) Has been cancelled
Deploy Eliza Provisioning Worker / Deploy worker to Hetzner host (${{ needs.determine-env.outputs.environment }} @ ${{ needs.determine-env.outputs.deployment_sha }}) (push) Has been cancelled
Dev Smoke / Classify changed paths (push) Has been cancelled
supply-chain / sbom (push) Has been cancelled
supply-chain / vulnerability-scan (push) Has been cancelled
Build, Push & Deploy to Phala Cloud / build-and-push (push) Has been cancelled
Test Packaging / Validate Packaging Configs (push) Has been cancelled
Test Packaging / Build & Test PyPI Package (push) Has been cancelled
Test Packaging / PyPI on Python ${{ matrix.python }} (push) Has been cancelled
Test Packaging / Pack & Test JS Tarballs (push) Has been cancelled
UI Fixture E2E / ui-fixture-e2e (push) Has been cancelled
UI Fixture E2E / fixture-e2e (push) Has been cancelled
UI Story Gate / story-gate (push) Has been cancelled
vault-ci / test (macos-latest) (push) Has been cancelled
vault-ci / test (ubuntu-latest) (push) Has been cancelled
vault-ci / test (windows-latest) (push) Has been cancelled
vault-ci / app-core wiring tests (push) Has been cancelled
verify-patches / verify patches/CHECKSUMS.sha256 (push) Has been cancelled
Voice Benchmark Smoke / voice-emotion fixture smoke (push) Has been cancelled
Voice Benchmark Smoke / voiceagentbench fixture smoke (push) Has been cancelled
Voice Benchmark Smoke / voicebench-quality unit smoke (push) Has been cancelled
Voice Benchmark Smoke / voicebench TypeScript unit (no audio) (push) Has been cancelled
Voice Benchmark Smoke / voice bench smoke summary (push) Has been cancelled
Windows CI / windows ([bun run --cwd packages/app-core test bun run --cwd packages/elizaos test bun run --cwd packages/cloud/shared test], app-and-cli) (push) Has been cancelled
Windows CI / windows ([bun run --cwd packages/scenario-runner test bun run --cwd packages/vault test bun run --cwd packages/security test bun run --cwd plugins/plugin-coding-tools test], framework-packages) (push) Has been cancelled
Windows CI / windows ([bun run --cwd plugins/plugin-elizacloud test bun run --cwd plugins/plugin-discord test bun run --cwd plugins/plugin-anthropic test bun run --cwd plugins/plugin-openai test bun run --cwd plugins/plugin-app-control test bun run --cwd plugins/pl… (push) Has been cancelled
Windows CI / windows ([node packages/scripts/run-turbo.mjs run build --filter=@elizaos/core --filter=@elizaos/shared --filter=@elizaos/agent --concurrency=4 node packages/scripts/run-bash-linux-only.mjs scripts/verify-riscv64-buildpaths.sh node packages/scripts/run… (push) Has been cancelled
Windows CI / windows ([node packages/scripts/run-turbo.mjs run typecheck --filter=@elizaos/core --filter=@elizaos/shared --filter=@elizaos/cloud-shared --concurrency=4 bun run --cwd packages/core test bun run --cwd packages/shared test], core-runtime, 75) (push) Has been cancelled
526 lines
16 KiB
TypeScript
526 lines
16 KiB
TypeScript
/** Integration coverage for the three workflow providers against a mocked WorkflowService (deterministic, no live model). */
|
|
import { describe, expect, mock, test } from 'bun:test';
|
|
import { activeWorkflowsProvider } from '../../../src/providers/activeWorkflows';
|
|
import { pendingDraftProvider } from '../../../src/providers/pendingDraft';
|
|
import { workflowStatusProvider } from '../../../src/providers/workflowStatus';
|
|
import { WORKFLOW_SERVICE_TYPE, WorkflowService } from '../../../src/services/workflow-service';
|
|
import {
|
|
createExecution,
|
|
createSlackNode,
|
|
createTriggerNode,
|
|
createWorkflowResponse,
|
|
} from '../../fixtures/workflows';
|
|
import { createMockMessage, createMockRuntime, createMockState } from '../../helpers/mockRuntime';
|
|
import { createMockService } from '../../helpers/mockService';
|
|
|
|
// ============================================================================
|
|
// activeWorkflowsProvider
|
|
// ============================================================================
|
|
|
|
describe('activeWorkflowsProvider', () => {
|
|
test('matches WORKFLOW action chat contexts and uses turn cache', () => {
|
|
expect(activeWorkflowsProvider.contexts).toEqual([
|
|
'general',
|
|
'automation',
|
|
'tasks',
|
|
'connectors',
|
|
]);
|
|
expect(activeWorkflowsProvider.contextGate).toEqual({
|
|
anyOf: ['general', 'automation', 'tasks', 'connectors'],
|
|
});
|
|
expect(activeWorkflowsProvider.cacheScope).toBe('turn');
|
|
});
|
|
|
|
test('returns empty when service not available', async () => {
|
|
const runtime = createMockRuntime();
|
|
const result = await activeWorkflowsProvider.get(
|
|
runtime,
|
|
createMockMessage(),
|
|
createMockState()
|
|
);
|
|
|
|
expect(result.text).toBe('');
|
|
expect(result.data).toEqual({});
|
|
});
|
|
|
|
test('returns empty workflows when user has none', async () => {
|
|
const mockService = createMockService({
|
|
listWorkflows: mock(() => Promise.resolve([])),
|
|
});
|
|
const runtime = createMockRuntime({
|
|
services: { [WORKFLOW_SERVICE_TYPE]: mockService },
|
|
});
|
|
|
|
const result = await activeWorkflowsProvider.get(
|
|
runtime,
|
|
createMockMessage(),
|
|
createMockState()
|
|
);
|
|
|
|
expect(result.data).toEqual({ workflows: [] });
|
|
expect(result.values).toEqual({ hasWorkflows: false });
|
|
});
|
|
|
|
test('returns formatted workflow data', async () => {
|
|
const mockService = createMockService({
|
|
listWorkflows: mock(() =>
|
|
Promise.resolve([
|
|
createWorkflowResponse({
|
|
id: 'wf-1',
|
|
name: 'Stripe Payments',
|
|
active: true,
|
|
nodes: [
|
|
createTriggerNode({ name: 'n1', position: [0, 0] }),
|
|
createTriggerNode({ name: 'n2', position: [100, 0] }),
|
|
createTriggerNode({ name: 'n3', position: [200, 0] }),
|
|
],
|
|
}),
|
|
createWorkflowResponse({
|
|
id: 'wf-2',
|
|
name: 'Gmail Automation',
|
|
active: false,
|
|
}),
|
|
])
|
|
),
|
|
});
|
|
const runtime = createMockRuntime({
|
|
services: { [WORKFLOW_SERVICE_TYPE]: mockService },
|
|
});
|
|
|
|
const result = await activeWorkflowsProvider.get(
|
|
runtime,
|
|
createMockMessage(),
|
|
createMockState()
|
|
);
|
|
|
|
expect(result.text).toContain('Stripe Payments');
|
|
expect(result.text).toContain('Gmail Automation');
|
|
expect(result.text).toContain('ACTIVE');
|
|
expect(result.text).toContain('INACTIVE');
|
|
expect(result.values).toEqual({ hasWorkflows: true, workflowCount: 2 });
|
|
const workflows = result.data?.workflows as Array<Record<string, unknown>>;
|
|
expect(workflows).toHaveLength(2);
|
|
expect(workflows[0]).toEqual({
|
|
id: 'wf-1',
|
|
name: 'Stripe Payments',
|
|
active: true,
|
|
nodeCount: 3,
|
|
});
|
|
});
|
|
|
|
test('searches workflows from workflow-related message text', async () => {
|
|
const searchQuery = 'Find the workflow that posts to Slack';
|
|
const mockService = createMockService({
|
|
listWorkflows: mock(() => Promise.resolve([])),
|
|
searchWorkflows: mock(() =>
|
|
Promise.resolve([
|
|
createWorkflowResponse({
|
|
id: 'wf-slack',
|
|
name: 'Slack Alerts',
|
|
active: true,
|
|
nodes: [createTriggerNode({ name: 'Slack', position: [0, 0] })],
|
|
}),
|
|
])
|
|
),
|
|
});
|
|
const runtime = createMockRuntime({
|
|
services: { [WORKFLOW_SERVICE_TYPE]: mockService },
|
|
});
|
|
const message = createMockMessage({
|
|
entityId: 'user-123',
|
|
content: { text: searchQuery },
|
|
});
|
|
|
|
const result = await activeWorkflowsProvider.get(runtime, message, createMockState());
|
|
|
|
expect(mockService.searchWorkflows).toHaveBeenCalledWith(searchQuery, 'user-123');
|
|
expect(mockService.listWorkflows).not.toHaveBeenCalled();
|
|
expect(result.text).toContain('# Matching Workflows');
|
|
expect(result.text).toContain('Slack Alerts');
|
|
expect(result.data).toEqual({
|
|
workflows: [
|
|
{
|
|
id: 'wf-slack',
|
|
name: 'Slack Alerts',
|
|
active: true,
|
|
nodeCount: 1,
|
|
},
|
|
],
|
|
searchQuery,
|
|
});
|
|
expect(result.values).toEqual({
|
|
hasWorkflows: true,
|
|
workflowCount: 1,
|
|
workflowSearchQuery: searchQuery,
|
|
});
|
|
});
|
|
|
|
test('searches sentence text through the real workflow ranking path', async () => {
|
|
const service = Object.assign(Object.create(WorkflowService.prototype), {
|
|
serviceType: WORKFLOW_SERVICE_TYPE,
|
|
listWorkflows: mock(() =>
|
|
Promise.resolve([
|
|
createWorkflowResponse({
|
|
id: 'wf-gmail',
|
|
name: 'Gmail digest',
|
|
}),
|
|
createWorkflowResponse({
|
|
id: 'wf-slack',
|
|
name: 'Team notifications',
|
|
nodes: [createTriggerNode(), createSlackNode()],
|
|
}),
|
|
])
|
|
),
|
|
}) as WorkflowService;
|
|
const runtime = createMockRuntime({
|
|
services: { [WORKFLOW_SERVICE_TYPE]: service },
|
|
});
|
|
const message = createMockMessage({
|
|
entityId: 'user-123',
|
|
content: { text: 'find the workflow that posts to Slack' },
|
|
});
|
|
|
|
const result = await activeWorkflowsProvider.get(runtime, message, createMockState());
|
|
|
|
expect(service.listWorkflows).toHaveBeenCalledWith('user-123');
|
|
expect(result.text).toContain('# Matching Workflows');
|
|
expect(result.text).toContain('Team notifications');
|
|
expect(result.text).not.toContain('Gmail digest');
|
|
expect(result.data).toEqual({
|
|
workflows: [
|
|
{
|
|
id: 'wf-slack',
|
|
name: 'Team notifications',
|
|
active: false,
|
|
nodeCount: 2,
|
|
},
|
|
],
|
|
searchQuery: 'find the workflow that posts to Slack',
|
|
});
|
|
});
|
|
|
|
test('uses full workflow list for non-workflow chat text', async () => {
|
|
const mockService = createMockService({
|
|
listWorkflows: mock(() =>
|
|
Promise.resolve([createWorkflowResponse({ id: 'wf-1', name: 'Daily Summary' })])
|
|
),
|
|
searchWorkflows: mock(() => Promise.resolve([])),
|
|
});
|
|
const runtime = createMockRuntime({
|
|
services: { [WORKFLOW_SERVICE_TYPE]: mockService },
|
|
});
|
|
const message = createMockMessage({
|
|
content: { text: 'What happened this morning?' },
|
|
});
|
|
|
|
const result = await activeWorkflowsProvider.get(runtime, message, createMockState());
|
|
|
|
expect(mockService.listWorkflows).toHaveBeenCalledWith('user-001');
|
|
expect(mockService.searchWorkflows).not.toHaveBeenCalled();
|
|
expect(result.text).toContain('# Available Workflows');
|
|
expect(result.data).toEqual({
|
|
workflows: [
|
|
{
|
|
id: 'wf-1',
|
|
name: 'Daily Summary',
|
|
active: false,
|
|
nodeCount: 2,
|
|
},
|
|
],
|
|
});
|
|
});
|
|
|
|
test('returns explicit empty result when workflow search has no matches', async () => {
|
|
const searchQuery = 'search workflows for calendar cleanup';
|
|
const mockService = createMockService({
|
|
searchWorkflows: mock(() => Promise.resolve([])),
|
|
});
|
|
const runtime = createMockRuntime({
|
|
services: { [WORKFLOW_SERVICE_TYPE]: mockService },
|
|
});
|
|
const message = createMockMessage({
|
|
content: { text: searchQuery },
|
|
});
|
|
|
|
const result = await activeWorkflowsProvider.get(runtime, message, createMockState());
|
|
|
|
expect(result.text).toContain(`No workflows match "${searchQuery}".`);
|
|
expect(result.data).toEqual({ workflows: [], searchQuery });
|
|
expect(result.values).toEqual({
|
|
hasWorkflows: false,
|
|
workflowCount: 0,
|
|
workflowSearchQuery: searchQuery,
|
|
});
|
|
});
|
|
|
|
test('passes userId from message', async () => {
|
|
const mockService = createMockService();
|
|
const runtime = createMockRuntime({
|
|
services: { [WORKFLOW_SERVICE_TYPE]: mockService },
|
|
});
|
|
const message = createMockMessage({
|
|
entityId: 'custom-user-0000-0000-000000000001',
|
|
});
|
|
|
|
await activeWorkflowsProvider.get(runtime, message, createMockState());
|
|
|
|
expect(mockService.listWorkflows).toHaveBeenCalledWith('custom-user-0000-0000-000000000001');
|
|
});
|
|
|
|
test('handles service error gracefully', async () => {
|
|
const mockService = createMockService({
|
|
listWorkflows: mock(() => Promise.reject(new Error('Network error'))),
|
|
});
|
|
const runtime = createMockRuntime({
|
|
services: { [WORKFLOW_SERVICE_TYPE]: mockService },
|
|
});
|
|
|
|
const result = await activeWorkflowsProvider.get(
|
|
runtime,
|
|
createMockMessage(),
|
|
createMockState()
|
|
);
|
|
|
|
// Should return empty result, not throw
|
|
expect(result.text).toBe('');
|
|
});
|
|
});
|
|
|
|
// ============================================================================
|
|
// workflowStatusProvider
|
|
// ============================================================================
|
|
|
|
describe('workflowStatusProvider', () => {
|
|
test('returns empty when service not available', async () => {
|
|
const runtime = createMockRuntime();
|
|
const result = await workflowStatusProvider.get(
|
|
runtime,
|
|
createMockMessage(),
|
|
createMockState()
|
|
);
|
|
|
|
expect(result.text).toBe('');
|
|
});
|
|
|
|
test('returns message when no workflows', async () => {
|
|
const mockService = createMockService({
|
|
listWorkflows: mock(() => Promise.resolve([])),
|
|
});
|
|
const runtime = createMockRuntime({
|
|
services: { [WORKFLOW_SERVICE_TYPE]: mockService },
|
|
});
|
|
|
|
const result = await workflowStatusProvider.get(
|
|
runtime,
|
|
createMockMessage(),
|
|
createMockState()
|
|
);
|
|
|
|
expect(result.text).toContain('No workflows');
|
|
});
|
|
|
|
test('includes workflow status and execution info', async () => {
|
|
const mockService = createMockService({
|
|
listWorkflows: mock(() =>
|
|
Promise.resolve([
|
|
createWorkflowResponse({
|
|
id: 'wf-1',
|
|
name: 'Active WF',
|
|
active: true,
|
|
}),
|
|
])
|
|
),
|
|
getWorkflowExecutions: mock(() =>
|
|
Promise.resolve([
|
|
createExecution({
|
|
status: 'success',
|
|
startedAt: '2025-01-15T10:30:00.000Z',
|
|
}),
|
|
])
|
|
),
|
|
});
|
|
const runtime = createMockRuntime({
|
|
services: { [WORKFLOW_SERVICE_TYPE]: mockService },
|
|
});
|
|
|
|
const result = await workflowStatusProvider.get(
|
|
runtime,
|
|
createMockMessage(),
|
|
createMockState()
|
|
);
|
|
|
|
expect(result.text).toContain('Active WF');
|
|
expect(result.text).toContain('success');
|
|
expect(result.values).toEqual({ workflowCount: 1 });
|
|
});
|
|
|
|
test('handles execution fetch error per workflow', async () => {
|
|
const mockService = createMockService({
|
|
listWorkflows: mock(() =>
|
|
Promise.resolve([createWorkflowResponse({ id: 'wf-1', name: 'WF', active: true })])
|
|
),
|
|
getWorkflowExecutions: mock(() => Promise.reject(new Error('Execution API error'))),
|
|
});
|
|
const runtime = createMockRuntime({
|
|
services: { [WORKFLOW_SERVICE_TYPE]: mockService },
|
|
});
|
|
|
|
const result = await workflowStatusProvider.get(
|
|
runtime,
|
|
createMockMessage(),
|
|
createMockState()
|
|
);
|
|
|
|
// Should still return workflow info even if executions fail
|
|
expect(result.text).toContain('WF');
|
|
});
|
|
|
|
test('limits to 10 workflows', async () => {
|
|
const mockService = createMockService({
|
|
listWorkflows: mock(() =>
|
|
Promise.resolve(
|
|
Array.from({ length: 15 }, (_, i) =>
|
|
createWorkflowResponse({ id: `wf-${i}`, name: `Workflow ${i}` })
|
|
)
|
|
)
|
|
),
|
|
});
|
|
const runtime = createMockRuntime({
|
|
services: { [WORKFLOW_SERVICE_TYPE]: mockService },
|
|
});
|
|
|
|
const result = await workflowStatusProvider.get(
|
|
runtime,
|
|
createMockMessage(),
|
|
createMockState()
|
|
);
|
|
|
|
expect(result.text).toContain('5 more workflows');
|
|
});
|
|
});
|
|
|
|
// ============================================================================
|
|
// pendingDraftProvider
|
|
// ============================================================================
|
|
|
|
describe('pendingDraftProvider', () => {
|
|
const draftWorkflow = {
|
|
name: 'Gmail to Telegram',
|
|
nodes: [
|
|
{
|
|
name: 'Gmail Trigger',
|
|
type: 'workflows-nodes-base.gmailTrigger',
|
|
typeVersion: 1,
|
|
position: [0, 0],
|
|
parameters: {},
|
|
},
|
|
{
|
|
name: 'Telegram Send',
|
|
type: 'workflows-nodes-base.telegram',
|
|
typeVersion: 1,
|
|
position: [200, 0],
|
|
parameters: {},
|
|
},
|
|
],
|
|
connections: {},
|
|
settings: {},
|
|
};
|
|
|
|
test('returns empty when no draft in cache', async () => {
|
|
const runtime = createMockRuntime();
|
|
const result = await pendingDraftProvider.get(runtime, createMockMessage(), createMockState());
|
|
|
|
expect(result.text).toBe('');
|
|
expect(result.data).toEqual({});
|
|
});
|
|
|
|
test('returns draft info when draft exists', async () => {
|
|
const runtime = createMockRuntime({
|
|
cache: {
|
|
'workflow_draft:user-001': {
|
|
workflow: draftWorkflow,
|
|
prompt: 'Send gmail to telegram',
|
|
userId: 'user-001',
|
|
createdAt: Date.now(),
|
|
},
|
|
},
|
|
});
|
|
|
|
const result = await pendingDraftProvider.get(
|
|
runtime,
|
|
createMockMessage({ entityId: 'user-001' }),
|
|
createMockState()
|
|
);
|
|
|
|
expect(result.text).toContain('Gmail to Telegram');
|
|
expect(result.text).toContain('WORKFLOW');
|
|
expect(result.data).toEqual({ hasPendingDraft: true, truncated: false });
|
|
expect(result.values).toEqual({ hasPendingDraft: true });
|
|
});
|
|
|
|
test('returns empty for expired draft', async () => {
|
|
const runtime = createMockRuntime({
|
|
cache: {
|
|
'workflow_draft:user-001': {
|
|
workflow: draftWorkflow,
|
|
prompt: 'test',
|
|
userId: 'user-001',
|
|
createdAt: Date.now() - 31 * 60 * 1000, // 31 min ago — expired
|
|
},
|
|
},
|
|
});
|
|
|
|
const result = await pendingDraftProvider.get(
|
|
runtime,
|
|
createMockMessage({ entityId: 'user-001' }),
|
|
createMockState()
|
|
);
|
|
|
|
expect(result.text).toBe('');
|
|
expect(result.data).toEqual({});
|
|
});
|
|
|
|
test('includes node names in text', async () => {
|
|
const runtime = createMockRuntime({
|
|
cache: {
|
|
'workflow_draft:user-001': {
|
|
workflow: draftWorkflow,
|
|
prompt: 'test',
|
|
userId: 'user-001',
|
|
createdAt: Date.now(),
|
|
},
|
|
},
|
|
});
|
|
|
|
const result = await pendingDraftProvider.get(
|
|
runtime,
|
|
createMockMessage({ entityId: 'user-001' }),
|
|
createMockState()
|
|
);
|
|
|
|
expect(result.text).toContain('Gmail Trigger');
|
|
expect(result.text).toContain('Telegram Send');
|
|
});
|
|
|
|
test('scoped to user — no draft for other user', async () => {
|
|
const runtime = createMockRuntime({
|
|
cache: {
|
|
'workflow_draft:user-001': {
|
|
workflow: draftWorkflow,
|
|
prompt: 'test',
|
|
userId: 'user-001',
|
|
createdAt: Date.now(),
|
|
},
|
|
},
|
|
});
|
|
|
|
const result = await pendingDraftProvider.get(
|
|
runtime,
|
|
createMockMessage({ entityId: 'other-user' }),
|
|
createMockState()
|
|
);
|
|
|
|
expect(result.text).toBe('');
|
|
});
|
|
});
|