Files
wehub-resource-sync 426e9eeabd
Voice Workbench / headless workbench (mocked backends) (push) Has been cancelled
Voice Workbench / real acoustic lane (nightly, provisioned only) (push) Has been cancelled
ci / test (push) Has been cancelled
ci / lint-and-format (push) Has been cancelled
ci / build (push) Has been cancelled
ci / dev-startup (push) Has been cancelled
gitleaks / gitleaks (push) Has been cancelled
Markdown Links / Relative Markdown Links (push) Has been cancelled
Quality (Extended) / Homepage Build (PR smoke) (push) Has been cancelled
Quality (Extended) / Comment-only diff guard (push) Has been cancelled
Quality (Extended) / Format + Type Safety Ratchet (push) Has been cancelled
Quality (Extended) / Develop Gate (secret scan + UI determinism) (push) Has been cancelled
Quality (Extended) / Develop Gate (lint) (push) Has been cancelled
Chat shell gestures / Chat shell gesture + parity e2e (push) Has been cancelled
Cloud Gateway Discord / Test (push) Has been cancelled
Benchmark Bridge Tests / benchmark (bunx @biomejs/biome check packages/lifeops-bench/src, benchmark-lint) (push) Has been cancelled
Benchmark Bridge Tests / benchmark (bunx vitest run --config packages/lifeops-bench/vitest.config.ts --root packages/lifeops-bench --passWithNoTests, benchmark-tests) (push) Has been cancelled
Build Agent Image / build-and-push (push) Has been cancelled
Dev Smoke / bun run dev onboarding chat (push) Has been cancelled
Dev Smoke / Vite HMR dependency-level smoke (push) Has been cancelled
Electrobun Submodule Guard / electrobun gitlink is fetchable (push) Has been cancelled
Publish @elizaos/example-code / check_npm (push) Has been cancelled
Publish @elizaos/example-code / publish_npm (push) Has been cancelled
Publish @elizaos/plugin-elizacloud / verify_version (push) Has been cancelled
Publish @elizaos/plugin-elizacloud / publish_npm (push) Has been cancelled
Sandbox Live Smoke / Sandbox live smoke (push) Has been cancelled
Snap Build & Test / Build Snap (amd64) (push) Has been cancelled
Snap Build & Test / Build Snap (arm64) (push) Has been cancelled
Test Packaging / elizaos CLI global-install smoke (node + bun) (push) Has been cancelled
Cloud Gateway Webhook / Test (push) Has been cancelled
Cloud Tests / lint-and-types (push) Has been cancelled
Cloud Tests / unit-tests (push) Has been cancelled
Cloud Tests / integration-tests (push) Has been cancelled
Cloud Tests / e2e-tests (push) Has been cancelled
CodeQL Advanced / Analyze (javascript-typescript) (push) Has been cancelled
Deploy Apps Worker (Product 2) / Determine environment (push) Has been cancelled
Deploy Apps Worker (Product 2) / Deploy apps worker to apps-control host (${{ needs.determine-env.outputs.environment }}) (push) Has been cancelled
Deploy Eliza Provisioning Worker / Determine environment (push) Has been cancelled
Deploy Eliza Provisioning Worker / Deploy worker to Hetzner host (${{ needs.determine-env.outputs.environment }} @ ${{ needs.determine-env.outputs.deployment_sha }}) (push) Has been cancelled
Dev Smoke / Classify changed paths (push) Has been cancelled
supply-chain / sbom (push) Has been cancelled
supply-chain / vulnerability-scan (push) Has been cancelled
Build, Push & Deploy to Phala Cloud / build-and-push (push) Has been cancelled
Test Packaging / Validate Packaging Configs (push) Has been cancelled
Test Packaging / Build & Test PyPI Package (push) Has been cancelled
Test Packaging / PyPI on Python ${{ matrix.python }} (push) Has been cancelled
Test Packaging / Pack & Test JS Tarballs (push) Has been cancelled
UI Fixture E2E / ui-fixture-e2e (push) Has been cancelled
UI Fixture E2E / fixture-e2e (push) Has been cancelled
UI Story Gate / story-gate (push) Has been cancelled
vault-ci / test (macos-latest) (push) Has been cancelled
vault-ci / test (ubuntu-latest) (push) Has been cancelled
vault-ci / test (windows-latest) (push) Has been cancelled
vault-ci / app-core wiring tests (push) Has been cancelled
verify-patches / verify patches/CHECKSUMS.sha256 (push) Has been cancelled
Voice Benchmark Smoke / voice-emotion fixture smoke (push) Has been cancelled
Voice Benchmark Smoke / voiceagentbench fixture smoke (push) Has been cancelled
Voice Benchmark Smoke / voicebench-quality unit smoke (push) Has been cancelled
Voice Benchmark Smoke / voicebench TypeScript unit (no audio) (push) Has been cancelled
Voice Benchmark Smoke / voice bench smoke summary (push) Has been cancelled
Windows CI / windows ([bun run --cwd packages/app-core test bun run --cwd packages/elizaos test bun run --cwd packages/cloud/shared test], app-and-cli) (push) Has been cancelled
Windows CI / windows ([bun run --cwd packages/scenario-runner test bun run --cwd packages/vault test bun run --cwd packages/security test bun run --cwd plugins/plugin-coding-tools test], framework-packages) (push) Has been cancelled
Windows CI / windows ([bun run --cwd plugins/plugin-elizacloud test bun run --cwd plugins/plugin-discord test bun run --cwd plugins/plugin-anthropic test bun run --cwd plugins/plugin-openai test bun run --cwd plugins/plugin-app-control test bun run --cwd plugins/pl… (push) Has been cancelled
Windows CI / windows ([node packages/scripts/run-turbo.mjs run build --filter=@elizaos/core --filter=@elizaos/shared --filter=@elizaos/agent --concurrency=4 node packages/scripts/run-bash-linux-only.mjs scripts/verify-riscv64-buildpaths.sh node packages/scripts/run… (push) Has been cancelled
Windows CI / windows ([node packages/scripts/run-turbo.mjs run typecheck --filter=@elizaos/core --filter=@elizaos/shared --filter=@elizaos/cloud-shared --concurrency=4 bun run --cwd packages/core test bun run --cwd packages/shared test], core-runtime, 75) (push) Has been cancelled
chore: import upstream snapshot with attribution
2026-07-13 12:43:05 +08:00

103 lines
3.6 KiB
TypeScript

/**
* Selection-validator tests for MCP tool and resource dispatch.
* They cover untrusted model output before a call reaches a connected server, including server state, tool/resource existence, and argument schema checks.
*/
import type { State } from "@elizaos/core";
import { describe, expect, it } from "vitest";
import {
validateResourceSelection,
validateToolSelectionArgument,
validateToolSelectionName,
} from "../src/utils/validation.js";
const stateWith = (mcp: Record<string, unknown>): State =>
({ values: { mcp }, data: {}, text: "" }) as unknown as State;
const connectedServer = {
status: "connected",
tools: { search: { description: "search the web" } },
};
describe("validateToolSelectionName", () => {
it("accepts a noToolAvailable signal and preserves reasoning", () => {
const res = validateToolSelectionName(
{ noToolAvailable: true, reasoning: "nothing fits" },
stateWith({})
);
expect(res.success).toBe(true);
if (res.success) {
expect(res.data.noToolAvailable).toBe(true);
expect(res.data.reasoning).toBe("nothing fits");
}
});
it("rejects a selection for an unknown or disconnected server", () => {
expect(
validateToolSelectionName({ serverName: "ghost", toolName: "search" }, stateWith({})).success
).toBe(false);
expect(
validateToolSelectionName(
{ serverName: "web", toolName: "search" },
stateWith({ web: { status: "connecting", tools: {} } })
).success
).toBe(false);
});
it("rejects a tool that does not exist on a connected server", () => {
const res = validateToolSelectionName(
{ serverName: "web", toolName: "delete_everything" },
stateWith({ web: connectedServer })
);
expect(res.success).toBe(false);
if (!res.success) expect(res.error).toMatch(/not found on server/);
});
it("accepts a real tool on a connected server", () => {
const res = validateToolSelectionName(
{ serverName: "web", toolName: "search" },
stateWith({ web: connectedServer })
);
expect(res.success).toBe(true);
});
it("rejects structurally invalid output (missing toolName)", () => {
expect(
validateToolSelectionName({ serverName: "web" }, stateWith({ web: connectedServer })).success
).toBe(false);
});
});
describe("validateToolSelectionArgument", () => {
const schema = {
type: "object",
properties: { q: { type: "string" } },
required: ["q"],
} as const;
it("validates arguments against the tool input schema", () => {
expect(validateToolSelectionArgument({ toolArguments: { q: "hi" } }, schema).success).toBe(
true
);
const bad = validateToolSelectionArgument({ toolArguments: {} }, schema);
expect(bad.success).toBe(false);
if (!bad.success) expect(bad.error).toMatch(/Invalid arguments/);
});
it("coerces an empty-string/'{}' toolArguments to an empty object", () => {
const emptyObjSchema = { type: "object" } as const;
expect(validateToolSelectionArgument({ toolArguments: "" }, emptyObjSchema).success).toBe(true);
expect(validateToolSelectionArgument({ toolArguments: "{}" }, emptyObjSchema).success).toBe(
true
);
});
});
describe("validateResourceSelection", () => {
it("accepts noResourceAvailable and a well-formed selection, rejects a malformed one", () => {
expect(validateResourceSelection({ noResourceAvailable: true }).success).toBe(true);
expect(validateResourceSelection({ serverName: "fs", uri: "file:///a" }).success).toBe(true);
expect(validateResourceSelection({ serverName: "fs" }).success).toBe(false);
});
});