426e9eeabd
Voice Workbench / headless workbench (mocked backends) (push) Has been cancelled
Voice Workbench / real acoustic lane (nightly, provisioned only) (push) Has been cancelled
ci / test (push) Has been cancelled
ci / lint-and-format (push) Has been cancelled
ci / build (push) Has been cancelled
ci / dev-startup (push) Has been cancelled
gitleaks / gitleaks (push) Has been cancelled
Markdown Links / Relative Markdown Links (push) Has been cancelled
Quality (Extended) / Homepage Build (PR smoke) (push) Has been cancelled
Quality (Extended) / Comment-only diff guard (push) Has been cancelled
Quality (Extended) / Format + Type Safety Ratchet (push) Has been cancelled
Quality (Extended) / Develop Gate (secret scan + UI determinism) (push) Has been cancelled
Quality (Extended) / Develop Gate (lint) (push) Has been cancelled
Chat shell gestures / Chat shell gesture + parity e2e (push) Has been cancelled
Cloud Gateway Discord / Test (push) Has been cancelled
Benchmark Bridge Tests / benchmark (bunx @biomejs/biome check packages/lifeops-bench/src, benchmark-lint) (push) Has been cancelled
Benchmark Bridge Tests / benchmark (bunx vitest run --config packages/lifeops-bench/vitest.config.ts --root packages/lifeops-bench --passWithNoTests, benchmark-tests) (push) Has been cancelled
Build Agent Image / build-and-push (push) Has been cancelled
Dev Smoke / bun run dev onboarding chat (push) Has been cancelled
Dev Smoke / Vite HMR dependency-level smoke (push) Has been cancelled
Electrobun Submodule Guard / electrobun gitlink is fetchable (push) Has been cancelled
Publish @elizaos/example-code / check_npm (push) Has been cancelled
Publish @elizaos/example-code / publish_npm (push) Has been cancelled
Publish @elizaos/plugin-elizacloud / verify_version (push) Has been cancelled
Publish @elizaos/plugin-elizacloud / publish_npm (push) Has been cancelled
Sandbox Live Smoke / Sandbox live smoke (push) Has been cancelled
Snap Build & Test / Build Snap (amd64) (push) Has been cancelled
Snap Build & Test / Build Snap (arm64) (push) Has been cancelled
Test Packaging / elizaos CLI global-install smoke (node + bun) (push) Has been cancelled
Cloud Gateway Webhook / Test (push) Has been cancelled
Cloud Tests / lint-and-types (push) Has been cancelled
Cloud Tests / unit-tests (push) Has been cancelled
Cloud Tests / integration-tests (push) Has been cancelled
Cloud Tests / e2e-tests (push) Has been cancelled
CodeQL Advanced / Analyze (javascript-typescript) (push) Has been cancelled
Deploy Apps Worker (Product 2) / Determine environment (push) Has been cancelled
Deploy Apps Worker (Product 2) / Deploy apps worker to apps-control host (${{ needs.determine-env.outputs.environment }}) (push) Has been cancelled
Deploy Eliza Provisioning Worker / Determine environment (push) Has been cancelled
Deploy Eliza Provisioning Worker / Deploy worker to Hetzner host (${{ needs.determine-env.outputs.environment }} @ ${{ needs.determine-env.outputs.deployment_sha }}) (push) Has been cancelled
Dev Smoke / Classify changed paths (push) Has been cancelled
supply-chain / sbom (push) Has been cancelled
supply-chain / vulnerability-scan (push) Has been cancelled
Build, Push & Deploy to Phala Cloud / build-and-push (push) Has been cancelled
Test Packaging / Validate Packaging Configs (push) Has been cancelled
Test Packaging / Build & Test PyPI Package (push) Has been cancelled
Test Packaging / PyPI on Python ${{ matrix.python }} (push) Has been cancelled
Test Packaging / Pack & Test JS Tarballs (push) Has been cancelled
UI Fixture E2E / ui-fixture-e2e (push) Has been cancelled
UI Fixture E2E / fixture-e2e (push) Has been cancelled
UI Story Gate / story-gate (push) Has been cancelled
vault-ci / test (macos-latest) (push) Has been cancelled
vault-ci / test (ubuntu-latest) (push) Has been cancelled
vault-ci / test (windows-latest) (push) Has been cancelled
vault-ci / app-core wiring tests (push) Has been cancelled
verify-patches / verify patches/CHECKSUMS.sha256 (push) Has been cancelled
Voice Benchmark Smoke / voice-emotion fixture smoke (push) Has been cancelled
Voice Benchmark Smoke / voiceagentbench fixture smoke (push) Has been cancelled
Voice Benchmark Smoke / voicebench-quality unit smoke (push) Has been cancelled
Voice Benchmark Smoke / voicebench TypeScript unit (no audio) (push) Has been cancelled
Voice Benchmark Smoke / voice bench smoke summary (push) Has been cancelled
Windows CI / windows ([bun run --cwd packages/app-core test bun run --cwd packages/elizaos test bun run --cwd packages/cloud/shared test], app-and-cli) (push) Has been cancelled
Windows CI / windows ([bun run --cwd packages/scenario-runner test bun run --cwd packages/vault test bun run --cwd packages/security test bun run --cwd plugins/plugin-coding-tools test], framework-packages) (push) Has been cancelled
Windows CI / windows ([bun run --cwd plugins/plugin-elizacloud test bun run --cwd plugins/plugin-discord test bun run --cwd plugins/plugin-anthropic test bun run --cwd plugins/plugin-openai test bun run --cwd plugins/plugin-app-control test bun run --cwd plugins/pl… (push) Has been cancelled
Windows CI / windows ([node packages/scripts/run-turbo.mjs run build --filter=@elizaos/core --filter=@elizaos/shared --filter=@elizaos/agent --concurrency=4 node packages/scripts/run-bash-linux-only.mjs scripts/verify-riscv64-buildpaths.sh node packages/scripts/run… (push) Has been cancelled
Windows CI / windows ([node packages/scripts/run-turbo.mjs run typecheck --filter=@elizaos/core --filter=@elizaos/shared --filter=@elizaos/cloud-shared --concurrency=4 bun run --cwd packages/core test bun run --cwd packages/shared test], core-runtime, 75) (push) Has been cancelled
147 lines
5.6 KiB
TypeScript
147 lines
5.6 KiB
TypeScript
/**
|
|
* spawn-ack.test.ts
|
|
*
|
|
* Unit coverage for the pure pieces of the LLM-generated "ack"-mode spawn
|
|
* acknowledgement (plugins/plugin-agent-orchestrator/src/index.ts). The single
|
|
* `useModel` call that produces the line is impure and covered through the
|
|
* progress-hook harness (progress-cadence.test.ts); the prompt construction and
|
|
* output sanitization are pure and tested directly here.
|
|
*
|
|
* The whole point of this surface is that there is NO hardcoded ack phrase, no
|
|
* i18n table, and no scraped personality: the model writes the line in the
|
|
* character's voice and the user's language. These tests pin the two seams that
|
|
* make that safe — the prompt carries the character + task, and the model's
|
|
* output is reduced to one clean line (with a literal fallback only when the
|
|
* model produces nothing usable).
|
|
*/
|
|
|
|
import type { Character } from "@elizaos/core";
|
|
import { describe, expect, it } from "vitest";
|
|
import {
|
|
buildSpawnAckSystemPrompt,
|
|
buildSpawnAckUserPrompt,
|
|
SPAWN_ACK_FALLBACK,
|
|
sanitizeSpawnAck,
|
|
} from "../../src/index.js";
|
|
|
|
describe("buildSpawnAckSystemPrompt", () => {
|
|
it("carries the character name, voice, and the one-line + same-language rules", () => {
|
|
const character: Character = {
|
|
name: "Avery",
|
|
bio: ["a terse, dry on-chain assistant"],
|
|
adjectives: ["dry", "precise"],
|
|
style: { chat: ["casual"], all: ["concise"] },
|
|
};
|
|
const prompt = buildSpawnAckSystemPrompt(character);
|
|
expect(prompt).toContain("You are Avery.");
|
|
expect(prompt).toContain("a terse, dry on-chain assistant");
|
|
// Voice traits are surfaced from the configured character, never hardcoded.
|
|
expect(prompt).toContain("dry");
|
|
expect(prompt).toContain("precise");
|
|
// Hard constraints that keep the output to one short in-language line.
|
|
expect(prompt.toLowerCase()).toContain("one");
|
|
expect(prompt.toLowerCase()).toContain("same language");
|
|
expect(prompt.toLowerCase()).toContain("no emoji");
|
|
});
|
|
|
|
it("degrades gracefully for an empty character (no name, no bio, no style)", () => {
|
|
const prompt = buildSpawnAckSystemPrompt({});
|
|
expect(prompt).toContain("You are the assistant.");
|
|
expect(prompt.toLowerCase()).toContain("same language");
|
|
// No dangling "Voice:" header when there are no traits to list.
|
|
expect(prompt).not.toContain("Voice:");
|
|
});
|
|
|
|
it("dedupes overlapping traits and bounds the voice descriptor list", () => {
|
|
const character: Character = {
|
|
name: "Bot",
|
|
adjectives: ["calm", "calm", "warm"],
|
|
style: { chat: ["warm", "friendly"], all: ["friendly"] },
|
|
};
|
|
const prompt = buildSpawnAckSystemPrompt(character);
|
|
// "warm"/"friendly" appear once each in the joined voice list despite the
|
|
// duplication across adjectives + style.chat + style.all.
|
|
const voiceLine = prompt.slice(prompt.indexOf("Voice:"));
|
|
expect(voiceLine.match(/warm/g)?.length).toBe(1);
|
|
expect(voiceLine.match(/friendly/g)?.length).toBe(1);
|
|
});
|
|
});
|
|
|
|
describe("buildSpawnAckUserPrompt", () => {
|
|
it("embeds the task verbatim as the language signal", () => {
|
|
const prompt = buildSpawnAckUserPrompt("déploie le site sur Cloudflare");
|
|
expect(prompt).toContain("déploie le site sur Cloudflare");
|
|
expect(prompt).toContain("acknowledgement");
|
|
});
|
|
|
|
it("supplies a neutral placeholder when the task is blank", () => {
|
|
const prompt = buildSpawnAckUserPrompt(" ");
|
|
expect(prompt).toContain("the task they just gave you");
|
|
});
|
|
|
|
it("clips an overlong task so the prompt stays bounded", () => {
|
|
const long = "x".repeat(1000);
|
|
const prompt = buildSpawnAckUserPrompt(long);
|
|
expect(prompt).toContain("…");
|
|
expect(prompt.length).toBeLessThan(500);
|
|
});
|
|
});
|
|
|
|
describe("sanitizeSpawnAck", () => {
|
|
it("returns a clean one-liner unchanged", () => {
|
|
expect(sanitizeSpawnAck("On it — starting now.")).toBe(
|
|
"On it — starting now.",
|
|
);
|
|
});
|
|
|
|
it("keeps only the first non-empty line", () => {
|
|
expect(sanitizeSpawnAck("\n\nOkay, getting into it.\nblah blah")).toBe(
|
|
"Okay, getting into it.",
|
|
);
|
|
});
|
|
|
|
it("strips a leading emoji and list/quote markers", () => {
|
|
expect(sanitizeSpawnAck("🚀 On it.")).toBe("On it.");
|
|
expect(sanitizeSpawnAck("- On it.")).toBe("On it.");
|
|
expect(sanitizeSpawnAck("> On it.")).toBe("On it.");
|
|
});
|
|
|
|
it("strips a single pair of surrounding quotes (straight, smart, backtick)", () => {
|
|
expect(sanitizeSpawnAck('"On it."')).toBe("On it.");
|
|
expect(sanitizeSpawnAck("'On it.'")).toBe("On it.");
|
|
expect(sanitizeSpawnAck("“On it.”")).toBe("On it.");
|
|
expect(sanitizeSpawnAck("`On it.`")).toBe("On it.");
|
|
});
|
|
|
|
it("collapses internal whitespace", () => {
|
|
expect(sanitizeSpawnAck("On it now.")).toBe("On it now.");
|
|
});
|
|
|
|
it("preserves non-English output untouched (no language assumptions)", () => {
|
|
expect(sanitizeSpawnAck("C'est parti, je m'y mets.")).toBe(
|
|
"C'est parti, je m'y mets.",
|
|
);
|
|
expect(sanitizeSpawnAck("了解、今すぐ取りかかります。")).toBe(
|
|
"了解、今すぐ取りかかります。",
|
|
);
|
|
});
|
|
|
|
it("clips an over-long line and marks the truncation", () => {
|
|
const out = sanitizeSpawnAck("word ".repeat(60));
|
|
expect(out.length).toBeLessThanOrEqual(120);
|
|
expect(out.endsWith("…")).toBe(true);
|
|
});
|
|
|
|
it("returns empty (caller falls back) for empty / whitespace-only input", () => {
|
|
expect(sanitizeSpawnAck("")).toBe("");
|
|
expect(sanitizeSpawnAck(" \n ")).toBe("");
|
|
});
|
|
});
|
|
|
|
describe("SPAWN_ACK_FALLBACK", () => {
|
|
it("is a short, neutral, non-empty literal", () => {
|
|
expect(SPAWN_ACK_FALLBACK.trim().length).toBeGreaterThan(0);
|
|
expect(SPAWN_ACK_FALLBACK.length).toBeLessThanOrEqual(24);
|
|
});
|
|
});
|