426e9eeabd
Voice Workbench / headless workbench (mocked backends) (push) Has been cancelled
Voice Workbench / real acoustic lane (nightly, provisioned only) (push) Has been cancelled
ci / test (push) Has been cancelled
ci / lint-and-format (push) Has been cancelled
ci / build (push) Has been cancelled
ci / dev-startup (push) Has been cancelled
gitleaks / gitleaks (push) Has been cancelled
Markdown Links / Relative Markdown Links (push) Has been cancelled
Quality (Extended) / Homepage Build (PR smoke) (push) Has been cancelled
Quality (Extended) / Comment-only diff guard (push) Has been cancelled
Quality (Extended) / Format + Type Safety Ratchet (push) Has been cancelled
Quality (Extended) / Develop Gate (secret scan + UI determinism) (push) Has been cancelled
Quality (Extended) / Develop Gate (lint) (push) Has been cancelled
Chat shell gestures / Chat shell gesture + parity e2e (push) Has been cancelled
Cloud Gateway Discord / Test (push) Has been cancelled
Benchmark Bridge Tests / benchmark (bunx @biomejs/biome check packages/lifeops-bench/src, benchmark-lint) (push) Has been cancelled
Benchmark Bridge Tests / benchmark (bunx vitest run --config packages/lifeops-bench/vitest.config.ts --root packages/lifeops-bench --passWithNoTests, benchmark-tests) (push) Has been cancelled
Build Agent Image / build-and-push (push) Has been cancelled
Dev Smoke / bun run dev onboarding chat (push) Has been cancelled
Dev Smoke / Vite HMR dependency-level smoke (push) Has been cancelled
Electrobun Submodule Guard / electrobun gitlink is fetchable (push) Has been cancelled
Publish @elizaos/example-code / check_npm (push) Has been cancelled
Publish @elizaos/example-code / publish_npm (push) Has been cancelled
Publish @elizaos/plugin-elizacloud / verify_version (push) Has been cancelled
Publish @elizaos/plugin-elizacloud / publish_npm (push) Has been cancelled
Sandbox Live Smoke / Sandbox live smoke (push) Has been cancelled
Snap Build & Test / Build Snap (amd64) (push) Has been cancelled
Snap Build & Test / Build Snap (arm64) (push) Has been cancelled
Test Packaging / elizaos CLI global-install smoke (node + bun) (push) Has been cancelled
Cloud Gateway Webhook / Test (push) Has been cancelled
Cloud Tests / lint-and-types (push) Has been cancelled
Cloud Tests / unit-tests (push) Has been cancelled
Cloud Tests / integration-tests (push) Has been cancelled
Cloud Tests / e2e-tests (push) Has been cancelled
CodeQL Advanced / Analyze (javascript-typescript) (push) Has been cancelled
Deploy Apps Worker (Product 2) / Determine environment (push) Has been cancelled
Deploy Apps Worker (Product 2) / Deploy apps worker to apps-control host (${{ needs.determine-env.outputs.environment }}) (push) Has been cancelled
Deploy Eliza Provisioning Worker / Determine environment (push) Has been cancelled
Deploy Eliza Provisioning Worker / Deploy worker to Hetzner host (${{ needs.determine-env.outputs.environment }} @ ${{ needs.determine-env.outputs.deployment_sha }}) (push) Has been cancelled
Dev Smoke / Classify changed paths (push) Has been cancelled
supply-chain / sbom (push) Has been cancelled
supply-chain / vulnerability-scan (push) Has been cancelled
Build, Push & Deploy to Phala Cloud / build-and-push (push) Has been cancelled
Test Packaging / Validate Packaging Configs (push) Has been cancelled
Test Packaging / Build & Test PyPI Package (push) Has been cancelled
Test Packaging / PyPI on Python ${{ matrix.python }} (push) Has been cancelled
Test Packaging / Pack & Test JS Tarballs (push) Has been cancelled
UI Fixture E2E / ui-fixture-e2e (push) Has been cancelled
UI Fixture E2E / fixture-e2e (push) Has been cancelled
UI Story Gate / story-gate (push) Has been cancelled
vault-ci / test (macos-latest) (push) Has been cancelled
vault-ci / test (ubuntu-latest) (push) Has been cancelled
vault-ci / test (windows-latest) (push) Has been cancelled
vault-ci / app-core wiring tests (push) Has been cancelled
verify-patches / verify patches/CHECKSUMS.sha256 (push) Has been cancelled
Voice Benchmark Smoke / voice-emotion fixture smoke (push) Has been cancelled
Voice Benchmark Smoke / voiceagentbench fixture smoke (push) Has been cancelled
Voice Benchmark Smoke / voicebench-quality unit smoke (push) Has been cancelled
Voice Benchmark Smoke / voicebench TypeScript unit (no audio) (push) Has been cancelled
Voice Benchmark Smoke / voice bench smoke summary (push) Has been cancelled
Windows CI / windows ([bun run --cwd packages/app-core test bun run --cwd packages/elizaos test bun run --cwd packages/cloud/shared test], app-and-cli) (push) Has been cancelled
Windows CI / windows ([bun run --cwd packages/scenario-runner test bun run --cwd packages/vault test bun run --cwd packages/security test bun run --cwd plugins/plugin-coding-tools test], framework-packages) (push) Has been cancelled
Windows CI / windows ([bun run --cwd plugins/plugin-elizacloud test bun run --cwd plugins/plugin-discord test bun run --cwd plugins/plugin-anthropic test bun run --cwd plugins/plugin-openai test bun run --cwd plugins/plugin-app-control test bun run --cwd plugins/pl… (push) Has been cancelled
Windows CI / windows ([node packages/scripts/run-turbo.mjs run build --filter=@elizaos/core --filter=@elizaos/shared --filter=@elizaos/agent --concurrency=4 node packages/scripts/run-bash-linux-only.mjs scripts/verify-riscv64-buildpaths.sh node packages/scripts/run… (push) Has been cancelled
Windows CI / windows ([node packages/scripts/run-turbo.mjs run typecheck --filter=@elizaos/core --filter=@elizaos/shared --filter=@elizaos/cloud-shared --concurrency=4 bun run --cwd packages/core test bun run --cwd packages/shared test], core-runtime, 75) (push) Has been cancelled
192 lines
7.1 KiB
TypeScript
192 lines
7.1 KiB
TypeScript
/**
|
|
* Tests for implicit referent resolution.
|
|
*
|
|
* Candidate stores are represented by seeded facts, threads, calendar records,
|
|
* and episodic anchors so the ranking contract is deterministic. Each case names
|
|
* exactly what it proves: lexical/signal ranking, semantic-prior resolution with
|
|
* a negative control, episodic anchoring, and one-question disambiguation.
|
|
*/
|
|
|
|
import { describe, expect, it } from "vitest";
|
|
import { resolveImplicitReferent } from "../src/lifeops/implicit-referents/index.js";
|
|
|
|
const nowIso = "2026-07-06T16:00:00.000Z";
|
|
|
|
describe("implicit referent resolver", () => {
|
|
it("resolves 'you know why' from recent context and confirms the interpretation", () => {
|
|
const result = resolveImplicitReferent({
|
|
ask: "Clear my afternoon. You know why.",
|
|
nowIso,
|
|
candidates: [
|
|
{
|
|
id: "calendar:board-prep",
|
|
source: "recent_thread",
|
|
label: "board prep afternoon block",
|
|
summary:
|
|
"Owner needs 1-5pm clear today for board prep; move the 1:1 and dentist.",
|
|
confirmation:
|
|
"clearing 1-5pm ahead of board prep, moving the 1:1 and dentist",
|
|
tags: ["reason", "afternoon", "board", "prep"],
|
|
occurredAt: "2026-07-06T13:00:00.000Z",
|
|
prior: 0.78,
|
|
executorHint: "calendar.bulk_reschedule.preview",
|
|
},
|
|
{
|
|
id: "calendar:dentist",
|
|
source: "calendar_event",
|
|
label: "dentist appointment",
|
|
summary: "Dentist appointment at 3pm.",
|
|
confirmation: "protecting the dentist appointment",
|
|
tags: ["afternoon"],
|
|
occurredAt: "2026-07-01T16:00:00.000Z",
|
|
prior: 0.2,
|
|
},
|
|
],
|
|
});
|
|
|
|
expect(result.decision).toBe("resolved");
|
|
if (result.decision !== "resolved") throw new Error("expected resolved");
|
|
expect(result.selected.candidate.id).toBe("calendar:board-prep");
|
|
expect(result.confirmationText).toContain(
|
|
"clearing 1-5pm ahead of board prep",
|
|
);
|
|
expect(result.confirmationText).toContain('Resolving "Clear my afternoon');
|
|
});
|
|
|
|
it("resolves 'the usual' by semantic prior when neither candidate shares a lexical token with the ask", () => {
|
|
// "Book the usual." carries no non-stop-word tokens, so lexicalScore is 0 for
|
|
// every candidate. Both candidates are owner facts tagged "usual", so the
|
|
// source-signal boost is identical too. The only signal that separates them
|
|
// is `prior` (the semantic-relevance score a retrieval layer supplies). This
|
|
// is the case the resolver exists for: pick the right referent with no shared
|
|
// words. The negative control below confirms `prior` is load-bearing here.
|
|
const candidates = [
|
|
{
|
|
id: "fact:osteria",
|
|
source: "owner_fact" as const,
|
|
label: "Osteria corner table",
|
|
summary: "corner table at Osteria for dinner",
|
|
confirmation: "booking the Osteria corner table",
|
|
tags: ["usual", "restaurant", "dinner"],
|
|
occurredAt: "2026-07-04T20:00:00.000Z",
|
|
executorHint: "calendar.create_event.preview",
|
|
},
|
|
{
|
|
id: "fact:coffee",
|
|
source: "owner_fact" as const,
|
|
label: "Blue Bottle morning order",
|
|
summary: "oat cappuccino each morning",
|
|
confirmation: "ordering the morning coffee",
|
|
tags: ["usual", "coffee", "morning"],
|
|
occurredAt: "2026-07-04T16:00:00.000Z",
|
|
},
|
|
];
|
|
|
|
const result = resolveImplicitReferent({
|
|
ask: "Book the usual.",
|
|
nowIso,
|
|
candidates: candidates.map((candidate) =>
|
|
candidate.id === "fact:osteria"
|
|
? { ...candidate, prior: 0.95 }
|
|
: { ...candidate, prior: 0.1 },
|
|
),
|
|
});
|
|
|
|
expect(result.decision).toBe("resolved");
|
|
if (result.decision !== "resolved") throw new Error("expected resolved");
|
|
expect(result.selected.candidate.id).toBe("fact:osteria");
|
|
// No lexical match fired — the resolution is driven by prior, not overlap.
|
|
expect(result.selected.evidence).not.toContain('matched "usual"');
|
|
expect(result.selected.evidence.some((e) => e.startsWith("matched "))).toBe(
|
|
false,
|
|
);
|
|
expect(result.selected.evidence).toContain("prior=0.95");
|
|
expect(result.confirmationText).toContain(
|
|
"booking the Osteria corner table",
|
|
);
|
|
|
|
// Negative control: strip the semantic prior and the identical facts become
|
|
// indistinguishable — the resolver must ask rather than guess. This proves
|
|
// the prior is what carried the resolution above.
|
|
const withoutPrior = resolveImplicitReferent({
|
|
ask: "Book the usual.",
|
|
nowIso,
|
|
candidates,
|
|
});
|
|
expect(withoutPrior.decision).toBe("ask");
|
|
});
|
|
|
|
it("resolves same-as-last-time asks against episodic anchors", () => {
|
|
const result = resolveImplicitReferent({
|
|
ask: "Use the same reason as last time.",
|
|
nowIso,
|
|
candidates: [
|
|
{
|
|
id: "episode:travel-delay",
|
|
source: "episodic_anchor",
|
|
label: "last vendor delay explanation",
|
|
summary:
|
|
"Last time the owner moved a vendor call, the stated reason was board packet prep.",
|
|
confirmation: "using the prior board packet prep reason",
|
|
tags: ["episodic", "reason"],
|
|
occurredAt: "2026-07-03T18:00:00.000Z",
|
|
prior: 0.7,
|
|
},
|
|
{
|
|
id: "fact:restaurant",
|
|
source: "owner_fact",
|
|
label: "usual restaurant",
|
|
summary: "Usual restaurant preference.",
|
|
confirmation: "using the usual restaurant preference",
|
|
tags: ["usual"],
|
|
prior: 0.2,
|
|
},
|
|
],
|
|
});
|
|
|
|
expect(result.decision).toBe("resolved");
|
|
if (result.decision !== "resolved") throw new Error("expected resolved");
|
|
expect(result.selected.candidate.id).toBe("episode:travel-delay");
|
|
expect(result.confirmationText).toContain(
|
|
"using the prior board packet prep reason",
|
|
);
|
|
});
|
|
|
|
it("asks one disambiguating question when two plausible referents are too close", () => {
|
|
const result = resolveImplicitReferent({
|
|
ask: "Clear it for Thursday.",
|
|
nowIso,
|
|
ambiguityMargin: 0.2,
|
|
candidates: [
|
|
{
|
|
id: "calendar:board",
|
|
source: "calendar_event",
|
|
label: "Thursday board prep",
|
|
summary: "Board prep block on Thursday afternoon.",
|
|
confirmation: "clearing Thursday for board prep",
|
|
tags: ["weekday", "thursday", "afternoon"],
|
|
occurredAt: "2026-07-05T16:00:00.000Z",
|
|
prior: 0.55,
|
|
},
|
|
{
|
|
id: "calendar:investor",
|
|
source: "calendar_event",
|
|
label: "Thursday investor prep",
|
|
summary: "Investor prep block on Thursday afternoon.",
|
|
confirmation: "clearing Thursday for investor prep",
|
|
tags: ["weekday", "thursday", "afternoon"],
|
|
occurredAt: "2026-07-05T15:00:00.000Z",
|
|
prior: 0.54,
|
|
},
|
|
],
|
|
});
|
|
|
|
expect(result.decision).toBe("ask");
|
|
if (result.decision !== "ask") throw new Error("expected ask");
|
|
expect(result.question).toBe(
|
|
"Do you mean Thursday board prep or Thursday investor prep?",
|
|
);
|
|
expect(result.selected).toBeNull();
|
|
});
|
|
});
|