Files
wehub-resource-sync 426e9eeabd
Voice Workbench / headless workbench (mocked backends) (push) Has been cancelled
Voice Workbench / real acoustic lane (nightly, provisioned only) (push) Has been cancelled
ci / test (push) Has been cancelled
ci / lint-and-format (push) Has been cancelled
ci / build (push) Has been cancelled
ci / dev-startup (push) Has been cancelled
gitleaks / gitleaks (push) Has been cancelled
Markdown Links / Relative Markdown Links (push) Has been cancelled
Quality (Extended) / Homepage Build (PR smoke) (push) Has been cancelled
Quality (Extended) / Comment-only diff guard (push) Has been cancelled
Quality (Extended) / Format + Type Safety Ratchet (push) Has been cancelled
Quality (Extended) / Develop Gate (secret scan + UI determinism) (push) Has been cancelled
Quality (Extended) / Develop Gate (lint) (push) Has been cancelled
Chat shell gestures / Chat shell gesture + parity e2e (push) Has been cancelled
Cloud Gateway Discord / Test (push) Has been cancelled
Benchmark Bridge Tests / benchmark (bunx @biomejs/biome check packages/lifeops-bench/src, benchmark-lint) (push) Has been cancelled
Benchmark Bridge Tests / benchmark (bunx vitest run --config packages/lifeops-bench/vitest.config.ts --root packages/lifeops-bench --passWithNoTests, benchmark-tests) (push) Has been cancelled
Build Agent Image / build-and-push (push) Has been cancelled
Dev Smoke / bun run dev onboarding chat (push) Has been cancelled
Dev Smoke / Vite HMR dependency-level smoke (push) Has been cancelled
Electrobun Submodule Guard / electrobun gitlink is fetchable (push) Has been cancelled
Publish @elizaos/example-code / check_npm (push) Has been cancelled
Publish @elizaos/example-code / publish_npm (push) Has been cancelled
Publish @elizaos/plugin-elizacloud / verify_version (push) Has been cancelled
Publish @elizaos/plugin-elizacloud / publish_npm (push) Has been cancelled
Sandbox Live Smoke / Sandbox live smoke (push) Has been cancelled
Snap Build & Test / Build Snap (amd64) (push) Has been cancelled
Snap Build & Test / Build Snap (arm64) (push) Has been cancelled
Test Packaging / elizaos CLI global-install smoke (node + bun) (push) Has been cancelled
Cloud Gateway Webhook / Test (push) Has been cancelled
Cloud Tests / lint-and-types (push) Has been cancelled
Cloud Tests / unit-tests (push) Has been cancelled
Cloud Tests / integration-tests (push) Has been cancelled
Cloud Tests / e2e-tests (push) Has been cancelled
CodeQL Advanced / Analyze (javascript-typescript) (push) Has been cancelled
Deploy Apps Worker (Product 2) / Determine environment (push) Has been cancelled
Deploy Apps Worker (Product 2) / Deploy apps worker to apps-control host (${{ needs.determine-env.outputs.environment }}) (push) Has been cancelled
Deploy Eliza Provisioning Worker / Determine environment (push) Has been cancelled
Deploy Eliza Provisioning Worker / Deploy worker to Hetzner host (${{ needs.determine-env.outputs.environment }} @ ${{ needs.determine-env.outputs.deployment_sha }}) (push) Has been cancelled
Dev Smoke / Classify changed paths (push) Has been cancelled
supply-chain / sbom (push) Has been cancelled
supply-chain / vulnerability-scan (push) Has been cancelled
Build, Push & Deploy to Phala Cloud / build-and-push (push) Has been cancelled
Test Packaging / Validate Packaging Configs (push) Has been cancelled
Test Packaging / Build & Test PyPI Package (push) Has been cancelled
Test Packaging / PyPI on Python ${{ matrix.python }} (push) Has been cancelled
Test Packaging / Pack & Test JS Tarballs (push) Has been cancelled
UI Fixture E2E / ui-fixture-e2e (push) Has been cancelled
UI Fixture E2E / fixture-e2e (push) Has been cancelled
UI Story Gate / story-gate (push) Has been cancelled
vault-ci / test (macos-latest) (push) Has been cancelled
vault-ci / test (ubuntu-latest) (push) Has been cancelled
vault-ci / test (windows-latest) (push) Has been cancelled
vault-ci / app-core wiring tests (push) Has been cancelled
verify-patches / verify patches/CHECKSUMS.sha256 (push) Has been cancelled
Voice Benchmark Smoke / voice-emotion fixture smoke (push) Has been cancelled
Voice Benchmark Smoke / voiceagentbench fixture smoke (push) Has been cancelled
Voice Benchmark Smoke / voicebench-quality unit smoke (push) Has been cancelled
Voice Benchmark Smoke / voicebench TypeScript unit (no audio) (push) Has been cancelled
Voice Benchmark Smoke / voice bench smoke summary (push) Has been cancelled
Windows CI / windows ([bun run --cwd packages/app-core test bun run --cwd packages/elizaos test bun run --cwd packages/cloud/shared test], app-and-cli) (push) Has been cancelled
Windows CI / windows ([bun run --cwd packages/scenario-runner test bun run --cwd packages/vault test bun run --cwd packages/security test bun run --cwd plugins/plugin-coding-tools test], framework-packages) (push) Has been cancelled
Windows CI / windows ([bun run --cwd plugins/plugin-elizacloud test bun run --cwd plugins/plugin-discord test bun run --cwd plugins/plugin-anthropic test bun run --cwd plugins/plugin-openai test bun run --cwd plugins/plugin-app-control test bun run --cwd plugins/pl… (push) Has been cancelled
Windows CI / windows ([node packages/scripts/run-turbo.mjs run build --filter=@elizaos/core --filter=@elizaos/shared --filter=@elizaos/agent --concurrency=4 node packages/scripts/run-bash-linux-only.mjs scripts/verify-riscv64-buildpaths.sh node packages/scripts/run… (push) Has been cancelled
Windows CI / windows ([node packages/scripts/run-turbo.mjs run typecheck --filter=@elizaos/core --filter=@elizaos/shared --filter=@elizaos/cloud-shared --concurrency=4 bun run --cwd packages/core test bun run --cwd packages/shared test], core-runtime, 75) (push) Has been cancelled
chore: import upstream snapshot with attribution
2026-07-13 12:43:05 +08:00

403 lines
13 KiB
TypeScript

/**
* Turns inbound Farcaster mentions and replies into agent responses. Implements
* `IInteractionProcessor`: `processMention`/`processReply` map a Neynar cast to
* the domain `Cast`, resolve its embeds to media via `EmbedManager`, ensure the
* room/entity connection and a memory, walk the thread back to root, then hand the
* memory to `runtime.messageService` with a reply callback and emit
* `MENTION_RECEIVED`. `processWebhookData` is the webhook-mode entry that filters
* and dedupes cast.created events before dispatching. A one-at-a-time `AsyncQueue`
* serializes connection/memory creation. The `InteractionSource` (polling vs
* webhook) drives which path fires.
*/
import {
ChannelType,
createUniqueUuid,
type EventPayload,
type IAgentRuntime,
type Memory,
stringToUuid,
type UUID,
} from "@elizaos/core";
import type { Cast as NeynarCast } from "@neynar/nodejs-sdk/build/api";
import type { FarcasterClient } from "../client/FarcasterClient";
import {
type Cast,
FARCASTER_SOURCE,
type FarcasterConfig,
FarcasterEventTypes,
type FarcasterGenericCastPayload,
type NeynarWebhookData,
type Profile,
} from "../types";
import { castUuid, neynarCastToCast } from "../utils";
import { AsyncQueue } from "../utils/asyncqueue";
import { standardCastHandlerCallback } from "../utils/callbacks";
import { DEFAULT_FARCASTER_ACCOUNT_ID, normalizeFarcasterAccountId } from "../utils/config";
import { EmbedManager } from "./EmbedManager";
import type { IInteractionProcessor } from "./InteractionProcessor";
import {
createFarcasterInteractionSource,
type FarcasterInteractionSource,
} from "./InteractionSource";
interface FarcasterInteractionManagerParams {
client: FarcasterClient;
runtime: IAgentRuntime;
config: FarcasterConfig;
}
export class FarcasterInteractionManager implements IInteractionProcessor {
private client: FarcasterClient;
private runtime: IAgentRuntime;
private config: FarcasterConfig;
private asyncQueue: AsyncQueue;
private embedManager: EmbedManager;
public readonly mode: "polling" | "webhook";
public readonly source: FarcasterInteractionSource;
constructor(opts: FarcasterInteractionManagerParams) {
this.client = opts.client;
this.runtime = opts.runtime;
this.config = opts.config;
this.asyncQueue = new AsyncQueue(1);
this.embedManager = new EmbedManager(opts.runtime);
this.mode = opts.config.FARCASTER_MODE as "polling" | "webhook";
this.source = createFarcasterInteractionSource({
client: this.client,
runtime: this.runtime,
config: this.config,
processor: this,
});
this.runtime.logger.info(`Farcaster interaction mode: ${this.mode}`);
}
private getAccountId(): string {
return normalizeFarcasterAccountId(
(this.config as FarcasterConfig & { accountId?: string }).accountId ??
DEFAULT_FARCASTER_ACCOUNT_ID
);
}
async processMention(cast: NeynarCast): Promise<void> {
const agentFid = this.config.FARCASTER_FID;
const agent = await this.client.getProfile(agentFid);
const mention = neynarCastToCast(cast);
if (mention.embeds && mention.embeds.length > 0) {
try {
this.runtime.logger.debug(
{ castHash: cast.hash, embedCount: mention.embeds.length },
"[Farcaster] Processing embeds for mention"
);
const processedMedia = await this.embedManager.processEmbeds(mention.embeds);
mention.media = processedMedia;
this.runtime.logger.info(
{ castHash: cast.hash, mediaCount: processedMedia.length },
"[Farcaster] Processed embeds for mention"
);
} catch (error) {
this.runtime.logger.warn(
{
error: error instanceof Error ? error.message : String(error),
castHash: cast.hash,
},
"[Farcaster] Failed to process embeds, continuing without media"
);
}
}
await this.handleMentionCast({ agent, mention, cast });
}
async processReply(cast: NeynarCast): Promise<void> {
const agentFid = this.config.FARCASTER_FID;
const agent = await this.client.getProfile(agentFid);
const reply = neynarCastToCast(cast);
if (reply.embeds && reply.embeds.length > 0) {
try {
this.runtime.logger.debug(
{ castHash: cast.hash, embedCount: reply.embeds.length },
"[Farcaster] Processing embeds for reply"
);
const processedMedia = await this.embedManager.processEmbeds(reply.embeds);
reply.media = processedMedia;
this.runtime.logger.info(
{ castHash: cast.hash, mediaCount: processedMedia.length },
"[Farcaster] Processed embeds for reply"
);
} catch (error) {
this.runtime.logger.warn(
{
error: error instanceof Error ? error.message : String(error),
castHash: cast.hash,
},
"[Farcaster] Failed to process embeds, continuing without media"
);
}
}
await this.handleMentionCast({ agent, mention: reply, cast });
}
async processWebhookData(webhookData: NeynarWebhookData): Promise<void> {
if (webhookData.type !== "cast.created" || !webhookData.data) {
this.runtime.logger.debug("Ignoring non-cast webhook event:", webhookData.type);
return;
}
const castData = webhookData.data;
const agentFid = this.config.FARCASTER_FID;
if (!castData.author || !castData.hash || typeof castData.author.fid !== "number") {
this.runtime.logger.warn(
"Invalid webhook cast data structure - missing author, hash, or author.fid"
);
return;
}
if (castData.author.fid === agentFid) {
this.runtime.logger.debug("Skipping webhook event from agent itself");
return;
}
const memoryId = castUuid({
agentId: this.runtime.agentId,
hash: castData.hash,
});
if (await this.runtime.getMemoryById(memoryId)) {
this.runtime.logger.debug("Skipping already processed webhook cast:", castData.hash);
return;
}
const isMention = castData.mentioned_profiles?.some(
(profile: { fid: number }) => profile.fid === agentFid
);
const isReply = castData.parent_hash && castData.parent_author?.fid === agentFid;
if (isMention) {
const username = castData.author.username || "unknown";
const text = castData.text || "";
this.runtime.logger.info(`Processing webhook MENTION from @${username}: "${text}"`);
try {
const neynarCast = await this.client.getCast(castData.hash);
await this.processMention(neynarCast);
} catch (error) {
this.runtime.logger.error(
{ agentId: this.runtime.agentId, error },
`Failed to process webhook mention from @${username}`
);
}
} else if (isReply) {
const username = castData.author.username || "unknown";
const text = castData.text || "";
this.runtime.logger.info(`Processing webhook REPLY from @${username}: "${text}"`);
try {
const neynarCast = await this.client.getCast(castData.hash);
await this.processReply(neynarCast);
} catch (error) {
this.runtime.logger.error({ error }, `Failed to process webhook reply from @${username}:`);
}
} else {
this.runtime.logger.debug("Webhook cast is neither mention nor reply to agent");
}
}
async ensureCastConnection(cast: Cast): Promise<Memory> {
return await this.asyncQueue.submit(async () => {
const memoryId = castUuid({
agentId: this.runtime.agentId,
hash: cast.hash,
});
const conversationId = cast.threadId ?? cast.inReplyTo?.hash ?? cast.hash;
const entityId = createUniqueUuid(this.runtime, cast.authorFid.toString());
const worldId = createUniqueUuid(this.runtime, cast.authorFid.toString());
const roomId = createUniqueUuid(this.runtime, conversationId);
if (entityId !== this.runtime.agentId) {
await this.runtime.ensureConnection({
entityId,
roomId,
worldName: `${cast.profile.username}'s Farcaster`,
userName: cast.profile.username,
name: cast.profile.name,
source: FARCASTER_SOURCE,
type: ChannelType.THREAD,
channelId: conversationId,
messageServerId: stringToUuid(cast.authorFid.toString()),
worldId,
metadata: {
accountId: this.getAccountId(),
ownership: { ownerId: cast.authorFid.toString() },
farcaster: {
accountId: this.getAccountId(),
username: cast.profile.username,
id: cast.authorFid.toString(),
name: cast.profile.name,
},
},
});
}
let text = cast.text;
if (cast.media && cast.media.length > 0) {
const attachmentTypes = cast.media.map((m) => m.source || "attachment").join(", ");
text = `${cast.text}\n\n(Attachments: ${cast.media.length} - ${attachmentTypes})`;
}
const memory: Memory = {
id: memoryId,
agentId: this.runtime.agentId,
content: {
text,
inReplyTo: cast.inReplyTo?.hash
? castUuid({
agentId: this.runtime.agentId,
hash: cast.inReplyTo.hash,
})
: undefined,
source: FARCASTER_SOURCE,
accountId: this.getAccountId(),
channelType: ChannelType.THREAD,
attachments: cast.media && cast.media.length > 0 ? cast.media : undefined,
},
entityId,
roomId,
createdAt: cast.timestamp.getTime(),
metadata: {
accountId: this.getAccountId(),
},
};
return memory;
});
}
private async buildThreadForCast(cast: Cast, skipMemoryId: Set<UUID>): Promise<Cast[]> {
const thread: Cast[] = [];
const visited: Set<string> = new Set();
const client = this.client;
const runtime = this.runtime;
const self = this;
async function processThread(currentCast: Cast): Promise<void> {
const memoryId = castUuid({
hash: currentCast.hash,
agentId: runtime.agentId,
});
if (visited.has(currentCast.hash) || skipMemoryId.has(memoryId)) {
return;
}
visited.add(currentCast.hash);
const memory = await runtime.getMemoryById(memoryId);
if (!memory) {
runtime.logger.info({ hash: currentCast.hash }, "Creating memory for cast");
const newMemory = await self.ensureCastConnection(currentCast);
await runtime.createMemory(newMemory, "messages");
runtime.emitEvent(
FarcasterEventTypes.THREAD_CAST_CREATED as string,
{
runtime,
memory: newMemory,
cast: currentCast,
source: FARCASTER_SOURCE,
accountId: self.getAccountId(),
} as EventPayload
);
}
thread.unshift(currentCast);
if (currentCast.inReplyTo) {
const parentCast = await client.getCast(currentCast.inReplyTo.hash);
await processThread(neynarCastToCast(parentCast));
}
}
await processThread(cast);
return thread;
}
private async handleMentionCast({
agent,
mention,
cast,
}: {
agent: Profile;
cast: NeynarCast;
mention: Cast;
}): Promise<void> {
if (mention.profile.fid === agent.fid) {
this.runtime.logger.info({ hash: mention.hash }, "skipping cast from bot itself");
return;
}
const memory = await this.ensureCastConnection(mention);
await this.buildThreadForCast(mention, memory.id ? new Set([memory.id]) : new Set());
if (!memory.content.text || memory.content.text.trim() === "") {
this.runtime.logger.info({ hash: mention.hash }, "skipping cast with no text");
return;
}
const callback = standardCastHandlerCallback({
client: this.client,
runtime: this.runtime,
config: this.config,
roomId: memory.roomId,
inReplyTo: {
hash: mention.hash,
fid: mention.authorFid,
},
});
try {
if (!this.runtime.messageService) {
this.runtime.logger.warn(
"[Farcaster] messageService not available, skipping mention handling"
);
return;
}
await this.runtime.messageService.handleMessage(this.runtime, memory, callback);
} catch (error) {
this.runtime.logger.error(
{
error: error instanceof Error ? error.message : String(error),
castHash: mention.hash,
},
"[Farcaster] Error processing mention"
);
}
const mentionPayload: FarcasterGenericCastPayload = {
runtime: this.runtime,
memory,
cast,
source: FARCASTER_SOURCE,
accountId: this.getAccountId(),
callback,
};
this.runtime.emitEvent(FarcasterEventTypes.MENTION_RECEIVED, mentionPayload);
}
async start(): Promise<void> {
this.runtime.logger.info(`Starting Farcaster interaction manager in ${this.mode} mode`);
await this.source.start();
}
async stop(): Promise<void> {
this.runtime.logger.info("Stopping Farcaster interaction manager");
await this.source.stop();
}
}