426e9eeabd
Voice Workbench / headless workbench (mocked backends) (push) Has been cancelled
Voice Workbench / real acoustic lane (nightly, provisioned only) (push) Has been cancelled
ci / test (push) Has been cancelled
ci / lint-and-format (push) Has been cancelled
ci / build (push) Has been cancelled
ci / dev-startup (push) Has been cancelled
gitleaks / gitleaks (push) Has been cancelled
Markdown Links / Relative Markdown Links (push) Has been cancelled
Quality (Extended) / Homepage Build (PR smoke) (push) Has been cancelled
Quality (Extended) / Comment-only diff guard (push) Has been cancelled
Quality (Extended) / Format + Type Safety Ratchet (push) Has been cancelled
Quality (Extended) / Develop Gate (secret scan + UI determinism) (push) Has been cancelled
Quality (Extended) / Develop Gate (lint) (push) Has been cancelled
Chat shell gestures / Chat shell gesture + parity e2e (push) Has been cancelled
Cloud Gateway Discord / Test (push) Has been cancelled
Benchmark Bridge Tests / benchmark (bunx @biomejs/biome check packages/lifeops-bench/src, benchmark-lint) (push) Has been cancelled
Benchmark Bridge Tests / benchmark (bunx vitest run --config packages/lifeops-bench/vitest.config.ts --root packages/lifeops-bench --passWithNoTests, benchmark-tests) (push) Has been cancelled
Build Agent Image / build-and-push (push) Has been cancelled
Dev Smoke / bun run dev onboarding chat (push) Has been cancelled
Dev Smoke / Vite HMR dependency-level smoke (push) Has been cancelled
Electrobun Submodule Guard / electrobun gitlink is fetchable (push) Has been cancelled
Publish @elizaos/example-code / check_npm (push) Has been cancelled
Publish @elizaos/example-code / publish_npm (push) Has been cancelled
Publish @elizaos/plugin-elizacloud / verify_version (push) Has been cancelled
Publish @elizaos/plugin-elizacloud / publish_npm (push) Has been cancelled
Sandbox Live Smoke / Sandbox live smoke (push) Has been cancelled
Snap Build & Test / Build Snap (amd64) (push) Has been cancelled
Snap Build & Test / Build Snap (arm64) (push) Has been cancelled
Test Packaging / elizaos CLI global-install smoke (node + bun) (push) Has been cancelled
Cloud Gateway Webhook / Test (push) Has been cancelled
Cloud Tests / lint-and-types (push) Has been cancelled
Cloud Tests / unit-tests (push) Has been cancelled
Cloud Tests / integration-tests (push) Has been cancelled
Cloud Tests / e2e-tests (push) Has been cancelled
CodeQL Advanced / Analyze (javascript-typescript) (push) Has been cancelled
Deploy Apps Worker (Product 2) / Determine environment (push) Has been cancelled
Deploy Apps Worker (Product 2) / Deploy apps worker to apps-control host (${{ needs.determine-env.outputs.environment }}) (push) Has been cancelled
Deploy Eliza Provisioning Worker / Determine environment (push) Has been cancelled
Deploy Eliza Provisioning Worker / Deploy worker to Hetzner host (${{ needs.determine-env.outputs.environment }} @ ${{ needs.determine-env.outputs.deployment_sha }}) (push) Has been cancelled
Dev Smoke / Classify changed paths (push) Has been cancelled
supply-chain / sbom (push) Has been cancelled
supply-chain / vulnerability-scan (push) Has been cancelled
Build, Push & Deploy to Phala Cloud / build-and-push (push) Has been cancelled
Test Packaging / Validate Packaging Configs (push) Has been cancelled
Test Packaging / Build & Test PyPI Package (push) Has been cancelled
Test Packaging / PyPI on Python ${{ matrix.python }} (push) Has been cancelled
Test Packaging / Pack & Test JS Tarballs (push) Has been cancelled
UI Fixture E2E / ui-fixture-e2e (push) Has been cancelled
UI Fixture E2E / fixture-e2e (push) Has been cancelled
UI Story Gate / story-gate (push) Has been cancelled
vault-ci / test (macos-latest) (push) Has been cancelled
vault-ci / test (ubuntu-latest) (push) Has been cancelled
vault-ci / test (windows-latest) (push) Has been cancelled
vault-ci / app-core wiring tests (push) Has been cancelled
verify-patches / verify patches/CHECKSUMS.sha256 (push) Has been cancelled
Voice Benchmark Smoke / voice-emotion fixture smoke (push) Has been cancelled
Voice Benchmark Smoke / voiceagentbench fixture smoke (push) Has been cancelled
Voice Benchmark Smoke / voicebench-quality unit smoke (push) Has been cancelled
Voice Benchmark Smoke / voicebench TypeScript unit (no audio) (push) Has been cancelled
Voice Benchmark Smoke / voice bench smoke summary (push) Has been cancelled
Windows CI / windows ([bun run --cwd packages/app-core test bun run --cwd packages/elizaos test bun run --cwd packages/cloud/shared test], app-and-cli) (push) Has been cancelled
Windows CI / windows ([bun run --cwd packages/scenario-runner test bun run --cwd packages/vault test bun run --cwd packages/security test bun run --cwd plugins/plugin-coding-tools test], framework-packages) (push) Has been cancelled
Windows CI / windows ([bun run --cwd plugins/plugin-elizacloud test bun run --cwd plugins/plugin-discord test bun run --cwd plugins/plugin-anthropic test bun run --cwd plugins/plugin-openai test bun run --cwd plugins/plugin-app-control test bun run --cwd plugins/pl… (push) Has been cancelled
Windows CI / windows ([node packages/scripts/run-turbo.mjs run build --filter=@elizaos/core --filter=@elizaos/shared --filter=@elizaos/agent --concurrency=4 node packages/scripts/run-bash-linux-only.mjs scripts/verify-riscv64-buildpaths.sh node packages/scripts/run… (push) Has been cancelled
Windows CI / windows ([node packages/scripts/run-turbo.mjs run typecheck --filter=@elizaos/core --filter=@elizaos/shared --filter=@elizaos/cloud-shared --concurrency=4 bun run --cwd packages/core test bun run --cwd packages/shared test], core-runtime, 75) (push) Has been cancelled
189 lines
12 KiB
Markdown
189 lines
12 KiB
Markdown
# @elizaos/plugin-imessage
|
|
|
|
iMessage connector for Eliza agents on macOS — inbound polling via chat.db and outbound sending via AppleScript or a CLI tool.
|
|
|
|
## Purpose / role
|
|
|
|
Adds iMessage send/receive capability to an Eliza agent running on macOS. The plugin registers `IMessageService`, which polls `~/Library/Messages/chat.db` for inbound messages and delivers outbound messages through `osascript` (Messages.app) or an optional iMessage CLI tool. It also registers the service as a `MessageConnector` so the standard `MESSAGE` operation routes through it. Auto-enabled when `config.connectors.imessage` is present and not explicitly disabled; opt-in otherwise.
|
|
|
|
## Plugin surface
|
|
|
|
**Services**
|
|
- `IMessageService` (`src/service.ts`) — core service; polls chat.db, dispatches inbound messages through `runtime.messageService.handleMessage`, sends via AppleScript or CLI, registers the `MessageConnector` with `resolveTargets`, `listRecentTargets`, `listRooms`, `fetchMessages`, `searchMessages`, `getChatContext`, `getUserContext`. Static `serviceType = "imessage"`.
|
|
|
|
**Actions** — none registered. Sending goes through the `MessageConnector` path (`MESSAGE` / `operation=send`).
|
|
|
|
**Providers** — none registered as standalone elizaOS providers. Contact and chat context is surfaced through the `MessageConnector` hooks above.
|
|
|
|
**Routes** (all `rawPath: true`, no plugin-name prefix):
|
|
|
|
*Setup routes* (`src/setup-routes.ts`):
|
|
- `GET /api/setup/imessage/status` — service health, chat.db availability, permission action
|
|
- `POST /api/setup/imessage/start` — mark imessage connector enabled in config
|
|
- `POST /api/setup/imessage/cancel` — remove imessage connector block from config
|
|
|
|
*Data routes* (`src/data-routes.ts`):
|
|
- `GET /api/imessage/messages` — recent messages (`?chatId=&limit=`)
|
|
- `POST /api/imessage/messages` — send a message (`{ to|chatId, text, mediaUrl? }`)
|
|
- `GET /api/imessage/chats` — list chats (DMs + groups) from chat.db
|
|
- `GET /api/imessage/contacts` — list Apple Contacts (full detail)
|
|
- `POST /api/imessage/contacts` — create a contact (CNContactStore)
|
|
- `PATCH /api/imessage/contacts/:id` — update a contact
|
|
- `DELETE /api/imessage/contacts/:id` — delete a contact
|
|
|
|
*Legacy HTTP handler exports* (`src/api/imessage-routes.ts`, `src/api/bluebubbles-routes.ts`):
|
|
- `handleIMessageRoute` / `handleBlueBubblesRoute` — raw `http.IncomingMessage` handlers for the agent's legacy HTTP router; not re-registered as `Route[]`.
|
|
|
|
**Events emitted** (`src/types.ts` — `IMessageEventTypes`):
|
|
- `IMESSAGE_CONNECTION_READY`, `IMESSAGE_MESSAGE_RECEIVED`, `IMESSAGE_MESSAGE_SENT`, `IMESSAGE_REACTION_RECEIVED`, `IMESSAGE_SYSTEM_EVENT`, `IMESSAGE_ERROR`
|
|
- Also emits core `EventType.MESSAGE_RECEIVED`, `MESSAGE_SENT`, `WORLD_JOINED`, `ENTITY_JOINED`.
|
|
|
|
## Layout
|
|
|
|
```
|
|
plugins/plugin-imessage/
|
|
src/
|
|
index.ts Plugin object; re-exports all public APIs
|
|
service.ts IMessageService — polling, send, MessageConnector registration
|
|
types.ts Interfaces, error classes, constants, utility fns
|
|
config.ts IMessageConfig / IMessageAccountConfig types
|
|
accounts.ts Multi-account helpers; DEFAULT_ACCOUNT_ID = "default"
|
|
chatdb-reader.ts chat.db SQLite reader (bun:sqlite / node:sqlite)
|
|
contacts-reader.ts Apple Contacts reader via CNContactStore
|
|
rpc.ts IMessageRpcClient — optional RPC bridge
|
|
connector-account-provider.ts ConnectorAccountProvider adapter
|
|
setup-routes.ts /api/setup/imessage/* route handlers
|
|
data-routes.ts /api/imessage/* CRUD route handlers
|
|
node-sqlite.d.ts Type shim for node:sqlite (gitignored)
|
|
providers/
|
|
index.ts (reserved)
|
|
api/
|
|
imessage-routes.ts Legacy raw HTTP handler (exported, not re-registered)
|
|
bluebubbles-routes.ts BlueBubbles webhook handler (exported, not re-registered)
|
|
auto-enable.ts elizaos.plugin.autoEnableModule entry point
|
|
package.json
|
|
build.ts
|
|
vitest.config.ts
|
|
```
|
|
|
|
## Commands
|
|
|
|
All scripts defined in `package.json`:
|
|
|
|
```bash
|
|
bun run --cwd plugins/plugin-imessage build # compile to dist/
|
|
bun run --cwd plugins/plugin-imessage test # vitest run
|
|
bun run --cwd plugins/plugin-imessage test:watch # vitest watch
|
|
bun run --cwd plugins/plugin-imessage lint # biome check --write --unsafe
|
|
bun run --cwd plugins/plugin-imessage lint:check # biome check (no write)
|
|
bun run --cwd plugins/plugin-imessage format # biome format --write
|
|
bun run --cwd plugins/plugin-imessage format:check # biome format (no write)
|
|
bun run --cwd plugins/plugin-imessage typecheck # tsgo --noEmit
|
|
```
|
|
|
|
## Config / env vars
|
|
|
|
All read via `runtime.getSetting(key)` with `process.env[key]` fallback. None required; the service degrades gracefully when absent.
|
|
|
|
| Env var | Default | Description |
|
|
|---|---|---|
|
|
| `IMESSAGE_CLI_PATH` | `"imsg"` | Path to an iMessage CLI binary; fallback to AppleScript when absent or path not found |
|
|
| `IMESSAGE_DB_PATH` | `~/Library/Messages/chat.db` | Override chat.db path |
|
|
| `IMESSAGE_POLL_INTERVAL_MS` | `5000` | How often (ms) to poll chat.db for new rows; `0` disables polling |
|
|
| `IMESSAGE_HEARTBEAT_INTERVAL_MS` | `60000` | How often (ms) to run the heartbeat health check against chat.db |
|
|
| `IMESSAGE_DM_POLICY` | `"pairing"` | `open` / `pairing` / `allowlist` / `disabled` |
|
|
| `IMESSAGE_GROUP_POLICY` | `"allowlist"` | `open` / `allowlist` / `disabled` |
|
|
| `IMESSAGE_ALLOW_FROM` | `""` | Comma-separated E.164 phones or iCloud emails for allowlist |
|
|
| `IMESSAGE_ENABLED` | `"true"` | Set to `"false"` to disable |
|
|
| `IMESSAGE_BACKFILL` | `0` | Number of rows before the current DB tip to replay on startup |
|
|
| `ELIZA_NATIVE_PERMISSIONS_DYLIB` | `""` | Path to the native permissions dylib used for CNContactStore access |
|
|
|
|
Config block in character settings:
|
|
|
|
```json
|
|
{
|
|
"connectors": {
|
|
"imessage": {
|
|
"enabled": true,
|
|
"dmPolicy": "pairing",
|
|
"groupPolicy": "allowlist",
|
|
"pollIntervalMs": 5000
|
|
}
|
|
}
|
|
}
|
|
```
|
|
|
|
## How to extend
|
|
|
|
**Add a new action:**
|
|
1. Create `src/actions/my-action.ts` exporting an `Action` object (see `@elizaos/core` `Action` interface).
|
|
2. Import and push it into the `actions` array in `src/index.ts`.
|
|
3. No service changes needed unless the action must call `IMessageService` directly (import `IMessageService` and call `runtime.getService(IMessageService.serviceType)`).
|
|
|
|
**Add a new provider:**
|
|
1. Create `src/providers/my-provider.ts` exporting a `Provider` object.
|
|
2. Import and push it into the `providers` array in `src/index.ts`.
|
|
|
|
**Add a new route:**
|
|
1. Write the handler in `src/data-routes.ts` or a new file.
|
|
2. Add a `Route` entry to the exported array and import it into `src/index.ts`'s `routes` spread.
|
|
3. Use `rawPath: true` to mount at the canonical path without a plugin prefix.
|
|
|
|
**Extend IMessageService:**
|
|
- Add public methods to `IMessageService` in `src/service.ts` and declare them on `IIMessageService` in `src/types.ts`.
|
|
- The connector registration object inside `IMessageService.registerSendHandlers` is the right place to extend `MessageConnector` hooks (e.g., adding a new `AdditiveMessageConnectorHooks` key).
|
|
|
|
## Conventions / gotchas
|
|
|
|
- **macOS only.** `IMessageService.start()` throws `IMessageNotSupportedError` on non-darwin platforms. The plugin still loads on other platforms but the service never starts; all route handlers return 503.
|
|
- **chat.db requires Full Disk Access.** Without it, `openChatDb` returns `null` and the service runs send-only. Guide the user to `System Settings > Privacy & Security > Full Disk Access`. The `createFullDiskAccessAction()` helper in `chatdb-reader.ts` builds the structured action object the UI needs.
|
|
- **Contacts permission is lazy.** `loadContacts()` is NOT called at service start — it fires on the first inbound message that needs handle→name resolution. This avoids a macOS TCC dialog at app launch.
|
|
- **Bun:sqlite / node:sqlite dual runtime.** `chatdb-reader.ts` tries `bun:sqlite` first, then `node:sqlite`. Neither runtime ships both. If chat.db can't be opened, the service degrades silently (logs a warning, returns send-only status).
|
|
- **Single macOS account model.** `DEFAULT_ACCOUNT_ID = "default"`. `assertLocalIMessageAccount` throws if a caller passes any other accountId. `accounts.ts` exposes connector-account inventory and config merging for the local Messages account; run separate agent processes for separate macOS user sessions.
|
|
- **Polling reentrancy guard.** `pollInFlight` prevents concurrent ticks from racing on the same cursor. If dispatch takes longer than `IMESSAGE_POLL_INTERVAL_MS`, ticks are dropped (not queued). This is intentional.
|
|
- **Message chunking.** Messages over 4000 chars (`MAX_IMESSAGE_MESSAGE_LENGTH`) are split at newlines or spaces and sent as sequential AppleScript calls.
|
|
- **BlueBubbles support.** `src/api/bluebubbles-routes.ts` exports a webhook handler for BlueBubbles (a third-party iMessage relay). It is exported from the plugin index but not auto-registered as a `Route[]`; the agent must mount it manually.
|
|
- **No npm build deps.** Only `@elizaos/core` and `zod` at runtime. The build uses `build.ts` (not a tsdown config file) invoked via `bun run build.ts`.
|
|
|
|
<!-- BEGIN: evidence-and-e2e-mandate (managed; canonical standard = repo-root AGENTS.md) -->
|
|
## ⛔ NON-NEGOTIABLE — evidence, trajectories & real end-to-end tests
|
|
|
|
> The binding, repo-wide standard is **[AGENTS.md](../../AGENTS.md)**. Read it.
|
|
> Nothing in this package is *done* until it is *proven* done — a reviewer must confirm it
|
|
> works **without reading the code**, from the artifacts you attach. This applies to **every**
|
|
> feature, fix, refactor, and chore here. "Tests pass" is not proof; "CI is green" is not proof.
|
|
|
|
- **Record AND read model trajectories.** Capture the *actual* inputs and outputs of the model
|
|
from a **live** LLM — not the deterministic proxy, not a mock: the prompt, the
|
|
providers/context, the raw model output, every tool/action call, and the result. Then **open
|
|
the trajectory and review it by hand.** A captured-but-unread trajectory is not evidence
|
|
(`packages/scenario-runner/bin/eliza-scenarios run <scenario> --report <out>`).
|
|
- **Real, full-featured E2E — no larp.** Every feature ships detailed end-to-end tests that
|
|
drive the *real* path end to end. Not the happy "front door" only: cover error paths,
|
|
edge/empty/invalid input, concurrency, roles/permissions, and adversarial input. A test that
|
|
asserts against a mock/stub/fixture standing in for the thing under test **does not count**.
|
|
If the real model/device/chain/connector/account is hard to reach, **make it reachable — that
|
|
is the work**, not an excuse to mock. If the existing tests here are shallow or mocked, fixing
|
|
them is part of your change.
|
|
- **Screenshots + logs at every phase**, plus a **complete walkthrough video/run-through** of
|
|
the entire feature or view, start to finish (`bun run test:e2e:record`).
|
|
- **Manually review every artifact the change touches** — never just the green check: client
|
|
logs (console + network), server logs (`[ClassName] …`), the model trajectories in and out,
|
|
before/after full-page screenshots, **and the domain artifacts listed below for this package.**
|
|
- **No residuals. No shortcuts.** The goal is not "done" — it is *everything* done. Clear every
|
|
blocker by the **hard path**: build the real architecture, stand up the real
|
|
model/device/service, actually test it. Never leave a TODO, a stub, a stepping-stone, or a
|
|
"follow-up." When unsure, research thoroughly, weigh the options, and ship the best,
|
|
highest-effort, production-ready version. Keep going until every possibility is exhausted.
|
|
|
|
Artifacts → attached inline in the PR (MP4 video, JPG screenshots, logs in `<details>`); attach each evidence type **or**
|
|
explicitly mark it N/A with a reason — never leave it blank. If `develop` moved and changed
|
|
behavior, **re-capture** evidence; stale proof is worse than none.
|
|
|
|
**Capture & manually review for this package — platform connector:**
|
|
- A real (or sandbox-account) round-trip on the platform: inbound message → agent → outbound reply, captured as logs **and** a screenshot/recording of the actual conversation.
|
|
- The raw inbound event/webhook payload and the outbound API request/response, with IDs mapped correctly (`stringToUuid` / `createUniqueUuid`).
|
|
- Attachments, threads/replies, edits, multi-account, and rate-limit/error paths — not just a single text ping.
|
|
- The agent trajectory for the turn the connector drove.
|
|
<!-- END: evidence-and-e2e-mandate -->
|