---
title: "Upgrade Guide: prerelease → Sessions-as-run-manager"
sidebarTitle: "Sessions Upgrade Guide"
description: "Migrating chat.agent code from the prerelease API to the Sessions-as-run-manager release."
---
This guide is for customers who tried `chat.agent` during the prerelease period.
The public surface of `chat.agent({...})`, `useTriggerChatTransport`,
`AgentChat`, `chat.defer`, and `chat.history` is largely
unchanged — but the transport's auth callbacks and the server-side helpers
that feed them were reshaped, so most prerelease apps need a small wiring
update.
## TL;DR
```ts before.ts
// Single accessToken callback, dispatches on purpose
accessToken: async ({ chatId, purpose }) => {
if (purpose === "trigger") {
return chat.createAccessToken("my-chat");
}
// purpose === "preload" — same call, same trigger token
return chat.createAccessToken("my-chat");
};
```
```ts after.ts
// Two callbacks: pure refresh + server action that creates the session
accessToken: ({ chatId }) => mintChatAccessToken(chatId),
startSession: ({ chatId, clientData }) =>
startChatSession({ chatId, clientData }),
```
What changed:
- `accessToken` is now a **pure session-PAT mint** — called only on 401/403
to refresh. It must return a token scoped to the session, not a
`trigger:tasks` JWT.
- `startSession` is a **new callback** that wraps a server action calling
`chat.createStartSessionAction(taskId)`. The transport invokes it on
`transport.preload(chatId)` and lazily on the first `sendMessage` for
any chatId without a cached PAT.
- `ChatSession` persistable state drops `runId` — store only
`{publicAccessToken, lastEventId?}`.
- Per-call options on `transport.preload(chatId, ...)` are gone. Trigger
config (machine, idleTimeoutInSeconds, tags, queue, maxAttempts) lives
server-side in `chat.createStartSessionAction(taskId, options)`.
The architectural shift is that `chat.agent` no longer rolls its own
per-run streams. It runs on top of a durable **Session** row that owns
its current run, persists across run lifecycles, and orchestrates
upgrades server-side. The customer-facing surface is similar; the wire
path beneath it changed completely.
## Step 1: Replace your access-token server action with two server actions
The old pattern was a single helper that minted a trigger token:
```ts app/actions.ts (before)
"use server";
import { chat } from "@trigger.dev/sdk/ai";
import type { myChat } from "@/trigger/chat";
export const getChatToken = () =>
chat.createAccessToken("my-chat");
```
Replace with two helpers — one for session creation, one for PAT refresh:
```ts app/actions.ts (after)
"use server";
import { auth } from "@trigger.dev/sdk";
import { chat } from "@trigger.dev/sdk/ai";
// Server-side wrapper for session creation. Idempotent on (env, chatId).
// The customer's server is the only entry point that creates Session rows;
// the browser never holds a `trigger:tasks` JWT.
export const startChatSession = chat.createStartSessionAction("my-chat");
// Pure session-PAT mint for the transport's 401/403 retry path.
export async function mintChatAccessToken(chatId: string) {
return auth.createPublicToken({
scopes: {
read: { sessions: chatId },
write: { sessions: chatId },
},
expirationTime: "1h",
});
}
```
`chat.createStartSessionAction(taskId)` returns a server action that:
1. Creates the Session row for `chatId` (idempotent on the
`(env, externalId)` unique pair).
2. Triggers the agent task's first run with
`basePayload: {messages: [], trigger: "preload"}` defaults plus any
overrides you pass.
3. Returns `{sessionId, runId, publicAccessToken}` to the browser.
## Step 2: Update the transport wiring
The transport now takes two callbacks instead of one:
```tsx app/components/chat.tsx (after)
"use client";
import { useChat } from "@ai-sdk/react";
import { useTriggerChatTransport } from "@trigger.dev/sdk/chat/react";
import type { myChat } from "@/trigger/chat";
import { mintChatAccessToken, startChatSession } from "@/app/actions";
export function Chat() {
const transport = useTriggerChatTransport({
task: "my-chat",
accessToken: ({ chatId }) => mintChatAccessToken(chatId),
startSession: ({ chatId, clientData }) =>
startChatSession({ chatId, clientData }),
});
const { messages, sendMessage, status } = useChat({ transport });
// ...
}
```
The transport calls them in two distinct flows:
| Trigger | Callback fired |
|---|---|
| `transport.preload(chatId)` | `startSession` |
| First `sendMessage` for a chatId with no cached PAT | `startSession` (auto) |
| Any 401/403 from `.in/append`, `.out` SSE, or `end-and-continue` | `accessToken` |
| Page hydrates with `sessions: { [chatId]: ... }` | Neither (uses hydrated PAT) |
`startSession` is deduped via an in-flight promise — concurrent
`preload` + `sendMessage` calls converge to one server action invocation.
## Step 3: Drop transport-level trigger config
The prerelease transport accepted `triggerConfig`, `triggerOptions`, and
per-call options on `preload`. All of that moved server-side:
```ts before
const transport = useTriggerChatTransport({
task: "my-chat",
accessToken: getChatToken,
triggerConfig: { basePayload: { /* ... */ } },
triggerOptions: { tags: [...], machine: "small-1x", maxAttempts: 3 },
});
transport.preload(chatId, { idleTimeoutInSeconds: 60, metadata: { ... } });
```
```ts after
// Trigger config now lives in chat.createStartSessionAction
export const startChatSession = chat.createStartSessionAction("my-chat", {
triggerConfig: {
machine: "small-1x",
maxAttempts: 3,
tags: ["my-tag"],
idleTimeoutInSeconds: 60,
},
});
// Browser side
const transport = useTriggerChatTransport({
task: "my-chat",
accessToken: ({ chatId }) => mintChatAccessToken(chatId),
startSession: ({ chatId, clientData }) =>
startChatSession({ chatId, clientData }),
});
transport.preload(chatId); // no second arg
```
For metadata that varies per chat, use `clientData` on the transport (see
the next step) — it's typed and threaded through `startSession` automatically.
## Step 4: Use `clientData` for typed payload metadata
If your agent uses `withClientData({schema})`, the transport's `clientData`
option is now the canonical place to set it. The same value:
- Is passed to your `startSession` callback as `params.clientData`, where
you forward it into `chat.createStartSessionAction`'s
`triggerConfig.basePayload.metadata`. The agent's first run sees it in
`payload.metadata` (visible to `onPreload` / `onChatStart`).
- Merges into per-turn `metadata` on every `.in/append` chunk
(visible to `onTurnStart` / inside `run` via `turn.clientData`).
```tsx
const transport = useTriggerChatTransport({
task: "my-chat",
accessToken: ({ chatId }) => mintChatAccessToken(chatId),
startSession: ({ chatId, clientData }) =>
startChatSession({ chatId, clientData }),
clientData: {
userId: currentUser.id,
plan: currentUser.plan,
},
});
```
The `clientData` value is live-updated when the option changes (the hook
calls `setClientData` under the hood), so dynamic values work without
reconstructing the transport.
Server-side authorization can still override or augment the
browser-claimed `clientData` inside `startSession` — never trust the
browser's identity claim. A typical pattern: the server action looks up
the user from the request session, then merges the trusted server fields
on top of `params.clientData`.
## Step 5: Update your `ChatSession` persistence
If you persist session state across page loads, drop the `runId` field:
```ts before
type ChatSession = {
runId: string;
publicAccessToken: string;
lastEventId?: string;
};
```
```ts after
type ChatSession = {
publicAccessToken: string;
lastEventId?: string;
};
```
If your DB has a `runId` column, you can drop it (the transport doesn't
read it) or keep it for telemetry. The current run ID lives on the
Session row server-side now.
Hydration on page reload is unchanged:
```tsx
const transport = useTriggerChatTransport({
// ...
sessions: persistedSession
? { [chatId]: persistedSession }
: {},
});
```
## `chat.requestUpgrade()`: same call, faster handoff
Calling `chat.requestUpgrade()` inside `onTurnStart` /
`onValidateMessages` still ends the current run so the next message starts
on the latest version. What changed is the mechanism:
- **Before:** the agent emitted a `trigger:upgrade-required` chunk on
`.out`; the transport consumed it browser-side and triggered a new run.
- **After:** the agent calls `endAndContinueSession` server-to-server;
the webapp triggers a new run and atomically swaps `Session.currentRunId`
via optimistic locking. The browser's existing SSE subscription keeps
receiving chunks across the swap — no transport-side bookkeeping.
The new run is recorded in a `SessionRun` audit row with
`reason: "upgrade"` for dashboard provenance.
## Hitting raw URLs
If your code talks to the realtime API directly instead of going through
the SDK, the URL shapes changed:
| Before | After |
|---|---|
| `GET /realtime/v1/streams/{runId}/chat` | `GET /realtime/v1/sessions/{chatId}/out` |
| `POST /realtime/v1/streams/{runId}/{target}/chat-messages/append` | `POST /realtime/v1/sessions/{chatId}/in/append` (body: `{kind: "message", payload}`) |
| `POST /realtime/v1/streams/{runId}/{target}/chat-stop/append` | `POST /realtime/v1/sessions/{chatId}/in/append` (body: `{kind: "stop"}`) |
The session-scoped PAT
(`read:sessions:{chatId} + write:sessions:{chatId}`) authorizes both the
externalId form (`/sessions/my-chat-id/...`) and the friendlyId form
(`/sessions/session_abc.../...`). The transport always uses the
externalId form; the friendlyId form is available for dashboard tooling
and direct API consumers.
## What didn't change
- `chat.agent({...})` definition — `id`, `idleTimeoutInSeconds`,
`clientDataSchema`, `actionSchema`, `hydrateMessages`, `onPreload`,
`onChatStart`, `onValidateMessages`, `onTurnStart`, `onTurnComplete`,
`onChatSuspend`, `run`. All callbacks have the same signature and
fire at the same lifecycle points.
- `onAction` is still defined the same way, but its semantics changed
in the [May 6 prerelease](/ai-chat/changelog) — actions are no longer
turns, and `onAction` returning a `StreamTextResult` produces a model
response.
- `chat.customAgent({...})` and the `chat.createSession(payload, ...)`
helper for building a session loop manually inside a custom agent.
- `chat.defer` (deferred work) and `chat.history` (imperative history
mutations from inside `onAction`).
- `AgentChat` (server-side chat client) — `agent`, `id`, `clientData`,
`session`, `onTriggered`, `onTurnComplete`, `sendMessage`, `text()`.
- `useTriggerChatTransport` React semantics (created once, kept in a
ref, callbacks updated under the hood).
- Multi-tab coordination (`multiTab: true`),
[pending messages / steering](/ai-chat/pending-messages),
[background injection](/ai-chat/background-injection),
[compaction](/ai-chat/compaction).
- Per-turn `metadata` flowing through
`sendMessage({ text }, { metadata })` to `turn.metadata` server-side.
## Verifying the migration
After updating, the smoke check is the same as before: send a message,
confirm the assistant streams a response, reload mid-stream, confirm
resume.
A few new things worth verifying once you've cut over:
- **Eager preload.** Click the button (or call `transport.preload(id)`
programmatically) — your `startSession` callback should fire and a
Session row + first run should be created before you send a message.
- **Idle-timeout continuation.** Wait past the agent's
`idleTimeoutInSeconds` so the run exits, then send another message —
the transport's `.in/append` should boot a new run on the same
Session, with a `SessionRun` row of `reason: "continuation"`.
- **PAT refresh.** Force a stale PAT in your DB (corrupt the signature)
and reload — the first request should 401, your `accessToken`
callback should fire, and the retry should succeed.
If any of those misfire, check that:
- Your `accessToken` callback returns a token minted via
`auth.createPublicToken({ scopes: { read: { sessions: chatId }, write: { sessions: chatId } } })`, **not**
`chat.createAccessToken` or `auth.createTriggerPublicToken`. The
transport rejects trigger tokens now.
- Your `startSession` callback returns
`{publicAccessToken: string}` — the result of
`chat.createStartSessionAction(taskId)({chatId, ...})` already has
this shape.
- You haven't left a stale `getStartToken` option on the transport;
it's not part of `TriggerChatTransportOptions` anymore.
## v4.5 wire format change
A second migration lands on top of the Sessions release. v4.5 removes the full-history wire payload — clients now ship at most one new `UIMessage` per `.in/append`, and the agent rebuilds prior history from a durable JSON snapshot in object storage plus a replay of the `session.out` tail.
If you use the built-in `TriggerChatTransport` / `AgentChat` and don't reach into the wire shape directly, **most apps need no changes** — the change is below the customer-facing surface. Customers who built custom transports, hit `/realtime/v1/sessions/{id}/in/append` directly, or rely on specific behaviors of `hydrateMessages` / `onChatStart` should read this section.
### Why the change
Long chats with heavy tool results were hitting the realtime API's 512 KiB body cap on `/in/append` once the accumulated `UIMessage[]` history (which the wire shipped in full on every send) crossed the limit. The 413 surfaced as a CORS error in browsers and stalled chats around turn 10–30 with tool use.
The wire is now **delta-only**: each `.in/append` carries at most one new `UIMessage`. The agent rebuilds prior history at run boot. The 512 KiB ceiling stops being pressure — typical payloads are a few KB regardless of chat length.
### Object-store configuration
Snapshot read/write uses Trigger.dev's existing object-store infrastructure — the same presigned-URL routes used for large payloads. Set the standard `OBJECT_STORE_*` env vars on your webapp deployment if you haven't already; MinIO and S3-compatible stores work via `OBJECT_STORE_DEFAULT_PROTOCOL`.
| Env var | Purpose |
|---|---|
| `OBJECT_STORE_BASE_URL` | Endpoint URL (S3, MinIO, R2, etc.) |
| `OBJECT_STORE_ACCESS_KEY_ID` | Access key |
| `OBJECT_STORE_SECRET_ACCESS_KEY` | Secret key |
| `OBJECT_STORE_DEFAULT_PROTOCOL` | `s3` (default), `minio`, etc. |
Snapshots are written under `packets/{projectRef}/{envSlug}/sessions/{sessionId}/snapshot.json`. Each snapshot is small (typically tens of KB) and overwritten every turn — no append-only growth.
**No object store + no `hydrateMessages` = conversations don't survive run boundaries.** With neither piece of state, a continuation boots empty and the agent can't reconstruct prior turns. Either configure an object store or register `hydrateMessages`. The runtime logs a warning at agent registration time when both are missing.
### Custom transports
If you've built your own transport (Slack bot, CLI, native app) against the [Client Protocol](/ai-chat/client-protocol), the `ChatTaskWirePayload` shape changed:
```ts before
type ChatTaskWirePayload = {
messages: UIMessage[]; // full history
chatId: string;
trigger: "submit-message" | "regenerate-message" | "preload" | "close" | "action";
// ...
};
```
```ts after
type ChatTaskWirePayload = {
message?: UIMessage; // singular, optional
headStartMessages?: UIMessage[]; // chat.headStart only, "handover-prepare"
chatId: string;
trigger:
| "submit-message"
| "regenerate-message"
| "preload"
| "close"
| "action"
| "handover-prepare";
// ...
};
```
What to send per trigger:
| Trigger | What to put in the payload |
|---|---|
| `submit-message` | The new user message (or a tool-approval-responded assistant message) in `message` |
| `regenerate-message` | No `message` — the agent trims its own tail |
| `preload` / `close` / `action` | No `message` |
| `handover-prepare` (head-start only) | Full prior history in `headStartMessages` (route handler — not on `/in/append`) |
The full wire breakdown is in the rewritten [Client Protocol](/ai-chat/client-protocol).
### `hydrateMessages` consumers
The hook signature is unchanged. Two behavior tightenings worth knowing:
1. **`incomingMessages` is now consistently 0-or-1-length.** Previously some triggers (`regenerate-message`, continuation) shipped full history; now all triggers ship at most one. If you assumed `incomingMessages` could contain multiple messages and acted on them as a batch, the loop now runs zero or one times. Patterns like the one below work the same — they just iterate fewer messages:
```ts
hydrateMessages: async ({ incomingMessages }) => {
for (const msg of incomingMessages) { // 0-or-1 iterations
for (const r of chat.history.extractNewToolResults(msg)) {
await auditLog.record({ id: r.toolCallId, output: r.output });
}
}
return await db.getMessages(chatId);
}
```
2. **Registering `hydrateMessages` short-circuits snapshot+replay.** The runtime trusts your hook to be the source of truth, so it doesn't read or write the JSON snapshot or replay `session.out`. Zero object-store traffic. Trade-off: you own persistence end-to-end.
### `onChatStart` is now once-per-chat
`onChatStart` no longer fires on continuation runs (post-`endRun`, post-waitpoint-timeout, post-`chat.requestUpgrade`, post-cancel, post-crash) or on OOM-retry attempts. It fires **exactly once per chat**, on the very first user message of the chat's lifetime. The `continuation` and `previousRunId` fields on `ChatStartEvent` are now `@deprecated` (always `false` / `undefined` when the hook fires).
This makes once-per-chat setup code (create the Chat DB row, mint chat-scoped resources) safe to write without continuation gates. Drop any `if (continuation) return;` checks from `onChatStart`:
```ts before
onChatStart: async ({ continuation, chatId, clientData }) => {
if (continuation) return; // ❌ no longer needed — fires only on first message ever
await db.chat.create({ /* ... */ });
}
```
```ts after
onChatStart: async ({ chatId, clientData }) => {
await db.chat.create({ /* ... */ }); // ✅ guaranteed first-message-of-chat
}
```
If you need per-turn setup that **does** run on continuations, move it to [`onTurnStart`](/ai-chat/lifecycle-hooks#onturnstart) — that hook still fires on every turn, including the first turn of a continuation run.
### Move `chat.local` init from `onChatStart` to `onBoot`
Because `onChatStart` no longer fires on continuation runs, **`chat.local`** state initialized there will be missing when a continuation run starts — `run()` then crashes with `"chat.local can only be modified after initialization"`. The fix is to move per-process initialization to the new [`onBoot`](/ai-chat/lifecycle-hooks#onboot) hook, which fires once per worker boot (initial, preloaded, AND continuation):
```ts before
const userContext = chat.local<{ name: string; plan: string }>({ id: "userContext" });
onChatStart: async ({ clientData }) => {
const user = await db.user.findUnique({ where: { id: clientData.userId } });
userContext.init({ name: user.name, plan: user.plan }); // ❌ never runs on continuation
}
```
```ts after
const userContext = chat.local<{ name: string; plan: string }>({ id: "userContext" });
onBoot: async ({ clientData }) => {
const user = await db.user.findUnique({ where: { id: clientData.userId } });
userContext.init({ name: user.name, plan: user.plan }); // ✅ runs on every fresh worker
}
```
Anything else that's per-process (DB connection pools, sandbox handles, in-memory caches) belongs in `onBoot` for the same reason. Branch on `continuation` inside `onBoot` if you need to re-load state from your DB on takeover.
### Client-side `setMessages` doesn't round-trip
The new wire makes one thing explicit that was implicit before: **mutating `useChat()`'s messages on the client doesn't change the agent's history.** Full-history mutations were silently overwritten by the wire's accumulator before this release; now they aren't even shipped.
For history compaction, summarization, or branch-swap, mutate the agent's accumulator inside `onTurnStart` using [`chat.setMessages()`](/ai-chat/backend) or [`chat.history.set()`](/ai-chat/backend#chat-history). The client's `useChat` will reconcile against the next `session.out` payload.
### Verifying the v4.5 migration
After updating, the smoke check is the same as for v4.4:
- Send a message, confirm the assistant streams a response.
- Reload mid-stream, confirm resume.
- Send 30+ turns with tool calls — `.in/append` body sizes stay under ~5 KB the entire time. (Pre-change baseline: payloads grew past 512 KB around turn 10-30.)
- Idle out a run, send another message — the new run reads the snapshot, replays the tail, and continues seamlessly.
If continuations boot empty:
- Confirm `OBJECT_STORE_*` env vars are set on the webapp.
- Confirm the bucket key `packets/{projectRef}/{envSlug}/sessions/{sessionId}/snapshot.json` exists after a successful turn.
- Or — register `hydrateMessages` and let your DB be the source of truth.
## Reference
- [TriggerChatTransport options](/ai-chat/reference#triggerchattransport-options)
- [`chat.createStartSessionAction`](/ai-chat/reference)
- [Backend setup](/ai-chat/backend)
- [Frontend setup](/ai-chat/frontend)
- [Client Protocol](/ai-chat/client-protocol) — wire format reference
- [Persistence and replay](/ai-chat/patterns/persistence-and-replay) — snapshot model end-to-end