3.5 KiB
3.5 KiB
QA: A2UI Error Recovery — LangGraph (Python)
Prerequisites
- Demo is deployed and accessible at
/demos/a2ui-recoveryon the dashboard host - Agent backend is healthy;
OPENAI_API_KEYis set;LANGGRAPH_DEPLOYMENT_URLpoints at the LangGraph deployment exposing thea2ui_recoverygraph (registered as agent namea2ui-recovery— seesrc/app/api/copilotkit-a2ui-recovery/route.ts) - Requires
ag-ui-langgraph >= 0.0.41(theget_a2ui_toolsvalidate→retry recovery loop +a2ui_recovery_exhaustedhard-fail envelope) and the@copilotkitA2UI renderer (thebuilding/retrying/failedlifecycle rendering) - Backend-owned wiring: the route sets
injectA2UITool: false; the agent ownsgenerate_a2uiviaget_a2ui_tools({ recovery: { maxAttempts: 3 } })(seesrc/agents/recovery_agent.py) - Reuses the declarative-gen-ui catalog (
catalogId: "declarative-gen-ui-catalog") and the Vantage Threads sales context — no new components
Test Steps
1. Basic Functionality
- Navigate to
/demos/a2ui-recovery; verify the page renders within 3s and a singleCopilotChatpane is centered (max-width ~896px, rounded-2xl, full-height) - Verify the chat is wired to
runtimeUrl="/api/copilotkit-a2ui-recovery"andagent="a2ui-recovery"(DevTools → Network: sending a message hits that endpoint, not/api/copilotkit) - Verify both suggestion pills are visible with verbatim titles:
- "Recover a bad render"
- "Show an unrecoverable failure"
2. Healing path
- Click "Recover a bad render" ("Render my Q2 sales dashboard, recovering if the first attempt is malformed.")
- The inner
render_a2uireturns free-form / sloppy A2UI args (components & data as JSON strings rather than structured arrays). Verify the middleware heals them viaparse_and_fixinto a valid surface that paints (no broken surface, no error banner) - Verify the painted surface is valid: a
declarative-metricrow ("Quarterly Revenue $4.2M", "Win Rate 31%") — i.e., the sloppy render was repaired and rendered - DevTools → Network: verify the final tool result carries an
a2ui_operationscontainer (noa2ui_recovery_exhausted) - Verify the chat reply is one short sentence noting the heal
3. Hard-fail (recovery exhausted) path
- Click "Show an unrecoverable failure" ("Render a dashboard that keeps failing validation so I can see the fallback.")
- Verify the lifecycle ends in a tasteful
failedstate (NOT a broken/half-rendered surface and NOT a silent drop) - DevTools → Network: verify
render_a2uiwas attempted up to the cap (3 attempts, all invalid) and the tool returned ana2ui_recovery_exhaustedenvelope (noa2ui_operationspainted) - Verify the chat reply gracefully explains the fallback (one short sentence)
4. Regression / isolation
- Verify the recovery demo does not affect the declarative-gen-ui or beautiful-chat demos (separate routes/agents)
- Re-run each pill a second time and verify the same lifecycle
Notes
- The malformed renders are forced by aimock fixtures (
showcase/aimock/d6/langgraph-python/a2ui-recovery.json): the innerrender_a2uicall is matched byuserMessage+toolName=render_a2ui. Healing itself is performed live by the toolkit recovery loop insideag_ui_langgraph.get_a2ui_tools, not the fixture. - This is the LangGraph-Python sibling of the Google-ADK
a2ui-recoverydemo; the backend recovery loop is provided byag_ui_langgraph(get_a2ui_tools) rather than the ADK middleware (get_a2ui_tool).