wehub-resource-sync
91e75e620b
CI: cua-driver distro-compat matrix / debian:12 (glibc 2.36) (push) Has been cancelled
CI: SPDX Headers / Check SPDX headers (warn-only) (push) Has been cancelled
CD: Docs MCP Server / build (linux/amd64) (push) Has been cancelled
CD: Docs MCP Server / build (linux/arm64) (push) Has been cancelled
CD: Docs MCP Server / merge (push) Has been cancelled
CI: cua-driver distro-compat matrix / Resolve release version (push) Has been cancelled
CI: cua-driver distro-compat matrix / fedora:41 (glibc 2.40) (push) Has been cancelled
CI: cua-driver distro-compat matrix / rockylinux:9 (glibc 2.34) (push) Has been cancelled
CI: cua-driver distro-compat matrix / ubuntu:22.04 (glibc 2.35) (push) Has been cancelled
CI: cua-driver distro-compat matrix / ubuntu:24.04 (glibc 2.39) (push) Has been cancelled
CI: cua-driver distro-compat matrix / Distro compat summary (push) Has been cancelled
CI: Rust Linux unit / Rust Linux unit and compile (push) Has been cancelled
CI: Rust Windows unit / Rust Windows unit and compile (push) Has been cancelled
CI: Nix Linux Rust source / Nix / compositor build (push) Has been cancelled
CI: Nix Linux Rust source / Nix / driver package (push) Has been cancelled
CI: Nix Linux Rust source / Nix / Rust unit tests (push) Has been cancelled
40 lines
1.1 KiB
Markdown
40 lines
1.1 KiB
Markdown
# cua-driver MCP Tool Output Format
|
|
|
|
Every tool call returns a ✅ checkmark + concise summary. No structured JSON output.
|
|
|
|
## screenshot
|
|
```
|
|
✅ Screenshot — 1920x1080 png
|
|
|
|
On-screen windows:
|
|
- Terminal (pid 7476) "cua — Claude Code" [window_id: 2102]
|
|
- Blender (pid 6808) "* Untitled - Blender 5.1.1" [window_id: 2129]
|
|
- Google Chrome (pid 13313) "Download — Blender" [window_id: 1941]
|
|
→ Call get_window_state(pid, window_id) to inspect a window's UI.
|
|
```
|
|
|
|
## get_window_state
|
|
```
|
|
✅ Blender — 11 elements, turn 3 + screenshot
|
|
⚠️ Small AX tree (11 elements) — this app likely uses custom rendering
|
|
(e.g. Blender, games, Electron). Use pixel clicks: click(pid, x, y)
|
|
with coordinates from the screenshot.
|
|
|
|
- AXApplication "Blender"
|
|
- [0] AXWindow "* Untitled - Blender 5.1.1" actions=[AXRaise]
|
|
- [1] AXButton
|
|
...
|
|
```
|
|
|
|
## click
|
|
```
|
|
✅ Posted click to pid 6808.
|
|
```
|
|
|
|
## zoom
|
|
```
|
|
✅ Zoomed region captured at native resolution. To click a target in
|
|
this image, use `click(pid, x, y, from_zoom=true)` where x,y are pixel
|
|
coordinates in THIS zoomed image — the driver maps them back automatically.
|
|
```
|