Sessionboxer

Watching the agent

Watch the agent's desktop and take control

The Desktop pane shows the box's Linux screen next to the chat. Read-only while the agent works, yours to click and type in when it is idle or when you press Take control.

Feature page: A real desktop — screenshots, things you can do with it and how other products compare.

The session header carries five tabs — Desktop, Terminal, Code, PRs and Auto QA — each opening its pane next to the chat (click again to hide it), and a ⋯ menu with the rest: Context, Scheduled, Snapshot, Fork…, Copy session…, Pull to folder… (sessions with a copied folder), Session settings, Stop and Delete. Copy session… copies or downloads the conversation as Markdown, JSON or JSONL with the parts you tick: your messages, the agent's (all of them, or only the last one of each turn — its summary, the default), its thinking, the tool calls (optionally with what they returned) and timestamps. Resume shows in the header while the box is stopped.

Desktop opens the box's screen next to the chat. While the agent is working the view is read-only so you don't fight over the mouse; Take control hands it to you until the agent's next turn. When the agent is idle the desktop is always interactive: log into a site for it, open a program, arrange windows.

The agent works the same screen through the built-in desktop MCP server: screenshot, zoom, the mouse (left_click, right_click, double_click, left_click_drag, scroll…), the keyboard (type, key, hold_key), wait, and the recording tools (start_recording, annotate_recording, stop_recording, narrate_recording). Every tool, its parameters and limits, and what it returns is in the MCP tools reference.

The agent's cursor glides rather than jumps: every move, click, scroll and drag with a target eases from where the cursor is to where it goes, about 100 ms for a short hop and up to 300 ms across the screen, at ~120 positions a second. You see it in the Desktop pane and in recordings, and the program under the cursor gets the same run of motion events a hand-moved mouse produces — hover effects fire, and drag-and-drop that needs to see the pointer travel works. While a recording runs, glides last 350–700 ms and typing slows to about 30 letters a second, so the video shows them. SESSIONBOXER_MOUSE_GLIDE=0 in the MCP's environment (in the box's .mcp.json) makes the cursor jump instead.

This chapter is generated from docs/GUIDE.md in the Sessionboxer repository. Found a mistake? Open an issue.