Use the computer and apps
Beyond shell commands and APIs, Plannix Bot can operate full desktop graphical user interfaces. It can open web browsers, navigate authenticated internal dashboards, interact with desktop design software, and test native applications.
Computer use architecture
Plannix Bot connects to an isolated X11 or Wayland virtual display server. A specialized multimodal model observes visual framebuffers, calculates pixel coordinates, and issues simulated mouse clicks and keystrokes.
Virtual Display Server
Runs in 1920x1080 resolution with support for high-DPI scaling and hardware-accelerated rendering.
Precise Coordinate Action
Executes clicks, double-clicks, drags, scroll gestures, and complex hotkey chords.
Mouse, keyboard, and screen capture
Screen frames are compressed and streamed live to the human operator so you can follow every mouse movement and form submission in real time.
Headless browser automation
For web workflows where GUI overhead is unnecessary, Plannix Bot switches to headless browser mode powered by Playwright and Puppeteer, executing fast DOM-level queries and capturing screenshots.
Running desktop applications
Bots can launch office suites, CAD software, legacy Windows/Linux desktop utilities, or terminal emulators, allowing legacy enterprise systems to be automated without requiring modern REST APIs.
Safety and human supervision
An emergency kill-switch button is always available in the interface. Human operators can take over mouse control at any millisecond to intervene or bypass CAPTCHAs.