agent-desktop
An open-source Rust command-line tool from Vercel Labs that gives AI agents cross-platform desktop control capability by reading the operating system's accessibility tree, using stable element references instead of pixel coordinates.
Timeline (last 90 days)
Vercel Labs has open-sourced agent-desktop under the Apache-2.0 license.
agent-desktop is a command-line tool written in Rust.
agent-desktop supports three platforms: macOS, Windows and Linux.
agent-desktop reads the interface structure from the operating system's accessibility tree, obtains stable element references (refs), and performs actions based on the refs rather than relying on pixel coordinates.
agent-desktop wraps the vastly different accessibility APIs of the three major platforms into a unified set of Rust CLI commands, achieving consistent cross-platform operation semantics.
agent-desktop is implemented in Rust and packaged as a CLI, offering near-native performance and single-binary distribution, and naturally fits various agent frameworks.
agent-desktop is likely to become middleware connecting the agent reasoning layer with the operating system execution layer.
agent-desktop's cross-platform execution mechanism and ref semantics depend on operating system accessibility interfaces, and actual results depend on the quality of the target software's implementation of accessibility semantics.
All Facts (8)
agent-desktop's cross-platform execution mechanism and ref semantics depend on operating system accessibility interfaces, and actual results depend on the quality of the target software's implementation of accessibility semantics.
50%Unverifiedagent-desktop is a command-line tool written in Rust.
50%Unverifiedagent-desktop supports three platforms: macOS, Windows and Linux.
50%Unverifiedagent-desktop reads the interface structure from the operating system's accessibility tree, obtains stable element references (refs), and performs actions based on the refs rather than relying on pixel coordinates.
50%Unverifiedagent-desktop wraps the vastly different accessibility APIs of the three major platforms into a unified set of Rust CLI commands, achieving consistent cross-platform operation semantics.
50%Unverifiedagent-desktop is implemented in Rust and packaged as a CLI, offering near-native performance and single-binary distribution, and naturally fits various agent frameworks.
50%Unverifiedagent-desktop is likely to become middleware connecting the agent reasoning layer with the operating system execution layer.
50%UnverifiedVercel Labs has open-sourced agent-desktop under the Apache-2.0 license.
50%