Verified75% confidenceFactExact time
In 2024, Anthropic released Claude's Computer Use feature, which understands screen content through screenshots and simulates mouse and keyboard operations using coordinate positioning
3
Sources
75%
Confidence
Long-term
Relevance
8/26/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe Computer Use feature was released in October 2024 alongside Claude 3.5 Sonnet, allowing AI models to directly observe screenshots, move the mouse, click buttons, and type text to control desktop applications.76% similarUnverifiedComputer-Use Agent directly controls graphical user interfaces by identifying interface elements via screenshots and simulating mouse clicks and keyboard inputs, mimicking human visual-action behavior.66% similarUnverifiedTypical representatives of UI Puppeteering technology include automated testing frameworks such as Selenium and Playwright, as well as Anthropic Claude's Computer Use screen-control capability66% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/804977API
curl https://kongchang.com/api/v1/knowledge/claims/804977MCP
get_claim(id=804977)