Unverified50% confidenceReleaseExact time
The Computer Use feature was released in October 2024 alongside Claude 3.5 Sonnet, allowing AI models to directly observe screenshots, move the mouse, click buttons, and type text to control desktop applications.
1
Sources
50%
Confidence
Long-term
Relevance
9/5/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedIn 2024, Anthropic released Claude's Computer Use feature, which understands screen content through screenshots and simulates mouse and keyboard operations using coordinate positioning76% similarUnverifiedAnthropic's Computer Use employs a 'screenshot-reason-execute' loop where AI captures the current screen, feeds the image into the Claude model for visual understanding, and outputs the next action including click coordinates, keyboard input, and scroll commands.65% similarUnverifiedComputer Use depends on screenshots combined with Vision Language Models (VLMs) to understand desktop interface content, then uses OS-level input simulation to control the mouse and keyboard65% similarUnverifiedComputer Use通过将屏幕截图作为视觉输入，模型识别UI元素后输出鼠标点击或键盘操作指令，与依赖DOM结构的Selenium、Playwright有本质区别63% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/860962API
curl https://kongchang.com/api/v1/knowledge/claims/860962MCP
get_claim(id=860962)