待验证50% 置信事实精确时间
Computer Use通过将屏幕截图作为视觉输入，模型识别UI元素后输出鼠标点击或键盘操作指令，与依赖DOM结构的Selenium、Playwright有本质区别
1
来源数
50%
置信度
长期有效
时效性
2026/7/7
首次发现
来源
100亿Token实战：Codex长程工程能力深度测评
bilibili程序员阿江-Relakkes2026/6/9
相关事实
已验证Computer Use通过多模态大模型直接查看屏幕截图来理解界面布局和内容语义，与传统RPA依赖预定义规则和固定UI元素定位的方式有本质区别78% 相似待验证Computer Use depends on screenshots combined with Vision Language Models (VLMs) to understand desktop interface content, then uses OS-level input simulation to control the mouse and keyboard77% 相似待验证Anthropic's Computer Use employs a 'screenshot-reason-execute' loop where AI captures the current screen, feeds the image into the Claude model for visual understanding, and outputs the next action including click coordinates, keyboard input, and scroll commands.73% 相似待验证视觉模型接收每张屏幕截图并输出结构化信息，包括OCR识别文本、页面布局、UI控件的像素坐标框及元素状态71% 相似
引用此条事实
Stable URI
https://kongchang.com/claim/141379API
curl https://kongchang.com/api/v1/knowledge/claims/141379MCP
get_claim(id=141379)