Unverified50% confidenceFactExact time
The program can perform low-level operations including capturing screen images, sending keystrokes, and executing mouse operations (move, double-click), allowing the model to directly control the mouse to use the interface.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/4/2026
First Seen
Valid until: 1/2/2027
Sources
Related Entities
Related Claims
UnverifiedComputer-Use Agent directly controls graphical user interfaces by identifying interface elements via screenshots and simulating mouse clicks and keyboard inputs, mimicking human visual-action behavior.79% similarUnverifiedStepShot automatically captures mouse clicks and keyboard input while the user operates the screen74% similarUnverifiedComputer Use通过将屏幕截图作为视觉输入，模型识别UI元素后输出鼠标点击或键盘操作指令，与依赖DOM结构的Selenium、Playwright有本质区别73% similarUnverifiedStudio Mode provides mouse click effects, including click highlights and cursor magnification and other visual feedback.72% similarUnverifiedScreen Awesome 提供自动缩放（Auto-zoom）功能，会在每次鼠标点击时平滑放大到操作区域71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/972322API
curl https://kongchang.com/api/v1/knowledge/claims/972322MCP
get_claim(id=972322)