Concept屏幕理解
Screen Understanding
A capability in AI systems that involves capturing the screen in real time and using vision models to recognize the location and semantics of interface elements such as buttons, menus, and icons. This enables AI to comprehend and respond to the current on-screen context.
Timeline (last 90 days)
Oct 5
Marv's technology relies on screen comprehension capabilities, requiring real-time screen capture and the use of a visual model to identify the position and semantics of interface elements, then rendering annotation results overlaid as a transparent floating layer.
Unverified50%