Point and Yap
An open-source, free tool for Mac that captures the user's voice commands and on-screen pointing location through a double-tap of the Control key, and sends structured context to an AI coding agent via the MCP protocol, helping the agent understand the developer's spatial intent.
Timeline (last 90 days)
Marc Maurer launched a small Mac utility called Point and Yap on Product Hunt.
Point and Yap is a completely free, open-source Mac tool that runs locally.
Point and Yap ranked 19th on Product Hunt that day, receiving 73 votes and 8 comments.
Point and Yap is operated by double-tapping the Control key, then pointing at a screen element with the mouse or trackpad while describing the request by voice.
Point and Yap captures both the location the user points at and the voice simultaneously, and packages the two types of information to send to a coding agent via MCP.
Point and Yap essentially acts as an MCP server, packaging the transcribed voice text and screen coordinates into structured context exposed to the agent.
Point and Yap currently supports only the Mac platform, so Windows and Linux users cannot use it for now.
Point and Yap's Product Hunt page does not detail the speech recognition accuracy, the list of supported agents, or the specific format of the pointing information.
Voice and screen-pointing data are processed locally in Point and Yap, which means lower privacy risk for developers handling sensitive code.
If speech recognition or agent reasoning relies on cloud models, the transcribed text may still be uploaded, so running locally does not necessarily mean data never leaves the device.
All Facts (10)
If speech recognition or agent reasoning relies on cloud models, the transcribed text may still be uploaded, so running locally does not necessarily mean data never leaves the device.
50%UnverifiedPoint and Yap is a completely free, open-source Mac tool that runs locally.
50%UnverifiedPoint and Yap ranked 19th on Product Hunt that day, receiving 73 votes and 8 comments.
50%UnverifiedPoint and Yap is operated by double-tapping the Control key, then pointing at a screen element with the mouse or trackpad while describing the request by voice.
50%UnverifiedPoint and Yap captures both the location the user points at and the voice simultaneously, and packages the two types of information to send to a coding agent via MCP.
50%UnverifiedPoint and Yap essentially acts as an MCP server, packaging the transcribed voice text and screen coordinates into structured context exposed to the agent.
50%UnverifiedPoint and Yap currently supports only the Mac platform, so Windows and Linux users cannot use it for now.
50%UnverifiedPoint and Yap's Product Hunt page does not detail the speech recognition accuracy, the list of supported agents, or the specific format of the pointing information.
50%UnverifiedVoice and screen-pointing data are processed locally in Point and Yap, which means lower privacy risk for developers handling sensitive code.
50%UnverifiedMarc Maurer launched a small Mac utility called Point and Yap on Product Hunt.
50%