ruNNtime
A browser-side inference library designed specifically around WebGPU compute capabilities. Written natively in TypeScript without requiring WASM or native plugins, it supports local GPU-accelerated execution of various vision models directly in the browser.
Timeline (last 90 days)
Developers ported the text tower and vision tower of EmbeddingGemma 2 to ruNNtime and built a small photo gallery demo.
ruNNtime is a TypeScript-written, WebGPU-based inference library designed specifically around WebGPU compute capabilities.
The ruNNtime project is hosted at github.com/software-mansion/runntime.
The entire retrieval process in this demo runs entirely on the user's local GPU without going through any server.
All Facts (4)
ruNNtime is a TypeScript-written, WebGPU-based inference library designed specifically around WebGPU compute capabilities.
50%UnverifiedThe ruNNtime project is hosted at github.com/software-mansion/runntime.
50%UnverifiedThe entire retrieval process in this demo runs entirely on the user's local GPU without going through any server.
50%UnverifiedDevelopers ported the text tower and vision tower of EmbeddingGemma 2 to ruNNtime and built a small photo gallery demo.
50%