#on-device AI
242 related articles
·3 min
Gemini Robotics 2 Explained: Full-Body Control, Multi-Robot Coordination, and On-Device Deployment
Google DeepMind releases Gemini Robotics 2, a robot foundation model enabling humanoid full-body control, multi-step error recovery, multi-robot coordination, and on-device deployment.
Read more →
·3 min
Gemini Robotics 2 Explained: Full-Body Control, Multi-Robot Coordination, and On-Device Deployment
Google DeepMind releases Gemini Robotics 2, achieving humanoid full-body control, multi-step error recovery, multi-robot coordination, and on-device deployment with built-in safety mechanisms.
Read more →
·2 min
Reverse Engineering Apple's ANE: Open-Source Project Enables On-Device Training on the Neural Engine
Deep dive into the maderix/ANE GitHub project that reverse engineers Apple's private APIs to enable neural network training on the Apple Neural Engine, exploring its technical approach, efficiency gains, compliance risks, and implications for on-device AI.
Read more →
·3 min
GitHub Daily · July 29: Voice AI and On-Device Training Take Flight as Open-Source Alternatives Rise
GitHub Trending July 29: Microsoft's VibeVoice leads voice AI open-source wave, MoonshotAI's FlashKDA CUDA kernel surges 25%, and open-source alternatives rise.
Read more →
·3 min
27B Parameter LLM on an iPhone? A Deep Dive into On-Device Full-Parameter AI
Startup Prismo claims to compress a 27B-parameter model to 4GB for full local inference on iPhone 17 Pro. We break down the compression tech, compare it to Apple's MoE approach, and assess real-world limits.
Read more →
·2 min
On-Device LLMs, Custom Silicon, and 100K-GPU Clusters: AI Industry Enters Full-Spectrum Competition
Apple's 1-bit compression fits 27B models on iPhone, Meta builds custom chip Iris, China's 100K-GPU cluster goes live, Samsung enters AI PC — a deep dive into AI's new full-spectrum competition.
Read more →
Bonsai 27B: The First 1-bit LLM That R…
·3 min
Bonsai 27B: The First 1-bit LLM That Runs on Your Phone — A New Milestone for On-Device AI
Bonsai 27B is the first 27B-parameter LLM that runs on smartphones via 1-bit quantization, compressing to 3–4GB. We break down the tech, privacy benefits, and community debate.
Read more →
·2 min
Chrome Silently Installed a 4GB Local AI Model: The Battle for Transparency in the On-Device AI Era
Google Chrome silently downloaded a 4GB Gemini Nano AI model without user consent, sparking Hacker News debate. A deep dive into on-device AI, user rights, and transparency.
Read more →
·3 min
NVIDIA ACE SDK: On-Device AI Inference for Intelligent Game NPC Companions
Deep dive into NVIDIA ACE Game Agent SDK's integration with Unreal Engine 5, exploring how on-device AI inference enables low-latency, privacy-safe intelligent NPC dialogue and behavior.
Read more →
·3 min
Firebase's Major Upgrade: Real-Time SQL Sync, On-Device AI Inference, and Agent Skills
Firebase unveils major updates at Google I/O 2025: SQL Connect real-time sync, AI Logic on-device inference, Firestore Enterprise full-text search, phone verification GA, and more.
Read more →
·1 min
Firebase AI Logic Integrates with Apple Foundation Models: A Deep Dive into On-Device and Cloud Collaboration for Calling Gemini Models
Firebase AI Logic integrates with Apple Foundation Models, enabling developers to call cloud-hosted Gemini models via a unified API. A deep dive into the on-device and cloud architecture.
Read more →
·4 min
Google Hybrid Inference Comes to iOS: A Complete Guide to On-Device AI Cross-Platform Deployment
Google Hybrid Inference now supports iOS, adds Gemma 4 on Android, and Chrome local Web inference nears GA. A deep dive into hybrid inference technology, cross-platform advantages, and developer opportunities.
Read more →
·4 min
Google Hybrid Inference Comes to iOS: A Complete Guide to On-Device AI Cross-Platform Deployment
Google Hybrid Inference officially supports iOS, adds Gemma 4 on Android, and Chrome local Web inference nears GA. A deep dive into hybrid inference technology, cross-platform advantages, and developer opportunities.
Read more →
·2 min
Google Kills Another App: Is the All-in-on-Gemini Integration Strategy Smart or Risky?
Google kills another app before launch, sparking Reddit debate. Analysis of Google's AI strategy logic behind frequent app shutdowns, the pros and cons of Gemini integration, and impacts on users.
Read more →
·5 min
Halo: A Real-Time Anti-Deepfake Tool That Detects AI Face-Swapping in Video Calls
Halo is a local real-time deepfake detection tool that identifies AI-synthesized faces during Zoom, Teams, and Google Meet video calls to prevent face-swapping fraud.
Read more →
·2 min
Yap: A 4MB Open-Source Voice Input Tool That Runs Entirely Locally with Zero Privacy Risk
Yap is a 4MB open-source Mac voice input tool that runs entirely locally using native macOS speech APIs. No internet needed, built with 3000 lines of Swift, MIT licensed and free.
Read more →
·2 min
Expert Chase Launches on Mobile: AI Assistant Deeply Integrated with Apple and Google Ecosystems
Expert Chase launches iOS and Android apps with deep Apple Calendar, Google Calendar, and health data integrations, transforming from a passive Q&A tool into a proactive all-scenario AI life assistant.
Read more →
·2 min
Yap: A 4MB Open-Source Voice Input Tool That Runs Entirely Locally with Zero Privacy Risk
Yap is a 4MB open-source Mac voice input tool that runs entirely locally using native macOS speech APIs. Zero cloud dependency, MIT licensed, built with 3,000 lines of Swift code.
Read more →
·3 min
Epilude: A Fully Local Mac AI Voice Input Tool Review
Epilude is a fully local macOS AI voice input tool that converts speech to polished written text with a push-to-talk hotkey. Review covers privacy, features, and cloud tool comparisons.
Read more →
·2 min
BlackFlare: A Powerful macOS Menu Bar Tool for Managing Claude Code and Codex
BlackFlare is a native macOS menu bar app for Claude Code and Codex users. It keeps your Mac awake, sends task notifications, monitors usage, and switches configs—all running locally for privacy.
Read more →