#on-device deployment
177 related articles
·3 min
Gemini Robotics 2 Explained: Full-Body Control, Multi-Robot Coordination, and On-Device Deployment
Google DeepMind releases Gemini Robotics 2, achieving humanoid full-body control, multi-step error recovery, multi-robot coordination, and on-device deployment with built-in safety mechanisms.
Read more →
·3 min
Gemini Robotics 2 Explained: Full-Body Control, Multi-Robot Coordination, and On-Device Deployment
Google DeepMind releases Gemini Robotics 2, a robot foundation model enabling humanoid full-body control, multi-step error recovery, multi-robot coordination, and on-device deployment.
Read more →
·4 min
Google Hybrid Inference Comes to iOS: A Complete Guide to On-Device AI Cross-Platform Deployment
Google Hybrid Inference officially supports iOS, adds Gemma 4 on Android, and Chrome local Web inference nears GA. A deep dive into hybrid inference technology, cross-platform advantages, and developer opportunities.
Read more →
·4 min
Google Hybrid Inference Comes to iOS: A Complete Guide to On-Device AI Cross-Platform Deployment
Google Hybrid Inference now supports iOS, adds Gemma 4 on Android, and Chrome local Web inference nears GA. A deep dive into hybrid inference technology, cross-platform advantages, and developer opportunities.
Read more →
·3 min
Meta Open-Sources Muse Glimmer: A 30-Billion Parameter Agent Model That Runs Locally on a Single GPU
Meta open-sources Muse Glimmer, a 30B parameter agent model compressed to under 20GB via 4-bit quantization. Runs on a single RTX 4090 with 128K context, 3x speedup via D-Flash speculative decoding, and MCP tool-calling score of 75.5.
Read more →
·3 min
Mighty Camera Board: Real-Time SLAM and Obstacle Avoidance with a Single Camera + IMU
How Mighty Camera Board achieves real-time SLAM and obstacle avoidance using only a single global shutter camera and IMU, enabling collision avoidance and autonomous navigation for robots and drones.
Read more →
·3 min
Sign Language to Text AI: How the SL2T Model Enables Barrier-Free Communication
Explore the SL2T sign-language-to-text AI model's technical breakthroughs and how it converts sign language into text in real time, breaking communication barriers for deaf and hard-of-hearing communities.
Read more →
·2 min
Google's SL2T Model: Real-Time Sign Language-to-Text Technology Arrives on Pixel 11
Google launches SL2T sign language-to-text model supporting real-time ASL-to-English conversion, integrated with Gboard and Live Transcribe, deploying on-device on Pixel 11 for system-level accessibility.
Read more →
·3 min
Needle: How a 14MB Foundation Model Is Unlocking Edge AI Deployment
Needle is a 14MB open-source foundation model from cactus-compute, designed for phones, wearables, smart home devices, and robots. Explore its edge AI potential.
Read more →
·2 min
Nodus: A Privacy-First Tool That Turns Gemini Conversations into a Searchable Knowledge Base
Nodus is a privacy-first browser tool that transforms Gemini conversation history into a searchable knowledge base, supports cross-platform prompt migration to ChatGPT format, with all data processed locally. Now open for Beta testing.
Read more →
·4 min
Needle2: How a 14MB On-Device Agentic LLM Could Transform Edge AI
Needle2 is a 14MB on-device agentic LLM designed for phones, wearables, smart homes, and robots. This article analyzes its compression techniques, architecture, and the cloud-to-edge AI paradigm shift.
Read more →
·2 min
Voice Agent Latency Optimization: Why Averages Are Lying to You
Deep analysis of three voice AI Agent latency pitfalls: averages hiding tail latency, pipeline jitter stacking, and regional differences. Practical P95/P99 measurement and end-to-end optimization tips.
Read more →
·2 min
Google SDK Accidentally Leaks Gemini 4 Flash: Real Roadmap or Just a Placeholder?
Google's public SDK was found containing Gemini 4 Flash references, sparking developer speculation about next-gen models. We analyze the leak's credibility and what it means.
Read more →
·3 min
Gemini Omni and Nano Banana Model Analysis: Google's Multimodal AI Strategy
Analysis of Google's Gemini Omni full-modal model and Nano Banana lightweight model, exploring their positioning, technical features, and Google's multimodal AI product strategy.
Read more →
·4 min
Total Parameter Count Is Obsolete: Understanding the Two-Number Era of MoE Models
Mixture-of-Experts (MoE) makes single parameter counts obsolete. Learn the difference between total and active parameters, how MoE decouples knowledge capacity from inference cost, and why this matters for model selection.
Read more →
·3 min
Deep Dive into Microsoft's AI Strategy: From Copilot to Autonomous Agents
Deep analysis of Microsoft's AI strategy: from OpenAI investment and Copilot ecosystem to autonomous agents, examining how Microsoft builds full-stack advantages in the tech giant AI race.
Read more →
·2 min
Is Apple's AI Strategy Really a Misstep? A Deep Dive into Industry Skepticism and Apple's Hidden Playbook
Is Apple falling behind in AI? We analyze the criticism of Apple's cautious strategy, the potential of on-device intelligence, and whether its ecosystem integration can deliver a late-mover advantage.
Read more →
·2 min
Why Does Apple Keep Getting AI Wrong? A Deep Dive into the Apple Intelligence Predicament
Deep analysis of Apple's strategic predicament in the generative AI era: Apple Intelligence falling short, Siri upgrades lagging, and how its privacy-first approach conflicts with AI capabilities.
Read more →
·3 min
Running a Small Language Model on an $8 Chip: Pushing the ESP32-S3 to Its Limits
Exploring training and running a small language model (SLM) on an ESP32-S3 microcontroller costing just $8. Learn about model design under extreme hardware constraints, quantization strategies, and edge AI's potential.
Read more →
·3 min
Maple-Preview: 20B Ternary MoE Model Achieves 120 tok/s On-Device Inference on iPhone
Maple-Preview achieves 120 tok/s inference of a 20B ternary MoE model on iPhone. We analyze ternary quantization, MoE sparse activation, and on-device inference challenges.
Read more →