#on-device AI
293 related articles
·3 min
Apple vs. OpenAI Trade Secret Lawsuit: Evidence Breakdown and Industry Implications
Apple sues OpenAI for trade secret theft. A former engineer's "LOL" message on Apple's internal system may be the key evidence. Analysis of the case and its AI industry impact.
Read more →
·2 min
Local Image-to-3D on Apple Silicon: 20 Seconds, 2GB RAM — Modelr Open-Source App Tested
A developer ports Tencent's Hunyuan3D to Apple MLX. M4 Max benchmarks: shape generation in 20s, 5.6GB peak RAM. Quantized versions run on iPhone. Modelr is the first local image-to-3D app for Apple Silicon.
Read more →
·3 min
CutWire Prism: A Free, Open-Source Node-Based Live Video Mixer Explained
CutWire Prism is a free, open-source node-based live video mixer supporting multi-source input, chroma key, background removal, Lua scripting, and web remote control. Available for Windows and Linux.
Read more →
·2 min
Claude Wrapped Goes Live: Anthropic Launches Annual AI Usage Recap Feature
Anthropic officially rolls out a "reflect" annual recap feature for Claude, similar to Spotify Wrapped, helping users visualize their AI usage data. This piece analyzes its design logic, privacy risks, and the AI humanization trend.
Read more →
·4 min
AI Weekly Recap: Four Major Vendors Cut Prices Together, Copilot's Paid Conversion Rate Just 4.5%
In one week, OpenAI, xAI, Google, and Microsoft all cut AI prices, driving near-frontier inference costs sharply lower. Meanwhile, Microsoft Copilot's paid conversion across 450M seats is under 4.5%, exposing the monetization challenge of general AI assistants.
Read more →
·3 min
The State of Gemini Nano Multilingual Support: When Will Hebrew and Arabic Be Available?
Gemini Nano's on-device AI model currently has limited language support, with no official timeline for RTL languages like Hebrew and Arabic. This article explores the technical bottlenecks, commercial priorities, and future outlook.
Read more →
·3 min
GPT 5.6 + Codex In-Depth Review: Three-Tier Models and Ultra Mode Fully Explained
GPT 5.6 updates Codex with Sol/Terra/Luna model tiers, Ultra thinking mode, 350K context, and stronger autonomous loops. Full hands-on review of all core upgrades.
Read more →
·3 min
Benchmarking LLMs on Smartphones: A Deep Dive into the MELTing Point Benchmark
The MELTing Point paper is the first to evaluate mobile LLM performance in real user scenarios, covering iPhone, Samsung, Pixel and more, testing TinyLlama, Mistral-7B and others—revealing GPU inference gains, 47°C heat warnings, and prefill-decode disaggregation.
Read more →
·2 min
The Rise of Small AI Models: A Guide to Deploying Intelligence in Weak-Network and Offline Environments
Large AI models rely on stable cloud connections and struggle in weak-network, remote, or resource-constrained settings. This article explores how small AI models achieve affordable, reliable, universal AI through offline inference, distillation, and on-device deployment.
Read more →
·3 min
CPU-Native Language Models: Breaking Through Inference Bottlenecks with Memory Bandwidth Co-Design
SiliconLLM builds a CPU-native LLM architecture from scratch, combining selective SSM, ternary (1.58-bit) LUT MLP, and granular MoE, co-designed around the L3 cache bandwidth cliff. Ternary kernels show 4-5x speedup over fp32.
Read more →
·3 min
Apple Executive Explains: Why the Mac Mini Has Become AI Developers' Top Choice for Local Inference
An Apple chip executive explains the surge in Mac Mini demand among AI developers: unified memory architecture breaks the VRAM bottleneck, superior energy efficiency enables long-term local deployment—the Mac Mini is becoming a top pick for local LLM inference.
Read more →
Microsoft's Carbon Emissions Surge 25%…
·3 min
Microsoft's Carbon Emissions Surge 25%: The Environmental Cost of AI Data Centers and the Path Forward
Microsoft's latest sustainability report shows carbon emissions up ~25% from baseline, driven by data center expansion. A deep dive into AI's carbon dilemma and solutions like liquid cooling and nuclear power.
Read more →
·3 min
Building a Local AI Coding Agent on Mac: A Complete Guide with Ollama, OpenCode, and MCP
A complete guide to building a local AI coding agent on a 32GB Mac: Ollama for local inference, OpenCode as the agent framework, and MCP memory servers for cross-session context. Code stays on-device, no subscription fees.
Read more →
·2 min
Gemini 3.5 Pro's Repeated Delays: The Real Logic Behind the LLM Race
Gemini 3.5 Pro's latest delay sparks community debate. This article dives deep into the technical causes, safety review pressures, and expectation-management challenges behind frequent LLM delays.
Read more →
·4 min
Complete Guide to Gesture Control on Huawei Sound X5: From Waving to Switch Songs to Whole-Home Automation
The Huawei Sound X5 is more than a Bluetooth speaker! Learn how to activate wave detection via the Smart Life App for contactless song switching, volume control, AC control, and whole-home automation.
Read more →
·7 min
GPT-5.6 and Grok 4.5 Launch Simultaneously, Meta Unveils Agent-Based Image Model
OpenAI GPT-5.6 expands its preview, xAI Grok 4.5 opens access at the same time, Meta releases the Agent-based Muse Image model and Muse Video model, while Apple and DeepSeek launch in-house AI inference chip programs. A quick look at the week's five biggest AI stories.
Read more →
·2 min
WisprGemma: Fully Local In-Browser Voice Input — Your Audio Never Leaves Your Device
WisprGemma is an open-source, browser-local voice input tool built on WebGPU and Transformers.js. One Gemma model handles speech recognition and text polish — your voice never leaves your device.
Read more →
Apple Sues OpenAI Over Trade Secret Th…
·5 min
Apple Sues OpenAI Over Trade Secret Theft: The Deep Logic Behind a Broken Coopetition
Apple has filed a trade secret lawsuit against OpenAI, fracturing the once-deep partnership between the two tech giants. A deep analysis of talent mobility, tech competition, and AI coopetition.
Read more →
·6 min
Nothing Phone 4B Announced: The First B-Series Phone, Once Again Skipping the US Market
Nothing officially launches its first B-series phone, the Phone 4B, blending 4A and 4A Pro design elements for the entry-level market. It continues the strategy of skipping the US, focusing on price-sensitive markets like India and Europe.
Read more →
·7 min
Rumored Pixel-Wide Price Hike: Watch 5 Starting Price May Rise to $399
Per French leak site Dealabs, Google's Pixel lineup may see across-the-board price hikes. The Pixel Watch 5 41mm could start at $399, with the LTE version reaching $499—nearly 15% higher than the Watch 4.
Read more →