#on-device AI
278 related articles
·3 min
Hadamard Transform: A Deep Dive into the Lightweight Deep Learning Technique That Replaces Multiplication with Addition and Subtraction
Deep dive into how the Hadamard Transform replaces matrix multiplication with only addition and subtraction for lightweight deep learning, covering FWHT principles, edge inference acceleration, and ultra-low-bit LLM quantization.
Read more →
·3 min
Apple Accuses Former Employees of Taking Confidential Data to OpenAI: The AI Talent War Escalates
Apple accuses former employees of taking trade secrets to OpenAI, spotlighting the escalating AI talent war and intellectual property challenges in the tech industry.
Read more →
·2 min
Finamie Review: AI Voice-Powered Expense Tracking — Record Spending by Simply Speaking
Finamie is an AI voice expense tracking app that automatically records and categorizes spending from speech. This review covers its voice recognition, smart analysis features, and key challenges.
Read more →
·3 min
Zen Whisper: A Privacy-First Local Voice Input Tool for Mac — In-Depth Review
Zen Whisper is a fully local Mac voice input tool powered by the Whisper model for offline speech-to-text. Audio never leaves your device. Supports dictation anywhere, voice memos, and media transcription.
Read more →
·4 min
Running an 80B Large Model on Mac with Only 4.3GB of Memory: Extreme Compression Techniques Explained
Deep dive into how an 80B-parameter LLM runs on Mac with only 4.3GB memory, covering ultra-low-bit quantization, sparsity, memory mapping, and implications for privacy and edge AI.
Read more →
·3 min
Nightcrawler: Deep Dive into an AI Penetration Testing Agent Running Locally on Smartphones
Deep analysis of Nightcrawler, an AI penetration testing agent running entirely on smartphones. Exploring how on-device AI empowers cybersecurity testing, its architecture, use cases, and risks.
Read more →
·2 min
Snapdown: A Local AI Tool for Mac That Converts Screenshots to Markdown with One Click
Snapdown is a local AI tool for Mac that converts screenshots to structured Markdown with one click, preserving headings, tables, and lists. Runs on Apple Silicon with no cloud dependency.
Read more →
·2 min
yapyap: A Local-First Open-Source Meeting Recording and Transcription Tool
yapyap is a local-first open-source meeting recording tool supporting transcription, speaker diarization, and AI summaries—all running locally with no cloud uploads or subscriptions required.
Read more →
·2 min
Why Does Apple Mail Connect to iCloud Servers When Sending Non-iCloud Emails? A Technical Explanation
When using Apple Mail to send Gmail or other non-iCloud emails, the system still connects to iCloud servers. This article explains the technical reasons including Mail Privacy Protection, APNs, and iCloud Keychain.
Read more →
·3 min
Hand Wave: Real-Time Sign Language Translation on Meta Smart Glasses for Barrier-Free Communication
Hand Wave uses Meta smart glasses' camera and open-source AI neural networks to translate sign language into text and speech in real time, supporting iOS and Web platforms.
Read more →
·3 min
CoachAI: An AI Personal Trainer App That Corrects Your Form in Real Time Using Your iPhone Camera
CoachAI is an iOS fitness app using pose estimation to provide automatic rep counting and real-time form correction via iPhone camera. A deep dive into its tech, features, and competition.
Read more →
·3 min
Capptivo: A Detailed Review of the Free Open-Source Screen Recording & Presentation Editor
Capptivo is a free open-source screen recorder and presentation editor for macOS, Windows, and Linux with cursor-following zoom, local caption burn-in, and no account or subscription required.
Read more →
·2 min
Google Releases Gemini 3.6 Flash and Two Other New Models: Comprehensive Expansion of the Flash Family
Google launches Gemini 3.6 Flash, 3.5 Flash-Lite, and 3.5 Flash Cyber, further expanding its lightweight AI product line. Analysis of positioning, differentiation strategy, and developer impact.
Read more →
·2 min
ESP32 Mini Robot: A Complete Guide to Wireless Real-Time Programming with MicroBlocks
An ESP32-based mini robot using MicroBlocks for wireless real-time programming—no flashing needed. Exploring the tech choices, development experience, and educational value of this low-cost project.
Read more →
·4 min
17M-Parameter Transformer for Blood Glucose Prediction: Open-Source Diabetes AI Model Explained
An open-source blood glucose prediction model using BERT-style Transformer architecture with only 17M parameters, running on mobile devices with DILATE and Pinball loss for 2-hour glucose forecasting.
Read more →
·2 min
Google Kills Another App: Is the All-in-on-Gemini Integration Strategy Smart or Risky?
Google kills another app before launch, sparking Reddit debate. Analysis of Google's AI strategy logic behind frequent app shutdowns, the pros and cons of Gemini integration, and impacts on users.
Read more →
·5 min
Halo: A Real-Time Anti-Deepfake Tool That Detects AI Face-Swapping in Video Calls
Halo is a local real-time deepfake detection tool that identifies AI-synthesized faces during Zoom, Teams, and Google Meet video calls to prevent face-swapping fraud.
Read more →
·2 min
Yap: A 4MB Open-Source Voice Input Tool That Runs Entirely Locally with Zero Privacy Risk
Yap is a 4MB open-source Mac voice input tool that runs entirely locally using native macOS speech APIs. No internet needed, built with 3000 lines of Swift, MIT licensed and free.
Read more →
·2 min
Expert Chase Launches on Mobile: AI Assistant Deeply Integrated with Apple and Google Ecosystems
Expert Chase launches iOS and Android apps with deep Apple Calendar, Google Calendar, and health data integrations, transforming from a passive Q&A tool into a proactive all-scenario AI life assistant.
Read more →
·2 min
Yap: A 4MB Open-Source Voice Input Tool That Runs Entirely Locally with Zero Privacy Risk
Yap is a 4MB open-source Mac voice input tool that runs entirely locally using native macOS speech APIs. Zero cloud dependency, MIT licensed, built with 3,000 lines of Swift code.
Read more →