605 related articles

Maple-Preview achieves 120 tok/s inference of a 20B ternary MoE model on iPhone. We analyze ternary quantization, MoE sparse activation, and on-device inference challenges.

Deep dive into how the Hadamard Transform replaces matrix multiplication with only addition and subtraction for lightweight deep learning, covering FWHT principles, edge inference acceleration, and ultra-low-bit LLM quantization.

Kimi K3's hype faded within a week of its open-weight release, with cloud subscribers still needing extra credits. We analyze the monetization vs. user experience balance in today's fierce open-source LLM competition.

Zen Whisper is a fully local Mac voice input tool powered by the Whisper model for offline speech-to-text. Audio never leaves your device. Supports dictation anywhere, voice memos, and media transcription.

A U.S. company struck a $100M deal with Ukraine to deploy AI visual lock-on capabilities on 50,000 cheap kamikaze drones, enabling terminal autonomous guidance to defeat electronic warfare jamming.

Alibaba's Qwen3.8-Max-Preview iterates daily with significant frontend development improvements. The team uses an open preview strategy to collect community feedback, promising open-weight release.

Deep dive into how an 80B-parameter LLM runs on Mac with only 4.3GB memory, covering ultra-low-bit quantization, sparsity, memory mapping, and implications for privacy and edge AI.

Chinese open-source AI models are rapidly rising with near-top performance at fraction of cost, dominating local deployment. As the gap shrinks to single digits and OpenAI cuts prices, open source is reshaping AI competition.

Deep dive into the LiveKit Agents open-source framework for building real-time voice AI agents using STT, LLM, and TTS modules with production-ready deployment capabilities.

Deep analysis of Nightcrawler, an AI penetration testing agent running entirely on smartphones. Exploring how on-device AI empowers cybersecurity testing, its architecture, use cases, and risks.

How to build product analytics and evaluation capabilities for AI Agents at the MCP protocol layer, covering session-level tracing, tool call observability, and quality Evals.

Deep dive into Ctruh Studio, an AI-powered no-code 3D creation platform covering AI-generated 3D assets, immersive product showcases, virtual stores, and more for web-based 3D & XR experiences.

CoachAI is an iOS fitness app using pose estimation to provide automatic rep counting and real-time form correction via iPhone camera. A deep dive into its tech, features, and competition.

In-depth analysis of NIST post-quantum standards ML-KEM, ML-DSA, and SLH-DSA, examining quantum threats to RSA/ECC and providing enterprise encryption migration guidance.

Microsoft announces Xbox price hikes up to 43%. Analysis of supply chain pressures, tariff impacts, and Microsoft's strategic shift from hardware sales to Game Pass subscriptions and cloud gaming.

From 1637 Dutch Tulip Mania to today's AI investment boom: analyzing shared traits of tech bubbles, key differences, and a rational framework for investors.

Bolcho AI is a voice AI platform for India's market, supporting Hindi, Tamil and more local languages with ultra-low latency, telephony integration, and flexible BYO model architecture for enterprise AI agents.

A CS student went from Python basics to model deployment in 3-4 months, building an AI portfolio through three real projects. This article breaks down the learning path, project value, and resume optimization strategies.

Dex by Exmergo adds analytics engineering skills to Claude Code, Cursor & other AI assistants via one command, with read-only schema mapping, cost guardrails, and drift detection.

Redis creator antirez open-sources ds4, a pure C local inference engine for DeepSeek 4 Flash and PRO with native Metal, CUDA, and ROCm support, earning nearly 20K GitHub stars.