#MLX framework
28 related articles
·2 min
Qwen Scribe: A Deep Dive into the Local Speech Transcription Tool for Apple Silicon
Qwen Scribe is a local speech transcription tool optimized for Apple Silicon, running fully offline with Qwen models. Explore its technical features, privacy benefits, and comparison with Whisper.
Read more →
·2 min
Qwen Scribe: A Deep Dive into the Local Speech Transcription Tool for Apple Silicon
Qwen Scribe is a local speech transcription tool optimized for Apple Silicon, powered by Qwen models for fully offline use. Explore its technical features, privacy benefits, and comparison with Whisper.
Read more →
·2 min
Reverse Engineering Apple's ANE: Open-Source Project Enables On-Device Training on the Neural Engine
Deep dive into the maderix/ANE GitHub project that reverse engineers Apple's private APIs to enable neural network training on the Apple Neural Engine, exploring its technical approach, efficiency gains, compliance risks, and implications for on-device AI.
Read more →
·4 min
Colibri: Running a 744-Billion-Parameter LLM on an Ordinary Laptop
Colibri uses MoE hot-cold separation and 4-bit quantization to run 744B-parameter models like GLM 5.2 on consumer hardware. Learn about its three-tier memory architecture and speculative decoding.
Read more →
·3 min
Apple Silicon LLM Inference Speed Benchmarks: A Complete Guide to Local Large Model Performance on Mac
In-depth analysis of Apple Silicon local LLM inference speed benchmarks covering M-series memory bandwidth, model quantization, MLX framework optimization, and Mac configuration guidance.
Read more →
·3 min
Zero-Cost VibeCoding: Complete Guide to Connecting Local Ollama Models to Codex
Step-by-step guide to running local open-source models (Qwen3/Gemma) with Ollama, connecting to Codex via CC Switch for zero-token AI coding. Works on a 6GB VRAM laptop.
Read more →
·1 min
Apple's Vibe Coding Showcase: What Did College Students Build with Mac + AI?
Apple hosted a college AI showcase in Guangzhou where students used Mac and AI tools to build a smart anti-sedentary chair, AR robotic arm, dental simulator, and more. A deep dive into Vibe Coding and Apple's AI hardware strategy.
Read more →
·3 min
Open-Source Dynamic Workflows: How awman Enables Multi-Model Collaborative AI Programming
awman's --dynamic flag enables cross-framework dynamic workflows with multi-model collaboration. Explore its leader agent architecture, shared context design, and auto fault-tolerance mechanisms.
Read more →
·3 min
Bonsai-27B Extreme Quantization: Running 1-bit LLMs on Consumer Hardware
Bonsai-27B supports binary/ternary extreme quantization for 27B LLMs running on 8GB VRAM. Covers llama.cpp upstream progress, RTX 4060 benchmarks (30 t/s), and real-world limitations.
Read more →
·4 min
Running Qwen3.6 27B Locally on a Single RTX 3090: A Complete Guide to Cloud-Rivaling Performance
One used RTX 3090, one 16.8GB GGUF file, and Qwen3.6 27B runs locally offline. SWE-bench score of 77 rivals Claude Sonnet. MTP boosts speed to 59 tok/s. Full local AI coding assistant deployment guide.
Read more →
Apple M7 Ultra Chip Leaked: Can 1.5TB …
·2 min
Apple M7 Ultra Chip Leaked: Can 1.5TB Unified Memory Reshape Local AI Inference?
Reddit leaks suggest Apple's M7 Ultra chip could feature up to 1.5TB unified memory. We analyze the architecture, pricing debate, bandwidth limits, and ecosystem trade-offs for local LLM inference.
Read more →
·2 min
QuantaMind: An Open-Source Tool for Testing AI Agent Reliability Locally
QuantaMind is a free, open-source local AI Agent reliability testing tool using pass^k scoring and deterministic evaluation, supporting Ollama, llama.cpp, vLLM, and more.
Read more →
·2 min
Local Image-to-3D on Apple Silicon: 20 Seconds, 2GB RAM — Modelr Open-Source App Tested
A developer ports Tencent's Hunyuan3D to Apple MLX. M4 Max benchmarks: shape generation in 20s, 5.6GB peak RAM. Quantized versions run on iPhone. Modelr is the first local image-to-3D app for Apple Silicon.
Read more →
·3 min
Ornith 1.0 9B Model Local Test: Tower Defense Game Exposes Small Model Coding Limitations
Hands-on test of Ornith 1.0 9B open model on a 16GB M4 Mac mini. A tower defense game task reveals the precision limits of small-parameter models vs 35B.
Read more →
How Fixing Three Bugs Made Qwen3.5-122…
·3 min
How Fixing Three Bugs Made Qwen3.5-122B Run Reliably on Mac Studio
A developer fixed three critical bugs to make Qwen3.5-122B run reliably as a daily driver on Mac Studio. Explore memory management, inference stability, and quantization precision.
Read more →
·3 min
Apple Executive Explains: Why the Mac Mini Has Become AI Developers' Top Choice for Local Inference
An Apple chip executive explains the surge in Mac Mini demand among AI developers: unified memory architecture breaks the VRAM bottleneck, superior energy efficiency enables long-term local deployment—the Mac Mini is becoming a top pick for local LLM inference.
Read more →
·6 min
Unsloth Major Update: DeepSeek-V4 Support and a Deep Dive into NVFP4 Quantized Export
Unsloth v0.1.481-beta adds full DeepSeek-V4-Flash support, NVFP4/FP8/imatrix GGUF quantized export, 1.3x faster GRPO, 3-5x faster MoE training, and an OpenAI-compatible API service in Studio.
Read more →
·3 min
Ornith 9B Tested: Can a 16GB Mac Mini Handle Local AI Coding?
Tested Ornith 9B on a 16GB M4 Mac Mini: LM Studio setup, tower defense game vs. 35B, and honest insights into small-model accuracy limits for local AI coding.
Read more →
·4 min
Anthropic Dynamic Workflows Explained: When to Use Them and Pitfalls to Avoid
Deep dive into Anthropic Dynamic Workflows: core mechanisms, differences from single Agent and Sub-Agent patterns, and a decision tree for when to use them vs. when to avoid burning tokens.
Read more →
·4 min
Local Deployment of Claude Code: Principles and Practical Guide for Three Approaches
A detailed guide to locally deploying Claude Code with three approaches (LM Studio, Ollama, vLLM), covering architecture, protocol translation, hardware selection, and model recommendations.
Read more →