#VRAM usage
315 related articles
·6 min
How the Creator of Redis Squeezed a 284B-Parameter DeepSeek into an Ordinary Laptop
Redis creator antirez built DS4 "Dwarf Star," a pure-C inference engine, using asymmetric quantization to compress DeepSeek V4 Flash from 500GB to 80.8GB for local 128GB unified-memory deployment at 26.7 tokens/sec.
Read more →
·4 min
Dify Local Deployment Guide: One-Click Private AI Platform with Docker
Step-by-step guide to deploying Dify AI platform locally with Docker. Covers Linux, Windows, macOS setup, docker compose launch, and first-time initialization in under 30 minutes.
Read more →
·6 min
Tongyi Qianwen Qwen-Image-3.0: The Leap of AI Image Generation from Toy to Productivity Tool
Tongyi Qianwen Qwen-Image-3.0 image generation model gets a comprehensive upgrade: supporting 4,500-token ultra-long instructions, pixel-level detail rendering, 12-language knowledge understanding, and ancient painting restoration. This article analyzes its three core capabilities.
Read more →
·3 min
InvokeAI In-Depth Review: Can It Replace SD WebUI and ComfyUI?
A hands-on InvokeAI review covering installation, VRAM optimization, infinite canvas, node workflows, and model management — with an objective comparison to SD WebUI and ComfyUI.
Read more →
·7 min
The Complete AI Character LoRA Training Workflow: Hands-On Multi-Character Consistency Generation with Local Deployment
A detailed guide to a complete local AI character generation workflow: from the five golden rules of LoRA training and automated ComfyUI dataset construction to hands-on comparisons of Crea2, Ideogram4, and Wan for multi-character same-frame interaction—all running free on personal hardware.
Read more →
·2 min
Agent A1 Open Source: 35B MoE Local Inference Speed Test & Deployment Guide
Agent A1 is a 35B MoE open-source model from Shanghai's Intern Science, activating only 3B params. Hits 95 tok/s on M4 Mac Studio. Supports 256K context, tool calling, and free local deployment via Ollama.
Read more →
Build a Free Whisper Transcription Too…
·2 min
Build a Free Whisper Transcription Tool with Cloudflare Workers AI
Build a free speech transcription tool using Cloudflare Workers AI and Whisper — no GPU, zero ops cost. Ideal for indie developers needing affordable voice-to-text.
Read more →
·3 min
V100 GPU Showdown: 4×16G PCIe vs. 2×32G SXM — Which Gives You More Bang for Your Buck?
Benchmarking 4×V100 16G PCIe vs. 2×V100 32G SXM adapter for local LLM inference. Prefill speed, decode speed, power limits, and bandwidth bottlenecks analyzed.
Read more →
·2 min
Qwen3 Fine-Tuning in Practice: A Complete Guide to Local Deployment and Domain Training
A hands-on guide to LLM fine-tuning: from understanding model weights to local Qwen3 deployment, dataset preparation, and domain-specific training. Build a complete AI engineering skill set.
Read more →
·3 min
What Is a Large Language Model, Really? The Core Principles Explained Through the Lens of Functions
Demystify large language models using middle-school math: LLMs are complex functions, training solves for parameters, and inference predicts next-token probabilities.
Read more →
·3 min
GPT-5.6 Inference at 18x Speed: OpenAI's Compute Gamble and Business Logic
Why is OpenAI pushing its most powerful model to 750 tokens/s? A deep dive into GPU vs. Cerebras chip cost trade-offs, the $10B compute deal, and how speed, intelligence, and token efficiency are reshaping the AI landscape.
Read more →
·3 min
Ornith 9B/35B Hands-On: A New Local Deployment Option for Code Agents
Ornith 1.0 by Deep Reinforce reinforces Qwen 3.5 for code agents. We test Ornith 9B & 35B MoE on Chinese writing, logic, and invoice OCR, with full llama.cpp deployment guide.
Read more →
·2 min
MiniMax M3 Local Deployment: 23B Active Parameters ≠ 23GB VRAM — A Complete Guide to MoE Architecture
MiniMax M3 is a 428B MoE model. Its 23B active parameters reflect per-token compute, not VRAM needs. Learn the MoE trade-offs, quantization options, and deployment paths to avoid the most common misconception.
Read more →
·2 min
OpenSpiel 2.0 Released: Reinforcement Learning Framework Fully Embraces Large Language Models
OpenSpiel 2.0 by Google DeepMind adds LLM fine-tuning examples, MCP tool server, JSON trajectories, AlphaZero on JAX, 19 new games, and Windows support.
Read more →
AirLLM: How a 4GB GPU Can Run a 70B Mo…
·2 min
AirLLM: How a 4GB GPU Can Run a 70B Model — Core Principles and Use Cases
AirLLM is an open-source project that uses layer-by-layer inference to run 70B LLMs on a single 4GB GPU. Learn how it works, its tradeoffs, and ideal use cases.
Read more →
·2 min
The Truth Behind Anthropic's Account Bans: Client Detection Logic and a Wave of AI Model Launches
Unpacking the technical truth behind Anthropic's account bans: hidden timezone and proxy detection logic sparks privacy debate. Plus Claude Sonnet 5, Linux support, and new releases from OpenAI, NVIDIA, and Google DeepMind.
Read more →
·2 min
Farewell Perplexity: Why a Free User Left and What It Reveals About AI Search Monetization
A Reddit user's Perplexity farewell exposes AI search's core tension: free trials hook users, then reasoning model quotas drive them away. Here's what it means for the industry.
Read more →
·3 min
GPT-5.6 Practical Guide: 7 Tips to Save Tokens and Boost Efficiency
7 practical GPT-5.6 optimization tips for Codex: control context windows, choose thinking modes, limit sub-agents, and trim agents.md to save tokens and cut costs.
Read more →
·3 min
Cherry Studio + MCP: A Practical Guide to Building AI Agents with Local Deployment
Learn how to build an automated AI agent using Cherry Studio, MCP protocol, and locally deployed models — covering DeepSeek integration, web scraping, and private knowledge base setup.
Read more →
·3 min
Complete Guide to Deploying LLMs Locally on RobotCore Mini: From Ollama Installation to Web Interface Setup
A complete guide to deploying LLMs locally on RobotCore Mini using Ollama — covering model pulling, CLI verification, Web backend setup, and LAN access.
Read more →