#VRAM usage
315 related articles
·4 min
Laguna S 2.1 Deep Dive: Hands-On Local Deployment of a 118B Parameter Coding Model
In-depth review of Poolside's Laguna S 2.1 open-source coding model: MoE architecture, RL training, DGX Spark local deployment, and real-world agentic coding tests with 8B active parameters.
Read more →
·4 min
Kimi K2/K3 Technical Speculation: Deep Dive into RL Hyperparameters and Multi-Teacher Distillation
Deep analysis of RL hyperparameter tuning challenges and 9-policy multi-teacher distillation in Kimi K2/K3 training, exploring the shift from scale to training craft.
Read more →
·3 min
From RAG to Agent Tuning: A Complete Guide to Deploying LLM Agents
A deep dive into LLM Agent frameworks covering RAG, Agent core components (tools, memory, planning), and Agent Tuning workflows with cost considerations for production deployment.
Read more →
·3 min
Kimi K3 Launch: Performance Rivaling Claude at One-Third the Price, US-China AI Gap Narrows to 3 Months
Moonshot AI launches Kimi K3 reasoning model with performance rivaling Claude and OpenAI's top models at one-third the price. The US-China AI gap narrows from 6-12 months to just 3 months.
Read more →
·3 min
Minecraft Java Edition Raises Recommended RAM to 16GB: What the Vulkan Migration Means
Minecraft Java Edition's recommended RAM jumps to 16GB as the game prepares for a Vulkan graphics API migration. Learn what this means for players and the mod ecosystem.
Read more →
·3 min
Kimi K3 Launches on Ollama Cloud: Free Tier, User Experience, and Developer Guide
Kimi K3 officially launches on Ollama Cloud as an "extra high usage" model. This guide covers free tier quotas, cloud inference experience, technical advantages, and how developers can seamlessly call this high-performance LLM.
Read more →
·3 min
Ollama's Extra Charges for Kimi 3 Spark Community Controversy: Should Open-Source Models Be Free to Use?
Ollama lists Kimi 3 with extra pay-per-use fees, breaking subscription expectations and sparking debate over open-weight models and AI service pricing tiers.
Read more →
·3 min
Is Ollama Pro Worth It? An In-Depth Comparison of the $20 Subscription vs. API Costs
In-depth analysis of Ollama Pro's $20/month subscription value, comparing usage quotas, equivalent API costs, and ZDR privacy policy to help developers decide if it's worth it.
Read more →
·3 min
DeepSeek-OCR Deployment & Fine-Tuning in Practice: From vLLM Inference to Unsloth Fine-Tuning
Complete guide to DeepSeek-OCR from vLLM inference deployment and Unsloth model loading to fine-tuning, covering cloud server setup, GPU selection, and code examples — all on a single 4090 GPU.
Read more →
·3 min
Deep Dive into the Kimi-K3 Technical Report: A Comprehensive Analysis of Architecture, Long-Context Processing, and Reasoning Capabilities
Deep dive into Moonshot AI's Kimi-K3 technical report, analyzing its long-context processing, MoE architecture, reasoning improvements, and its position in global AI competition.
Read more →
·3 min
Deep Dive into the Kimi-K3 Technical Report: Architecture, Long Context, and Reasoning Capabilities
Deep analysis of Moonshot AI's Kimi-K3 technical report covering long context processing, MoE architecture, reasoning capabilities, and China's position in the global AI competition.
Read more →
·3 min
Is Ollama Pro Worth It? A Deep Comparison of the $20 Subscription vs. API Costs
Deep analysis of Ollama Pro's $20/month subscription value, comparing usage quotas, equivalent API costs, and ZDR privacy policy to help developers decide if it's worth it.
Read more →
·3 min
Kimi K3 Local Deployment Guide: Storage Requirements for q4 and q8 Quantization Explained
Detailed analysis of Kimi K3 quantization deployment options, comparing q4 vs q8 storage requirements, precision trade-offs, and hardware configurations for local self-hosting.
Read more →
·3 min
Build RAG and AI Agent Projects at Zero Cost: A Practical Guide to Open-Source Tools
Build high-quality AI projects on a budget. Learn how to use Ollama, Groq, Chroma, and other free open-source tools to build RAG systems and multi-Agent workflows from scratch.
Read more →
·3 min
Ideogram 4.0 Turbo Workflow: An AI Image Generation Solution Balancing Speed and Quality
Detailed look at the Ideogram 4.0 mixed turbo workflow: RTX 4090 inference in just 15 seconds, rivaling Krea2 speed, with stable output up to 8K resolution.
Read more →
·3 min
Ideogram 4.0 Turbo Workflow: An AI Image Generation Solution Balancing Speed and Quality
Detailed look at the Ideogram 4.0 mixed turbo workflow: RTX 4090 tested at just 15s inference, matching Krea2 speed with up to 8K resolution output.
Read more →
·5 min
Ollama Performance Degrades After Connecting to OpenWebUI? A Complete Troubleshooting Guide
Complete guide to troubleshooting Ollama performance degradation with OpenWebUI, covering num_ctx truncation, sampling parameter differences, GPU resource contention, and system prompt interference.
Read more →
·3 min
GLM 5.2 Hands-On: An Open-Source, Low-Cost Model That Rivals Opus
In-depth hands-on review of GLM 5.2: a 753B-parameter open-source model with a 1M-token context, rivaling Opus 4.8 at about one-tenth the price. Full setup guide for Claude Code and Cursor.
Read more →
·3 min
Laguna S 2.1: The Open-Source Coding Model That's 14x Smaller Yet Stronger
Poolside releases Laguna S 2.1, an open-source agentic coding model: 118B total params with only 8B active, scoring 40.4% on DeepSWE — ~4.5x DeepSeek V4 Pro Max. Supports 1M-token context, deployable on a single workstation.
Read more →
·6 min
How the Creator of Redis Squeezed a 284B-Parameter DeepSeek into an Ordinary Laptop
Redis creator antirez built DS4 "Dwarf Star," a pure-C inference engine, using asymmetric quantization to compress DeepSeek V4 Flash from 500GB to 80.8GB for local 128GB unified-memory deployment at 26.7 tokens/sec.
Read more →