#num_gpu
2 related articles
·3 min
Local LLM Agent Lagging? Lowering num_gpu Is the Key
Local LLM crashing in Agent frameworks? The issue may be num_gpu set too high. Learn what num_gpu really controls (GPU layer offloading, not GPU count) and how to tune it for stable Agent performance.
Read more →
·6 min
Why Is Qwen3 27B So Slow on a 4090? A Hands-On Guide to Local Inference Performance Optimization
RTX 4090 taking over 400 seconds to run Qwen3 27B inference? This article analyzes the core causes—VRAM overflow and CPU offloading drag—and offers targeted fixes.
Read more →