#optimizer state offloading
4 related articles
JAX Host Offloading: A Practical Guide…
·2 min
JAX Host Offloading: A Practical Guide to Breaking Through LLM Training Memory Bottlenecks
Memory capacity is the core bottleneck in LLM training. This guide explores JAX-based host offloading — covering optimizer state offloading, activation strategies, PCIe bandwidth trade-offs, and how it complements activation recomputation.
Read more →
·2 min
A Complete Guide to LLM Infrastructure: Core Challenges from GPU Clusters to Inference Optimization
A deep dive into core challenges and key technologies for LLM infrastructure, covering GPU cluster management, inference optimization, distributed training, cost control, and observability.
Read more →
Product Reviews·5 min
Unsloth: The Open-Source Tool That Speeds Up Local LLM Fine-Tuning by 5x
Unsloth is an open-source LLM training tool with 63,000+ GitHub Stars. It supports local fine-tuning of Gemma 4, Qwen3, DeepSeek and more, with Web UI, VRAM optimization, and 2-5x training speedup on consumer GPUs.
Read more →
Product Reviews·3 min
Hugging Face Transformers: A Deep Dive into the AI Open-Source Framework Behind 160K Stars
Deep dive into Hugging Face Transformers: core features, Pipeline API usage, ecosystem synergy, large model support, and future challenges of this 160K-star AI framework.
Read more →