#DeepSpeed
36 related articles
·5 min
The Complete Learning Path to Understanding the Kimi K3 Technical Report
A systematic learning path for understanding the Kimi K3 technical report, covering MoE, MLA, distributed training, and modern post-training techniques.
Read more →
·3 min
The Real Daily Life of MLE and MLOps Engineers: Key Differences Between Three Roles and Career Paths
An in-depth look at the real daily work of data scientists, MLEs, and MLOps engineers — covering responsibilities, essential tools, and career paths to help you find your direction in AI.
Read more →
JAX Host Offloading: A Practical Guide…
·2 min
JAX Host Offloading: A Practical Guide to Breaking Through LLM Training Memory Bottlenecks
Memory capacity is the core bottleneck in LLM training. This guide explores JAX-based host offloading — covering optimizer state offloading, activation strategies, PCIe bandwidth trade-offs, and how it complements activation recomputation.
Read more →
·2 min
Distributed AI Systems: A Practical Engineering Guide to Training, Inference, and Production Deployment
A deep dive into distributed AI systems engineering: data/model/tensor parallelism for training, KV cache, quantization, elastic scaling for inference, and cloud deployment with Kubernetes, Ray, and DeepSpeed.
Read more →
·5 min
The Five Unsolved Challenges of Production MLOps: A Deep Dive into GPU Scheduling, Fault-Tolerant Training, and Model Observability
A deep dive into the five genuinely tough challenges of production MLOps: fault-tolerant training on Spot instances, cross-team GPU scheduling, data reproducibility, model observability, and inference cost optimization.
Read more →
·2 min
NYT Accuses OpenAI of Hiding Billions of Logs: A Deep Dive into the AI Copyright Lawsuit
NYT accuses OpenAI of faking inability to search training data and hiding billions of logs. A deep dive into the allegations, legal implications, and impact on AI copyright compliance.
Read more →
·2 min
Unsloth v0.1.461-beta: Fix for Local GGUF Vision Model Loading
Unsloth v0.1.461-beta fixes local GGUF vision model loading on llama-server in Studio, adds variant directory companion file lookup for stable multimodal deployment.
Read more →
·5 min
Nonuniform Tensor Parallelism: NVIDIA's New Fault-Tolerance Approach to Boost LLM Training Goodput
NVIDIA introduces Nonuniform Tensor Parallelism, letting GPUs bear different compute loads so training can continue without checkpoint rollback during hardware failures—boosting LLM training Goodput and fault tolerance at scale.
Read more →
·5 min
Reproducing GitHub Projects from Scratch: A Practical Step-by-Step Guide
A complete guide to reproducing GitHub projects from scratch: due diligence, virtual environments, dependency installation, script interpretation, and breakpoint debugging — helping grad students and junior developers run others' code efficiently.
Read more →
·2 min
A Complete Guide to LLM Infrastructure: Core Challenges from GPU Clusters to Inference Optimization
A deep dive into core challenges and key technologies for LLM infrastructure, covering GPU cluster management, inference optimization, distributed training, cost control, and observability.
Read more →
Tutorials·2 min
Gemma 4 Complete Guide: The Apache 2.0 Open-Source Agent Powerhouse
In-depth analysis of Google's Gemma 4 open-source models: 31B, 26B MOE, and 14B/12B benchmarks, deployment guides for all platforms, and MS-Swift fine-tuning tutorial for building local Agent workflows.
Read more →
Tutorials·2 min
Hermes + Qwen3.6 Local Deployment Tutorial: Build Your Private AI Agent at Zero Cost
Step-by-step tutorial to deploy Hermes Agent with Qwen3.6 open-source LLM locally. Covers WSL setup, model download, Telegram bot integration for a zero-cost private AI Agent.
Read more →
Tutorials·4 min
NCCL Inspector Explained: Real-Time GPU Cluster Communication Monitoring with Prometheus Integration
Deep dive into NVIDIA NCCL Inspector for real-time GPU cluster communication monitoring with Prometheus integration, covering straggler detection, alerting, and Grafana visualization for distributed training optimization.
Read more →
Product Reviews·4 min
Cube Studio Deep Dive: Tencent's Open-Source One-Stop MLOps Platform
Deep dive into Cube Studio, Tencent Music's open-source one-stop AI platform, covering architecture design, distributed training, large model fine-tuning and inference, and domestic chip adaptation.
Read more →
Tutorials·3 min
WSL2 Installation Guide: Complete Tutorial from Setup to Non-System Drive Migration
Complete WSL2 installation tutorial covering enabling Windows features, installing Ubuntu 22.04, and migrating to a non-system drive. Includes PowerShell commands and user configuration for AI developers.
Read more →
Product Reviews·3 min
Cube Studio: A Comprehensive Analysis of Tencent's Open-Source Cloud-Native AI Platform
Deep dive into Tencent Music's open-source Cube Studio cloud-native AI platform, covering distributed training, LLM fine-tuning & inference, Pipeline orchestration, and domestic hardware adaptation.
Read more →
Product Reviews·2 min
Unsloth: 80% VRAM Reduction — The Best Open-Source Tool for Local LLM Fine-Tuning
Unsloth is an open-source LLM training tool with 63K+ GitHub stars, supporting Gemma 4, Qwen 3, DeepSeek. Reduces VRAM by 50–80%, enabling RTX 4090 to fine-tune 7B models with a no-code Web UI.
Read more →
Product Reviews·3 min
Cube Studio: Tencent's Open-Source One-Stop AI Platform — A Deep Dive into Full MLOps Lifecycle
Deep dive into Tencent Music's open-source Cube Studio cloud-native AI platform, covering Notebook development, Pipeline orchestration, distributed training, LLM fine-tuning, inference deployment, and domestic hardware adaptation for full MLOps lifecycle.
Read more →
Product Reviews·3 min
GitHub 8000+ Stars: A Deep Dive into awesome-LLM-resources — The Most Comprehensive Large Language Model Resource Collection
Deep dive into the GitHub 8000+ star project awesome-LLM-resources, covering LLM training, multimodal generation, AI Agents, MCP protocol, AI-assisted coding, and more for developers.
Read more →
Deep Dives·1 min
Hugging Face Transformers: A Complete Guide to the AI Model Framework with 160K Stars
Explore Hugging Face Transformers, the 160K-star open-source AI framework powering text, vision, audio, and multimodal models with elegant APIs and massive community support.
Read more →