#ZeRO optimizer
85 related articles
·2 min
Advanced Claude Code: 5 Skill Techniques for Building Efficient AI Workflows
5 advanced Claude Code Skill techniques — Prompt Optimizer, Deep Interview, Real Plan, Code Simplifier, and Skill Creator — to build reusable AI workflows that reduce rework and boost precision.
Read more →
·2 min
LlamaFactory: A Comprehensive Guide to the Open-Source Framework for Unified Fine-Tuning of 100+ LLMs
Deep dive into LlamaFactory, an open-source unified fine-tuning framework supporting 100+ LLMs and VLMs with LoRA, QLoRA, RLHF methods, Web UI, 71K+ GitHub Stars, accepted at ACL 2024.
Read more →
Deep Dives·3 min
Deep Dive into Hermes Agent Self-Evolution: The GIPA Algorithm and Engineering Practice
Deep analysis of NousResearch's Hermes Agent Self Evolution project: GIPA genetic Pareto prompt evolution algorithm, six-step optimization loop, and five guardrail mechanisms for real-world Agent self-evolution.
Read more →
Tutorials·2 min
Deep Learning Beginner Tutorial: From Neural Network Fundamentals to Image Recognition in Three Days
A systematic review of a three-day deep learning crash course covering neural network math, gradient descent, backpropagation, TensorFlow, CNNs, and transfer learning with practical tips.
Read more →
Tech Frontiers·2 min
Must-Know AI Skills for Software Testing Interviews in 2026: Four Core Competencies & Top Interview Questions Explained
In 2026, AI skills are a hard requirement for software testing roles. Learn the four core competencies enterprises demand, top interview questions with answer frameworks, and a complete learning path.
Read more →
Tutorials·4 min
NCCL Inspector Explained: Real-Time GPU Cluster Communication Monitoring with Prometheus Integration
Deep dive into NVIDIA NCCL Inspector for real-time GPU cluster communication monitoring with Prometheus integration, covering straggler detection, alerting, and Grafana visualization for distributed training optimization.
Read more →
Tutorials·4 min
NVIDIA Model Optimizer Post-Training Quantization (PTQ) Practical Guide
A deep dive into NVIDIA Model Optimizer's PTQ workflow, covering INT8/INT4 quantization principles, calibration methods, RTX GPU optimization, and best practices for deploying quantized LLMs on consumer GPUs.
Read more →
Product Reviews·4 min
Cube Studio Deep Dive: Tencent's Open-Source One-Stop MLOps Platform
Deep dive into Cube Studio, Tencent Music's open-source one-stop AI platform, covering architecture design, distributed training, large model fine-tuning and inference, and domestic chip adaptation.
Read more →
Deep Dives·3 min
Decoupled DiLoCo Explained: Making Large-Scale GPU Training Resilient to Failures
Deep dive into Decoupled DiLoCo distributed training: how decoupling training units enables fault tolerance, letting large-scale AI training continue through node failures and reducing downtime loss from 100% to 1%.
Read more →
Product Reviews·3 min
Cube Studio: A Comprehensive Analysis of Tencent's Open-Source Cloud-Native AI Platform
Deep dive into Tencent Music's open-source Cube Studio cloud-native AI platform, covering distributed training, LLM fine-tuning & inference, Pipeline orchestration, and domestic hardware adaptation.
Read more →
Expert Opinions·3 min
Reinventing the Wheel: Why Building From Scratch Is the Shortcut to the Technical Frontier
Developer Andrew Quinn compressed a 3GB SQLite database into a 7MB FST file, sharing a profound insight: reinventing four or five wheels by hand beats passive study at pushing you to the technical frontier.
Read more →
Product Reviews·3 min
Cube Studio: Tencent's Open-Source One-Stop AI Platform — A Deep Dive into Full MLOps Lifecycle
Deep dive into Tencent Music's open-source Cube Studio cloud-native AI platform, covering Notebook development, Pipeline orchestration, distributed training, LLM fine-tuning, inference deployment, and domestic hardware adaptation for full MLOps lifecycle.
Read more →
Product Reviews·3 min
GitHub 8000+ Stars: A Deep Dive into awesome-LLM-resources — The Most Comprehensive Large Language Model Resource Collection
Deep dive into the GitHub 8000+ star project awesome-LLM-resources, covering LLM training, multimodal generation, AI Agents, MCP protocol, AI-assisted coding, and more for developers.
Read more →
Product Reviews·4 min
Cube Studio: Tencent's Open-Source All-in-One AI Platform Covering the Full Pipeline from Large Model Training to Inference
Deep dive into Tencent Music's open-source Cube Studio cloud-native AI platform, covering distributed training, LLM fine-tuning, vLLM inference, VGPU virtualization, and Huawei Ascend adaptation.
Read more →
Product Reviews·3 min
awesome-LLM-resources: Deep Dive into a GitHub 8000+ Star LLM Resource Collection
Deep dive into GitHub's 8000+ star project awesome-LLM-resources, covering AI Agents, model training, MCP protocol, multimodal generation and more across 10 core LLM directions.
Read more →
Product Reviews·4 min
Deep Dive into Cube Studio: Tencent's Open-Source All-in-One AI Platform
Deep dive into Tencent's open-source AI platform Cube Studio, covering distributed training, large model fine-tuning and inference, Pipeline orchestration, VGPU virtualization, and Huawei Ascend support for enterprise cloud-native MLOps.
Read more →
Product Reviews·4 min
Cube Studio Deep Dive: Tencent's Open-Source One-Stop Cloud-Native AI Platform
Deep dive into Tencent's open-source AI platform Cube Studio, covering distributed training, LLM fine-tuning, inference deployment, VGPU virtualization, and domestic hardware support for enterprise MLOps.
Read more →
Product Reviews·4 min
Unsloth: The Open-Source Tool That Makes Local LLM Fine-Tuning 5x Faster
Unsloth is an open-source LLM fine-tuning tool with 63K+ GitHub stars. Supporting Gemma 4, Qwen 3, and DeepSeek, it boosts training speed 2-5x and cuts VRAM by 80% via LoRA/QLoRA, with a Web UI for easy local fine-tuning.
Read more →
Product Reviews·5 min
Unsloth: The Open-Source Tool That Speeds Up Local LLM Fine-Tuning by 5x
Unsloth is an open-source LLM training tool with 63,000+ GitHub Stars. It supports local fine-tuning of Gemma 4, Qwen3, DeepSeek and more, with Web UI, VRAM optimization, and 2-5x training speedup on consumer GPUs.
Read more →
Product Reviews·5 min
Hugging Face Transformers: Deep Dive into the 160K-Star Open Source Framework
Deep dive into Hugging Face Transformers, covering core features, API design, model ecosystem, and practical code examples. Learn how this 160K-Star project lowers AI barriers and drives democratization across LLMs, computer vision, and multimodal AI.
Read more →