#分布式训练
16 related articles
AMD RCCL GPU-Initiated Networking Integrated into TorchTitan: 15% MoE Communication Performance Boost
AMD integrates RCCL's GPU-Initiated Networking (GIN) into PyTorch TorchTitan, boosting MoE all-to-all communication with up to 30% kernel gains and 12–15% end-to-end training speedup.
ResearchInside Cursor Composer 2 Training: A Complete Breakdown of Its Distributed Reinforcement Learning Architecture
Deep dive into how Cursor trained Composer 2 on Fireworks: async pipeline architecture, MoE numerical precision challenges, Router Replay, and global distributed GPU coordination.
ResearchTechnical Breakdown of Cursor Composer 2's Distributed RL Training
Deep dive into how Cursor trained Composer 2 via distributed RL, covering async pipelines, MoE numerical alignment, global weight sync, and more.
TutorialsNCCL Inspector Explained: Real-Time GPU Cluster Communication Monitoring with Prometheus Integration
Deep dive into NVIDIA NCCL Inspector for real-time GPU cluster communication monitoring with Prometheus integration, covering straggler detection, alerting, and Grafana visualization for distributed training optimization.
Product ReviewsCube Studio Deep Dive: Tencent's Open-Source One-Stop MLOps Platform
Deep dive into Cube Studio, Tencent Music's open-source one-stop AI platform, covering architecture design, distributed training, large model fine-tuning and inference, and domestic chip adaptation.
Deep DivesDecoupled DiLoCo Explained: Making Large-Scale GPU Training Resilient to Failures
Deep dive into Decoupled DiLoCo distributed training: how decoupling training units enables fault tolerance, letting large-scale AI training continue through node failures and reducing downtime loss from 100% to 1%.
Product ReviewsCube Studio: A Comprehensive Analysis of Tencent's Open-Source Cloud-Native AI Platform
Deep dive into Tencent Music's open-source Cube Studio cloud-native AI platform, covering distributed training, LLM fine-tuning & inference, Pipeline orchestration, and domestic hardware adaptation.
Product ReviewsCube Studio: Tencent's Open-Source One-Stop AI Platform — A Deep Dive into Full MLOps Lifecycle
Deep dive into Tencent Music's open-source Cube Studio cloud-native AI platform, covering Notebook development, Pipeline orchestration, distributed training, LLM fine-tuning, inference deployment, and domestic hardware adaptation for full MLOps lifecycle.
Product ReviewsCube Studio: Deep Dive into Tencent's Open-Source Cloud-Native All-in-One AI Platform
Deep dive into Cube Studio, Tencent's open-source cloud-native AI platform covering the full MLOps lifecycle from data labeling to large model training and inference deployment.
Product ReviewsCube Studio: Tencent's Open-Source All-in-One AI Platform Covering the Full Pipeline from Large Model Training to Inference
Deep dive into Tencent Music's open-source Cube Studio cloud-native AI platform, covering distributed training, LLM fine-tuning, vLLM inference, VGPU virtualization, and Huawei Ascend adaptation.
Product ReviewsDeep Dive into Cube Studio: Tencent's Open-Source All-in-One AI Platform
Deep dive into Tencent's open-source AI platform Cube Studio, covering distributed training, large model fine-tuning and inference, Pipeline orchestration, VGPU virtualization, and Huawei Ascend support for enterprise cloud-native MLOps.
Product ReviewsCube Studio Deep Dive: Tencent's Open-Source One-Stop Cloud-Native AI Platform
Deep dive into Tencent's open-source AI platform Cube Studio, covering distributed training, LLM fine-tuning, inference deployment, VGPU virtualization, and domestic hardware support for enterprise MLOps.
Product ReviewsCube Studio Deep Dive: Tencent's Open-Source Cloud-Native AI Platform — A Complete MLOps Workflow Guide
Deep dive into Cube Studio, Tencent Music's open-source cloud-native AI platform covering distributed training, LLM SFT/RLHF fine-tuning, vLLM inference, VGPU virtualization, and domestic chip adaptation for complete MLOps workflows.
Product ReviewsCube Studio Deep Dive: A Practical Guide to Tencent's Open-Source One-Stop MLOps Platform
Deep dive into Tencent's open-source Cube Studio: architecture, large model training/fine-tuning, vLLM inference, distributed training ecosystem, Ascend adaptation, and VGPU compute management for enterprise MLOps.
Product ReviewsCube Studio: A Deep Dive into Tencent's Open-Source Cloud-Native AI Platform
A deep dive into Cube Studio, Tencent Music's open-source cloud-native AI platform covering the full MLOps lifecycle, large model training, distributed frameworks, VGPU virtualization, and domestic hardware support.
Product ReviewsCube Studio: Tencent's Open-Source One-Stop AI Platform Covering Everything from Large Model Training to Inference
In-depth analysis of Cube Studio, Tencent Music's open-source cloud-native AI platform covering distributed training, DeepSeek fine-tuning, vLLM inference, VGPU management, and Huawei Ascend support.