#AllReduce

29 related articles

Jul 29, 2026·3 min

Google's $1 Billion Dark Fiber Deal with Verizon: AI Infrastructure Competition Goes Deep

Google signs a $1B+ dark fiber deal with Verizon to interconnect data centers for AI training and inference. Verizon launches AI Connect, converting central offices into edge compute nodes.

Jul 24, 2026·6 min

Hands-On with Panel AI On-Premises Deployment: One-Click Enterprise Adoption and Unified Compute Cluster Scheduling

In-depth review of Panel AI v1.1.1: second-level installation, no-public-IP networking, batch compute cluster management. Learn how enterprise AI on-premises deployment barriers are dramatically lowered.

Jul 16, 2026·3 min

GPUStack in Action: Complete Guide to Day 0 Deployment of DeepSeek-V4-Flash

Deploy DeepSeek-V4-Flash DSpark on 8× H20-141G using GPUStack's SGLang backend on Day 0. Full walkthrough of Web UI config, parameter tuning, and 200 tokens/sec benchmark results.

Jul 16, 2026·2 min

ExLlamaV3 v1.0.0 Official Release: Faster Inference, Lossless KV Quantization, and Streamlined Dependencies

ExLlamaV3 v1.0.0 releases with lossless KV cache quantization via kernel fusion, removal of flash-attention-2/xformers, major GEMM/GEMV gains, and broader tensor parallelism support.

Jul 13, 2026·2 min

P2P Student GPU Sharing Network: A Full Breakdown of Technical Feasibility and Real-World Challenges

A deep dive into the technical feasibility and real-world challenges of P2P student GPU sharing networks, covering distributed computing, latency, security, and incentive design.

Jul 12, 2026·3 min

SlickToken: A Deep Dive into GPU Fleet and Agentic Workflow Planning

SlickToken is a GPU fleet and agentic workflow planning tool for AI teams, supporting offline simulation, load testing, and capacity planning—no internet required to protect enterprise data.

Jul 12, 2026·3 min

DeepSeek-V4 Flash RL Training Successfully Ported to AMD MI355X GPU: A Complete Breakdown

The Miles team and AMD announce the full port of DeepSeek-V4 Flash RL training to AMD Instinct MI355X GPUs on ROCm, boosting AIME pass@1 from 0.39 to 0.49—a milestone for compute ecosystem diversity.

Jul 11, 2026·7 min

Practical RL Compute Optimization: Core Strategies to Boost CPU and GPU Utilization

An in-depth look at why CPU and GPU utilization is low in RL training, covering vectorized environment parallelism, distributed Actor-Learner architectures, GPU-side simulation (Isaac Gym/Brax), and Ray RLlib practice.

Jul 11, 2026·2 min

AI Agents for SGLang Kernel Optimization: Real-World Performance Gains and Engineering Methodology

SGLang's team converted expert knowledge into agent skills, achieving 71.4% throughput gains, TTFT reduced from 456ms to 168ms. A deep dive into agent-assisted kernel optimization methodology.

Jul 10, 2026·5 min

Real-World Comparison of 6 Open-Source LLMs for On-Premise Deployment: A Selection Guide to Avoid Pitfalls

A hands-on comparison of 6 open-source LLMs (DeepSeek, Qwen3, Zhipu GLM, Kimi K2, MiniMax M3, Tencent Hunyuan 3) for on-premise deployment—covering hardware cost, inference efficiency, and deployment difficulty.

Jul 10, 2026·5 min

TensorRT Multi-Device Inference: Engineering Practices for Breaking Through Single-GPU Memory Bottlenecks

NVIDIA TensorRT now supports multi-device inference via pipeline and tensor parallelism, distributing large models across multiple GPUs to break through single-card memory limits.

Jul 9, 2026·4 min

AI Weekly: GPT-5.6 Launches in Three Tiers, Open-Source Inference Frameworks and Robot Safety Break Through Across the Board

This week in AI: OpenAI launches GPT-5.6 in three tiers (Sol/Terra/Luna) hitting 91.9% on coding benchmarks; DeepSeek and PKU open-source DSpark for 85% faster inference; Prime Intellect trains trillion-param models on just 28 H200s; Anthropic Claude enters Slack.

Jul 9, 2026·6 min

Unsloth Major Update: DeepSeek-V4 Support and a Deep Dive into NVFP4 Quantized Export

Unsloth v0.1.481-beta adds full DeepSeek-V4-Flash support, NVFP4/FP8/imatrix GGUF quantized export, 1.3x faster GRPO, 3-5x faster MoE training, and an OpenAI-compatible API service in Studio.

Jun 6, 2026·3 min

vLLM Deep Dive: How PagedAttention Enables High-Throughput LLM Inference

Deep dive into vLLM's core technologies for high-throughput LLM inference, including PagedAttention memory management, continuous batching, distributed deployment, and comparisons with TensorRT-LLM.

NCCL Multi-GPU Communication Optimization in Practice: A Guide to Scaling HPC High-Performance Computing

Tutorials

May 19, 2026·2 min

NCCL Multi-GPU Communication Optimization in Practice: A Guide to Scaling HPC High-Performance Computing

Deep dive into NVIDIA NCCL multi-GPU communication library principles and optimization strategies, covering AllReduce, NVLink, and GPUDirect RDMA to help HPC and AI developers master scaling from single-node to massive clusters.

GB200 NVL72 Block Scheduling in Practice: How Slurm Squeezes Every Bit of Rack-Level NVLink Performance

Tutorials

May 17, 2026·2 min

GB200 NVL72 Block Scheduling in Practice: How Slurm Squeezes Every Bit of Rack-Level NVLink Performance

Deep dive into how Slurm block scheduling maximizes NVIDIA GB200 NVL72 rack-level NVLink performance through topology-aware allocation, reducing fragmentation and boosting GPU utilization by 15-25%.

NCCL Inspector Explained: Real-Time GPU Cluster Communication Monitoring with Prometheus Integration

Tutorials

May 17, 2026·4 min

NCCL Inspector Explained: Real-Time GPU Cluster Communication Monitoring with Prometheus Integration

Deep dive into NVIDIA NCCL Inspector for real-time GPU cluster communication monitoring with Prometheus integration, covering straggler detection, alerting, and Grafana visualization for distributed training optimization.

NVIDIA Fleet Intelligence Explained: Real-Time Monitoring and Intelligent Optimization for GPU Clusters

Deep Dives

May 17, 2026·3 min

NVIDIA Fleet Intelligence Explained: Real-Time Monitoring and Intelligent Optimization for GPU Clusters

Deep dive into NVIDIA Fleet Intelligence for GPU clusters: real-time visualization, AI anomaly detection, utilization optimization, and energy management to boost large-scale GPU infrastructure efficiency.

Cube Studio Deep Dive: Tencent's Open-Source One-Stop MLOps Platform

Product Reviews

May 16, 2026·4 min

Cube Studio Deep Dive: Tencent's Open-Source One-Stop MLOps Platform

Deep dive into Cube Studio, Tencent Music's open-source one-stop AI platform, covering architecture design, distributed training, large model fine-tuning and inference, and domestic chip adaptation.

Decoupled DiLoCo Explained: Making Large-Scale GPU Training Resilient to Failures

Deep Dives

May 15, 2026·3 min

Decoupled DiLoCo Explained: Making Large-Scale GPU Training Resilient to Failures

Deep dive into Decoupled DiLoCo distributed training: how decoupling training units enables fault tolerance, letting large-scale AI training continue through node failures and reducing downtime loss from 100% to 1%.