#GPU kernel optimization
227 related articles
Industry Insights·2 min
AMD MI355X Beats B200: Full-Stack Optimization Breakdown for 5% Lower TCO on DeepSeek-R1 Inference
AMD Instinct MI355X achieves 5% lower TCO than NVIDIA B200 on DeepSeek-R1 disaggregated inference via SGLang+MoRI full-stack optimization with 1.25x per-GPU throughput.
Read more →
Industry Insights·2 min
NVIDIA Dynamo Snapshot: A Snapshot Recovery Solution for GPU Inference Cold Start Problems
Deep dive into how NVIDIA Dynamo Snapshot reduces LLM inference cold start time from minutes to seconds via GPU state snapshot and recovery, covering Kubernetes integration and elastic inference.
Read more →
Industry Insights·2 min
NVIDIA Blackwell Sets New STAC-AI Records for Financial LLM Inference
NVIDIA Blackwell GPU sets new LLM inference records in STAC-AI financial benchmark. Explore Blackwell architecture advantages, TensorRT-LLM co-optimization, and LLM applications in trading and risk management.
Read more →
Research·3 min
Inside Cursor Composer 2 Training: A Complete Breakdown of Its Distributed Reinforcement Learning Architecture
Deep dive into how Cursor trained Composer 2 on Fireworks: async pipeline architecture, MoE numerical precision challenges, Router Replay, and global distributed GPU coordination.
Read more →
Product Reviews·1 min
NVIDIA CompileIQ: Auto-Tuning Compiler Options to Squeeze Every Drop of GPU Kernel Performance
Deep dive into NVIDIA CompileIQ auto-tuning tool that intelligently searches compiler option combinations to find optimal build parameters for CUDA kernels.
Read more →
Tutorials·1 min
NVIDIA CUDA Tile: A Detailed Look at the New Tile-Based GPU Programming Paradigm
In-depth analysis of NVIDIA's new CUDA Tile programming model: how tile-based GPU kernel development integrates with C++, optimizes data locality, and accelerates Tensor Core computation for HPC, deep learning, and AI inference.
Read more →
Research·2 min
Technical Breakdown of Cursor Composer 2's Distributed RL Training
Deep dive into how Cursor trained Composer 2 via distributed RL, covering async pipelines, MoE numerical alignment, global weight sync, and more.
Read more →
Tutorials·2 min
CSS text-shadow Smooth Rendering Optimization: Say Goodbye to Jagged Edges and Unlock Text Effect Potential
Major browsers have optimized the CSS text-shadow rendering engine for sub-pixel smoothing and GPU acceleration. Learn the improvements, neon effects, and performance best practices.
Read more →
Tutorials·2 min
Hermes + Qwen3.6 Local Deployment Tutorial: Build Your Private AI Agent at Zero Cost
Step-by-step tutorial to deploy Hermes Agent with Qwen3.6 open-source LLM locally. Covers WSL setup, model download, Telegram bot integration for a zero-cost private AI Agent.
Read more →
Tutorials·2 min
vLLM and SGLang Local Deployment Tutorial: A Practical Guide to 3-8x Performance Gains
Complete guide to deploying vLLM and SGLang locally. Compare performance vs LM Studio, deploy in 3 steps with Docker + AI assistant. Covers SGLang vs vLLM selection, 5090 VRAM optimization, and Cherry Studio integration.
Read more →
Tutorials·4 min
NVIDIA Model Optimizer Post-Training Quantization (PTQ) Practical Guide
A deep dive into NVIDIA Model Optimizer's PTQ workflow, covering INT8/INT4 quantization principles, calibration methods, RTX GPU optimization, and best practices for deploying quantized LLMs on consumer GPUs.
Read more →
Deep Dives·3 min
AI Model Deployment Pipeline Friction: How TensorRT Systematically Eliminates Inference Optimization Bottlenecks
Deep dive into pipeline friction in AI model deployment from training to production, covering TensorRT automated optimization, ONNX export, and Triton Inference Server best practices.
Read more →
Product Reviews·3 min
GitHub 8K Stars: Deep Dive into the Most Comprehensive LLM Resource Repository
Deep analysis of the GitHub project awesome-LLM-resources covering multimodal generation, AI Agents, MCP protocol, model training/inference, o1 models, and SLMs—a community-verified 8200+ Star LLM learning resource hub.
Read more →
Product Reviews·4 min
Cube Studio Deep Dive: Tencent's Open-Source One-Stop MLOps Platform
Deep dive into Cube Studio, Tencent Music's open-source one-stop AI platform, covering architecture design, distributed training, large model fine-tuning and inference, and domestic chip adaptation.
Read more →
Deep Dives·5 min
Hugging Face Transformers: A Comprehensive Guide to the 160K-Star Open-Source AI Framework
Comprehensive guide to Hugging Face Transformers, the 160K-star GitHub framework—covering architecture, multimodal support, quantization, and inference optimization for loading, fine-tuning, and deploying pre-trained models.
Read more →
Deep Dives·3 min
Microsoft Magentic-UI Explained: A Human-AI Collaborative Agent Operating System
Deep dive into Microsoft's open-source Magentic-UI: a human-AI collaborative Agent platform built on AutoGen. Explore its five core capabilities, system architecture, and Human-in-the-Loop design.
Read more →
Tech Frontiers·3 min
Mistral AI Teams Up with NVIDIA to Build Open-Source AI Models — How Will This Partnership Reshape the Industry?
Mistral AI and NVIDIA announce a strategic partnership to co-develop frontier open-source AI models. A deep analysis of the collaboration's background, technical synergies, and impact on the open vs. closed source AI landscape.
Read more →
Tech Frontiers·3 min
NVIDIA Nemotron Hackathon Korea Winners Announced: Asia-Pacific AI Developers Showcase Their Strength
NVIDIA Nemotron Hackathon Korea winners officially announced, showcasing Korean AI developer innovation. Analysis of Nemotron LLM ecosystem, Korea's AI landscape, and NVIDIA's global developer strategy.
Read more →
Tech Frontiers·2 min
NVIDIA Developer Account Migration to @NVIDIAAI: A Complete Guide to Brand Consolidation and Developer Impact
NVIDIA's developer team social media has migrated to @NVIDIAAI. Learn about the AI strategy behind this brand consolidation, its impact on the developer community, and recommended actions.
Read more →
Deep Dives·3 min
Microsoft Tutel: A Deep Dive into the MoE Model Acceleration Library with FP4/FP8 Low-Precision Support
A deep dive into Microsoft's open-source Tutel MoE optimization library, supporting FP8, NVFP4, and MXFP4 multi-precision computation for DeepSeek, Kimi-K2, Qwen3, and other leading MoE models.
Read more →