#pipeline parallelism
128 related articles
·3 min
Local Merge Queues: Solving Code Conflicts for Parallel AI Programming Agents
Deep dive into how local merge queues solve code conflict challenges when multiple AI programming agents work in parallel, covering merge queue principles and multi-agent development trends.
Read more →
·3 min
Local Merge Queues: Solving Code Conflicts from Parallel AI Coding Agents
Deep dive into how local merge queues solve code conflict challenges when multiple AI coding agents work in parallel, covering merge queue principles and multi-agent development trends.
Read more →
·3 min
Production-Grade LLM Inference Deployment: A Practical K8s Handbook
Complete guide to deploying production-grade LLM inference on Kubernetes, covering GPU scheduling, vLLM engine selection, autoscaling, observability, and cost optimization.
Read more →
·3 min
Moonshot AI Open-Sources FlashKDA: A Deep Dive into High-Performance CUDA Kernels for KDA Attention
Moonshot AI open-sources FlashKDA, providing high-performance CUDA kernels for Kimi Delta Attention. Learn about its technical principles, performance gains, and value for long-context training and inference acceleration.
Read more →
·3 min
Moonshot AI Open-Sources FlashKDA: A Deep Dive into High-Performance CUDA Kernels for KDA Attention
Moonshot AI open-sources FlashKDA, providing high-performance CUDA kernels for Kimi Delta Attention. Explore its technical principles, performance gains, and value for long-context training and inference.
Read more →
·3 min
Google's $1 Billion Dark Fiber Deal with Verizon: AI Infrastructure Competition Goes Deep
Google signs a $1B+ dark fiber deal with Verizon to interconnect data centers for AI training and inference. Verizon launches AI Connect, converting central offices into edge compute nodes.
Read more →
·4 min
LangChain Guardrails Explained: Building Safe and Controllable AI Agents
A detailed guide to LangChain Guardrails covering layered ecosystem architecture, middleware implementation, deterministic and model-driven protection for building production-grade secure AI Agents.
Read more →
·4 min
Kimi K3 Deep Dive: 2.8 Trillion Parameter Open-Source Model Closes the Gap with Closed-Source Frontier for the First Time
Moonshot AI releases Kimi K3 open-weight model with 2.8T parameters and 1M token context. Our deep dive covers coding, 3D dev, agent capabilities, and safety concerns.
Read more →
·3 min
Replacing spaCy's Sentencizer with yasbd: Accuracy Jumps from 55% to 98.9%
spaCy's default Sentencizer achieves only 55.4% accuracy on edge cases, while open-source library yasbd reaches 98.9%. Analysis of limitations and integration code examples.
Read more →
·2 min
Gemini Always Crashes on the 16th Turn? Error 1076 Root Cause Analysis and Workarounds
Google's Gemini consistently triggers Error 1076 on the 16th conversation turn, regardless of context size. Analysis points to a session state management defect, with three workarounds provided.
Read more →
·3 min
The Real Daily Life of MLE and MLOps Engineers: Key Differences Between Three Roles and Career Paths
An in-depth look at the real daily work of data scientists, MLEs, and MLOps engineers — covering responsibilities, essential tools, and career paths to help you find your direction in AI.
Read more →
·3 min
Monocular RGB Human Mesh Reconstruction: Real-Time Motion Capture at 18 FPS with Rust + CUDA
Deep dive into a real-time 3D human mesh reconstruction project using a single RGB camera, built with Rust, Candle, and CUDA, achieving 55ms/frame on RTX 5080. Exploring its architecture, Metal porting plans, and applications in VTuber, AR/VR, and sports analysis.
Read more →
·3 min
Monocular RGB Human Mesh Reconstruction: Real-Time Motion Capture at 18 FPS with Rust + CUDA
A deep dive into a real-time 3D human mesh reconstruction project using a single RGB camera, built with Rust, Candle, and CUDA, achieving 55ms/frame on an RTX 5080.
Read more →
·1 min
Radxa Cubie A7Z Real-World Test: 330ms End-to-End Object Detection Latency Under Full NPU Load
Deep analysis of Radxa Cubie A7Z achieving 330ms glass-to-glass object detection latency under full NPU load, covering latency breakdown, practical use cases, and edge AI optimization strategies.
Read more →
·3 min
Kimi K3 Local Deployment Guide: Storage Requirements for q4 and q8 Quantization Explained
Detailed analysis of Kimi K3 quantization deployment options, comparing q4 vs q8 storage requirements, precision trade-offs, and hardware configurations for local self-hosting.
Read more →
In-Depth Analysis of the Claude Opus 5…
·3 min
In-Depth Analysis of the Claude Opus 5 Elevated Error Rate Incident and Response Strategies
Deep analysis of the Claude Opus 5 elevated error rate incident, exploring LLM service reliability challenges and providing developers with practical strategies including multi-model redundancy, retry mechanisms, and graceful degradation.
Read more →
·2 min
D-Flash: How Diffusion Drafting Delivers 3.5x Faster LLM Inference
D-Flash solves the autoregressive drafter latency bottleneck in speculative decoding via fast diffusion parallel drafting and target feature KV injection. 16 tokens in just 6ms, up to 3.5x speedup on HumanEval, beating EAGLE3 and MTP.
Read more →
·3 min
D-Flash: The Secret Behind 3.5x LLM Inference Speedup with Diffusion Drafting
D-Flash uses fast diffusion parallel drafting and target feature KV injection to solve the autoregressive Drafter latency bottleneck in speculative decoding. 16 tokens in just 6ms, up to 3.5x speedup on HumanEval, surpassing EAGLE3 and MTP.
Read more →
·6 min
AI Application Engineer Interview Guide: Core Topics in Model Quantization and Inference Deployment
A systematic review of must-know topics for AI Application Engineer interviews: PTQ/QAT quantization, operator fusion, inference pipelines, latency/throughput analysis, and edge deployment of detection/segmentation/BEV models.
Read more →
·6 min
AI Application Engineer Interview Guide: Core Topics on Model Quantization and Inference Deployment
A systematic guide to must-know AI application engineer interview topics: PTQ/QAT quantization, operator fusion, inference pipelines, latency/throughput analysis, and edge deployment of detection/segmentation/BEV models.
Read more →