#continuous batching
133 related articles
·3 min
Claude Code Local Deployment: A Practical Guide to Connecting Local LLMs
Complete guide to deploying Claude Code locally with Ollama, LM Studio, or vLLM. Covers architecture, protocol translation, hardware requirements, and model selection for zero-cost, private AI coding.
Read more →
·4 min
Pi Coding Agent Deep Configuration Guide: A Complete Breakdown of Custom Tools, Sub-Agents, and the Skill System
A complete Pi Coding Agent configuration guide refined over two months, covering custom tools, sub-agents, persistent memory, security, and skill systems.
Read more →
·3 min
vLLM Deep Dive: How PagedAttention Enables High-Throughput LLM Inference
Deep dive into vLLM's core technologies for high-throughput LLM inference, including PagedAttention memory management, continuous batching, distributed deployment, and comparisons with TensorRT-LLM.
Read more →
·4 min
Legitimate Slacking for Programmers: The Art of Waiting from Code Compilation to AI Generation
From the classic XKCD compilation meme to AI coding era reinterpretations — exploring how waiting for compilation and AI generation is reshaping developer productivity.
Read more →
·4 min
The Art of Legitimate Slacking: From Code Compilation to AI Generation Waits for Programmers
From the classic XKCD compilation meme to AI coding era reinterpretations — exploring how waiting for compilation and AI code generation is reshaping developer productivity.
Read more →
·3 min
Claude Opus 4.8 Released: Comprehensive Upgrades in Judgment, Honesty, and Autonomous Work Capabilities
Anthropic releases Claude Opus 4.8 with three core upgrades: sharper judgment, more honest self-awareness, and longer independent work duration — all at the same price.
Read more →
Tutorials·3 min
Agent Tuning: A Complete Guide to Training LLMs with Agent Capabilities
A deep dive into Agent Tuning principles and practices, covering why Agent training is needed, the evolution from Prompt to RAG to Agent, development workflows, and cost assessment for private deployment.
Read more →
Tutorials·4 min
Four Core Rules Anthropic Engineers Use to Prompt Claude Code
Anthropic engineers share how to properly use Claude Code at AI Code Summit: build composable Skills systems instead of one-off prompts. Master four core rules for skills that get smarter over time.
Read more →
Product Reviews·3 min
OpenClaw v2026.5.14 Deep Dive: Real-Time Voice Calls and Gateway Freeze Fix
Deep dive into OpenClaw v2026.5.14: TelLinks real-time voice calls, gateway freeze fix, Telegram message congestion resolution, Agent transparency, DeepSeek V4 Flash config, and 120+ bug fixes.
Read more →
Industry Insights·2 min
SGLang Enters Finance: How AI Inference Infrastructure Is Reshaping Wall Street
SGLang co-hosts a finance AI inference event with Crusoe AI and Cloudflare, exploring LLM inference deployment in trading, risk management, and compliance — signaling Wall Street's shift to production-grade AI infrastructure.
Read more →
Industry Insights·2 min
AMD MI355X Beats B200: Full-Stack Optimization Breakdown for 5% Lower TCO on DeepSeek-R1 Inference
AMD Instinct MI355X achieves 5% lower TCO than NVIDIA B200 on DeepSeek-R1 disaggregated inference via SGLang+MoRI full-stack optimization with 1.25x per-GPU throughput.
Read more →
Industry Insights·2 min
NVIDIA Blackwell Sets New STAC-AI Records for Financial LLM Inference
NVIDIA Blackwell GPU sets new LLM inference records in STAC-AI financial benchmark. Explore Blackwell architecture advantages, TensorRT-LLM co-optimization, and LLM applications in trading and risk management.
Read more →
Product Reviews·2 min
GLM 5.1 Flagship Model Tested at 400 TPS — From Sketch to Complete App in Two Minutes
Testing Zhipu's GLM 5.1 High Speed API: a full-power flagship model at 400 Token/s. From sketch restoration to generating a complete puzzle game, verifying speed and capability combined.
Read more →
Tech Frontiers·1 min
Hetzner Servers Hit by Massive Traffic Surge: The Hidden Risks of Budget Cloud Services
Hetzner servers reportedly hit by massive traffic surge causing service issues. Analysis of budget cloud architecture trade-offs, AI inference infrastructure pressure, and developer mitigation strategies.
Read more →
Deep Dives·4 min
How Dangerous Are Windsurf Account-Switching Plugins? A Deep Dive into Technical Principles and Security Risks
Deep analysis of Windsurf seamless account-switching plugin's technical implementation, revealing risks of account bans, code theft, and legal liability. Four compliant alternatives for developers.
Read more →
Tutorials·4 min
NVIDIA Model Optimizer Post-Training Quantization (PTQ) Practical Guide
A deep dive into NVIDIA Model Optimizer's PTQ workflow, covering INT8/INT4 quantization principles, calibration methods, RTX GPU optimization, and best practices for deploying quantized LLMs on consumer GPUs.
Read more →
Deep Dives·3 min
AI Model Deployment Pipeline Friction: How TensorRT Systematically Eliminates Inference Optimization Bottlenecks
Deep dive into pipeline friction in AI model deployment from training to production, covering TensorRT automated optimization, ONNX export, and Triton Inference Server best practices.
Read more →
Product Reviews·3 min
8K Stars on GitHub: Deep Dive into the Most Comprehensive LLM Resource Repository
Deep analysis of the awesome-LLM-resources project (8200+ GitHub Stars), covering multimodal AI, Agents, MCP protocol, model training, o1 reasoning, SLMs, and more for LLM practitioners.
Read more →
Product Reviews·4 min
Cube Studio Deep Dive: Tencent's Open-Source One-Stop MLOps Platform
Deep dive into Cube Studio, Tencent Music's open-source one-stop AI platform, covering architecture design, distributed training, large model fine-tuning and inference, and domestic chip adaptation.
Read more →
Tutorials·4 min
Claude Code Hands-On Tutorial: Installation, DeepSeek Integration & Programming Tips - Complete Guide
Complete guide to Claude Code installation, DeepSeek V4 Pro integration, IDE setup, with a real full-stack project demo, Skill system, MCP configuration, and 10 AI programming tips.
Read more →