#continuous batching
89 related articles
·4 min
The Art of Legitimate Slacking: From Code Compilation to AI Generation Waits for Programmers
From the classic XKCD compilation meme to AI coding era reinterpretations — exploring how waiting for compilation and AI code generation is reshaping developer productivity.
Read more →
·3 min
Claude Opus 4.8 Released: Comprehensive Upgrades in Judgment, Honesty, and Autonomous Work Capabilities
Anthropic releases Claude Opus 4.8 with three core upgrades: sharper judgment, more honest self-awareness, and longer independent work duration — all at the same price.
Read more →
Tutorials·3 min
Agent Tuning: A Complete Guide to Training LLMs with Agent Capabilities
A deep dive into Agent Tuning principles and practices, covering why Agent training is needed, the evolution from Prompt to RAG to Agent, development workflows, and cost assessment for private deployment.
Read more →
Tutorials·4 min
Four Core Rules Anthropic Engineers Use to Prompt Claude Code
Anthropic engineers share how to properly use Claude Code at AI Code Summit: build composable Skills systems instead of one-off prompts. Master four core rules for skills that get smarter over time.
Read more →
Product Reviews·3 min
OpenClaw v2026.5.14 Deep Dive: Real-Time Voice Calls and Gateway Freeze Fix
Deep dive into OpenClaw v2026.5.14: TelLinks real-time voice calls, gateway freeze fix, Telegram message congestion resolution, Agent transparency, DeepSeek V4 Flash config, and 120+ bug fixes.
Read more →
Industry Insights·2 min
SGLang Enters Finance: How AI Inference Infrastructure Is Reshaping Wall Street
SGLang co-hosts a finance AI inference event with Crusoe AI and Cloudflare, exploring LLM inference deployment in trading, risk management, and compliance — signaling Wall Street's shift to production-grade AI infrastructure.
Read more →
Industry Insights·2 min
AMD MI355X Beats B200: Full-Stack Optimization Breakdown for 5% Lower TCO on DeepSeek-R1 Inference
AMD Instinct MI355X achieves 5% lower TCO than NVIDIA B200 on DeepSeek-R1 disaggregated inference via SGLang+MoRI full-stack optimization with 1.25x per-GPU throughput.
Read more →
Industry Insights·2 min
NVIDIA Blackwell Sets New STAC-AI Records for Financial LLM Inference
NVIDIA Blackwell GPU sets new LLM inference records in STAC-AI financial benchmark. Explore Blackwell architecture advantages, TensorRT-LLM co-optimization, and LLM applications in trading and risk management.
Read more →
Product Reviews·2 min
GLM 5.1 Flagship Model Tested at 400 TPS — From Sketch to Complete App in Two Minutes
Testing Zhipu's GLM 5.1 High Speed API: a full-power flagship model at 400 Token/s. From sketch restoration to generating a complete puzzle game, verifying speed and capability combined.
Read more →