#distributed inference
762 related articles
Product Reviews·2 min
Lenovo Xiaoxin Pro16 AI Yuanqi Review: Is the N150 Processor Worth $480?
Lenovo Xiaoxin Pro16 AI Yuanqi Edition with Intel N150 processor at 3,499 RMB after subsidies. We analyze performance, use cases, and whether this 16-inch ultrabook is worth buying.
Read more →
Product Reviews·3 min
Cursor 2.0 Deep Dive: Hands-On Testing of Five Major Features Including Custom Models and Multi-Agent Parallel Development
Deep dive into Cursor 2.0's five major updates: custom Composer model, Git Worktrees multi-agent parallel development, Agent View mode, built-in browser, and more—with hands-on evaluation.
Read more →
Tutorials·3 min
Coze Skill Packs Fully Explained: From Concept to Hands-On Creation Guide
Deep dive into Coze's Skill feature: progressive disclosure concepts, practical cases in comic generation and contract review, two creation methods, and layered SOP design principles.
Read more →
Research·3 min
MementoGUI: A Multimodal Memory Management Framework for Solving Long-Horizon GUI Agent Amnesia
MementoGUI is a plugin-style multimodal memory management framework that solves GUI agent forgetting in long-horizon tasks through dual time-scale memory and four memory control operators, boosting long-task completion without fine-tuning.
Read more →
Tutorials·3 min
Complete Learning Roadmap for Java Developers Transitioning to AI Engineering
A detailed five-phase learning roadmap for Java developers transitioning to AI engineering, covering Spring AI, LangChain4j, RAG core technology, and Agent development.
Read more →
Tutorials·4 min
Credit Settlement for AI Async Tasks: Deduct First or Complete First?
Analyze correct timing for AI async task credit settlement. Compare deduct-on-submit vs. Webhook callback approaches with a pre-freeze + callback confirmation implementation for fair SaaS billing.
Read more →
Product Reviews·3 min
Claude Code 2.1 Deep Dive: Hooks Automation, MCP Ecosystem & Multi-Agent Collaboration Fully Explained
Full breakdown of Claude Code 2.1: Opus 4.6 model upgrade, Hooks deterministic automation, Skills multi-agent collaboration, MCP tool chain integration, plus IDE shortcuts and practical commands.
Read more →
Industry Insights·3 min
Alibaba's $52B AI Investment: A Full-Stack Cloud Infrastructure Upgrade for the Agent Era
Alibaba invests $52B in AI cloud infrastructure over 3 years. Bailian Platform hits 8B yuan ARR with 11 quarters of triple-digit AI revenue growth. Deep analysis of Alibaba Cloud's full-stack Agent upgrade strategy.
Read more →
Product Reviews·3 min
Mavis Hands-On Review: Multi-Agent Collaboration vs. Single Agent — A Comprehensive Comparison in Academic Research and Web Development
In-depth review of Mavis multi-agent platform across academic retrieval, literature review, and web development. Multi-agent mode significantly outperforms single agents in accuracy and reliability.
Read more →
Tutorials·3 min
Spring AI + MCP Protocol in Practice: Tool Calling, Security Authentication, and Enterprise Deployment
Deep dive into Spring AI and MCP protocol integration, covering tool calling, OAuth security, horizontal scaling, and context optimization for enterprise AI Agent services.
Read more →
Tutorials·4 min
Full Breakdown: Building an APP with AI and Publishing to the App Store in 45 Minutes
How to use Cursor AI to develop an iOS APP in 45 minutes and publish it to the App Store, covering backend API development, iOS frontend, debugging tips, and effective AI communication methods.
Read more →
Tutorials·2 min
Tutorial: Deploying a PD-Disaggregated SGLang Multi-Node Inference Cluster on AMD GPUs
Learn how to deploy a PD-disaggregated SGLang inference cluster on AMD GPUs using a single config file, boosting LLM throughput and latency performance.
Read more →
Tech Frontiers·2 min
SGLang v0.5.12.post1 Released: DeepSeek V4 Stability Fixes and Blackwell Adaptation
SGLang v0.5.12.post1 stability patch details: 12 critical fixes covering DeepSeek V4 garbled text and crashes, NIXL PD disaggregated inference logic, Blackwell B300 adaptation, and cold start optimization.
Read more →
Industry Insights·2 min
AMD MI355X Beats B200: Full-Stack Optimization Breakdown for 5% Lower TCO on DeepSeek-R1 Inference
AMD Instinct MI355X achieves 5% lower TCO than NVIDIA B200 on DeepSeek-R1 disaggregated inference via SGLang+MoRI full-stack optimization with 1.25x per-GPU throughput.
Read more →
Tech Frontiers·1 min
Cloudflare Contributes Critical KV Cache and Mooncake Fixes to SGLang
Cloudflare contributes decode KV cache offload and Mooncake recovery fixes to SGLang, resolving garbled output under high concurrency for Kimi K2.6 and enabling automatic fault recovery in distributed inference.
Read more →
Tech Frontiers·1 min
SGLang Hosts Agent Loops Office Hour, Focusing on Agentic Loop Architecture Optimization
SGLang team hosts an Agent Loops Office Hour exploring inference optimization for agentic loops, covering KV Cache reuse, low-latency multi-turn dialogue, and tool calling techniques.
Read more →
Industry Insights·3 min
Six Foundational Upgrades to Claude Code: AI Programming Moves from Lab to Industrial Scale
Anthropic's largest-ever foundational upgrade to Claude Code fixes six critical issues at once—terminal flickering, thinking freezes, cryptic errors, context deadlocks, unstable connections, and session crashes—shifting AI coding competition to the infrastructure layer.
Read more →
Industry Insights·3 min
Deep Dive into Three Major LLM Career Paths: Requirements, Tech Stacks, and Career Prospects
Deep analysis of three core LLM roles—Application Engineer, Development Engineer, and Algorithm Engineer—covering technical requirements, salary thresholds, and career prospects including RAG, fine-tuning, and inference deployment.
Read more →
Tutorials·3 min
DeepSeek V4 Flash MTP Speculative Decoding Real-World Test: A Guide to 20% Faster Local Inference
Real-world testing of DeepSeek V4 Flash with MTP speculative decoding: ~20% speedup for code generation, minimal gains for text. Covers memory overhead, accuracy differences, Q4 vs Q3 quantization, and full deployment tutorial.
Read more →
Tutorials·3 min
Building a SaaS Website with AI and Zero Code: A Complete Bolt + Cursor Walkthrough
Learn how to build a SaaS website with AI image generation, multimodal chat, and webpage replication using only Bolt and Cursor — no code required. Covers prompt design, architecture, and iteration techniques.
Read more →