#decoding strategies
164 related articles
Industry Insights·2 min
AMD MI355X Beats B200: Full-Stack Optimization Breakdown for 5% Lower TCO on DeepSeek-R1 Inference
AMD Instinct MI355X achieves 5% lower TCO than NVIDIA B200 on DeepSeek-R1 disaggregated inference via SGLang+MoRI full-stack optimization with 1.25x per-GPU throughput.
Read more →
Tech Frontiers·1 min
SGLang Hosts Agent Loops Office Hour, Focusing on Agentic Loop Architecture Optimization
SGLang team hosts an Agent Loops Office Hour exploring inference optimization for agentic loops, covering KV Cache reuse, low-latency multi-turn dialogue, and tool calling techniques.
Read more →
Tech Frontiers·1 min
Go 1.26 Officially Released: New GC, SIMD Support, and Other Major Updates Explained
Go 1.26 officially released with a new garbage collector, significantly reduced cgo overhead, experimental SIMD support, and runtime/secret key management package.
Read more →
Tutorials·2 min
Practical Guide to Prompt Engineering: Core Optimization Techniques and Pitfalls to Avoid in 2026
A 2026 practical guide to prompt engineering: format selection, system message priority, role setting, few-shot learning, structured output, and how to avoid common pitfalls.
Read more →
Tutorials·1 min
Ningbo Bank AI Agent Interview Questions: Reasoning Optimization + Agent Debugging + Python Key Topics
Deep analysis of real Ningbo Bank AI Agent interview questions covering LLM multi-path reasoning optimization, agent debugging methodology, Python deep/shallow copy, GIL, and decorators.
Read more →
Tutorials·3 min
AI Agent Context Management in Practice: A Complete Guide from Death Loops to Intelligent Truncation
Deep dive into AI Agent context management: a three-step strategy from naive truncation to intelligent memory, covering sub-Agent architecture and long session evals to solve LLM context bloat.
Read more →
Deep Dives·3 min
NVIDIA Dynamo Multi-Turn Agentic Interaction: Deep Integration of Streaming Tokens and Tool Calling
Deep dive into NVIDIA Dynamo's multi-turn agentic interaction support, covering streaming token output, structured tool calling, state management, and MoE synergy for production-grade AI agents.
Read more →
Product Reviews·3 min
Claude Haiku 4.5 Real-World Test: Fast but Outclassed in Value by GPT-5 Mini
Real-world comparison of Claude Haiku 4.5 vs GPT-5 Mini and GLM 4.6 on speed, code quality, and price. Haiku 4.5 beats Sonnet 4 by one minute but costs 4x more than GPT-5 Mini with 9 points lower coding scores.
Read more →
Expert Opinions·3 min
Sam Altman in Conversation with Garry Tan: How OpenAI and YC Are Co-Shaping the AI Startup Ecosystem
Sam Altman and YC President Garry Tan discuss the convergence of OpenAI's foundation models and YC's startup ecosystem, revealing key signals about the next phase of AI entrepreneurship.
Read more →
Product Reviews·3 min
awesome-LLM-resources: A Comprehensive Analysis of the 8,200-Star LLM Learning Resource Repository on GitHub
In-depth analysis of the 8,200-star GitHub project awesome-LLM-resources, covering multimodal generation, Agents, model training, MCP protocol, and more — a one-stop LLM learning guide.
Read more →
Tech Frontiers·2 min
Cursor Launches Claude Opus 4 Fast Mode: 2.5x Faster, 6x More Expensive — Is It Worth It?
Cursor launches Claude Opus 4 Fast Mode with 2.5x speed but 6x cost. We analyze use cases, cost tradeoffs, and practical tips to help you decide if it's worth it.
Read more →
Tech Frontiers·2 min
Kimi K2 Official Verification Tool K2-Vendor-Verifier: One-Click API Vendor Model Accuracy Detection
Moonshot AI open-sources K2-Vendor-Verifier to verify third-party Kimi K2 API vendor inference accuracy. Learn how this tool helps developers detect over-quantization, model substitution, and other API market risks.
Read more →
Tutorials·3 min
Building an AI Digital Human Agent from Scratch: Architecture Design & Full Technical Breakdown
Complete guide to building an AI digital human Agent, covering Agent, RAG, WebRTC, and Docker deployment with architecture design and engineering best practices.
Read more →
Tech Frontiers·2 min
OpenAI Symphony: One Codex Agent Per Task — A New Paradigm for Multi-Agent Parallel Programming
Deep dive into OpenAI's Symphony: assigning an independent Codex agent to each task for multi-agent parallel programming. Explore its architecture, developer impact, and industry trends.
Read more →
Deep Dives·3 min
Why Is AI Agent Testing So Hard? How Simulation Testing Cracks the Infinite Input Space Problem
AI Agents face infinite input spaces and non-deterministic outputs. Learn how simulation testing systematically validates Agent reliability through scenario generation, environment simulation, and behavior evaluation.
Read more →
Tutorials·3 min
The Complete Guide to MLflow: An Open-Source AI Engineering Platform from Experiment Tracking to LLM Deployment
A deep dive into the MLflow open-source AI engineering platform, covering experiment tracking, LLM evaluation, model deployment, and monitoring to help teams efficiently manage the ML lifecycle.
Read more →
Tutorials·2 min
ComfyUI-WanVideoWrapper: A Complete Guide to Installing and Using Wan Video Generation Nodes
A detailed guide to ComfyUI-WanVideoWrapper: integrate Wan video generation models into ComfyUI with text-to-video and image-to-video workflows, VRAM optimization tips, and use cases.
Read more →
Product Reviews·3 min
GitHub 8,200-Star LLM Resource Hub: Covering the Full Pipeline from Training to Inference to Agents
Deep dive into the 8,200-star awesome-LLM-resources GitHub project covering the full LLM lifecycle: data processing, training, inference, Agents, multimodal, and more.
Read more →
Tech Frontiers·2 min
LLM 0.32a0 Released: Message Sequences and Typed Streaming Refactor Explained
Simon Willison releases LLM 0.32a0 alpha with message sequence modeling and typed streaming parts, supporting multimodal output and conversation history injection while maintaining backward compatibility.
Read more →
Product Reviews·5 min
awesome-LLM-resources: A Deep Dive into GitHub's 8K-Star Comprehensive LLM Resource Repository
Deep analysis of the GitHub project awesome-LLM-resources covering LLM training, inference, Agent, MCP, multimodal, small language models, o1 reasoning and more — an 8200+ Star one-stop LLM resource guide.
Read more →