#推理加速
3 related articles
Tech Frontiers·2 min
Mercury 2: How Diffusion Architecture Achieves 1000 Tokens Per Second Inference Speed
Inception Labs releases Mercury 2, a diffusion-based language model achieving 1000+ tokens/sec with strong reasoning, challenging autoregressive architectures.
Read more →
Tech Frontiers·2 min
Mercury 2 Hands-On Review: The Fastest Inference LLM Powered by Diffusion Models — A Complete Game Generated in 18 Seconds
Hands-on review of Inception Labs' Mercury 2 diffusion model, benchmarked against Claude Haiku, Gemini Flash and more across code generation, structured reasoning, and long-range planning at 1000+ tokens/sec.
Read more →
Tutorials·4 min
NVIDIA Model Optimizer Post-Training Quantization (PTQ) Practical Guide
A deep dive into NVIDIA Model Optimizer's PTQ workflow, covering INT8/INT4 quantization principles, calibration methods, RTX GPU optimization, and best practices for deploying quantized LLMs on consumer GPUs.
Read more →