#DeepSeek-R1 inference

155 related articles

May 30, 2026·2 min

AMD MI355X Beats B200: Full-Stack Optimization Breakdown for 5% Lower TCO on DeepSeek-R1 Inference

AMD Instinct MI355X achieves 5% lower TCO than NVIDIA B200 on DeepSeek-R1 disaggregated inference via SGLang+MoRI full-stack optimization with 1.25x per-GPU throughput.

Aug 2, 2026·3 min

Evaluating Open-Source AI Mathematical Reasoning: Latest Progress and Core Challenges

In-depth analysis of open-source AI models' latest progress in mathematical reasoning, exploring evaluation challenges like data contamination and benchmark saturation, and how formal verification and chain-of-thought methods drive more objective assessment.

Aug 2, 2026·3 min

LLM Post-Training on an 8GB GPU: A Practical Guide to SFT, DPO, and GRPO

Learn how to complete LLM post-training on a consumer GPU with just 8GB VRAM, covering SFT, DPO, and GRPO methods using LoRA quantization and other techniques.

Aug 2, 2026·3 min

GitHub Daily · August 2: The Dual Explosion of Agent Web Access and the DeepSeek Ecosystem

GitHub Trending Aug 2: Agent-Reach enables zero-cost web access for AI Agents, while DeepSeek ecosystem explodes with ds4 inference engine and Reasonix coding Agent.

Aug 1, 2026·3 min

Reasoning Capabilities Unmatched, Pricing Still Too High: The Dilemma of AI Model Competition

Deep analysis of the dilemma in AI model competition where reasoning gaps and pricing imbalances force vendors to excel at either capability or cost-effectiveness to survive.

Jul 31, 2026·5 min

The Complete Learning Path to Understanding the Kimi K3 Technical Report

A systematic learning path for understanding the Kimi K3 technical report, covering MoE, MLA, distributed training, and modern post-training techniques.

Jul 30, 2026·2 min

GPT-5.6 Price Cut of 80%: How OpenAI Reclaims the AI Price-Performance Throne

OpenAI launches GPT-5.6 with 80% price cuts on its Luna model series, surpassing DeepSeek on the price-performance curve. Analysis of the tech logic, developer impact, and AI price war trends.

Jul 30, 2026·2 min

GPT-5.6 Price Cut of 80%: How OpenAI Reclaims the AI Price-Performance Throne

OpenAI releases GPT-5.6 with 80% price cuts on Luna models, overtaking DeepSeek on price-performance. Analysis of the tech logic, developer impact, and AI pricing trends.

Jul 30, 2026·2 min

Distilling DeepSeek to GPT-OSS: Why Censorship Doesn't Transfer

When distilling DeepSeek to GPT-OSS, censorship mechanisms don't transfer. This article analyzes the separability of capabilities vs. behavioral constraints in knowledge distillation and its implications for AI safety.

Jul 30, 2026·2 min

Distilling DeepSeek to GPT-OSS: Why Censorship Doesn't Transfer

When distilling DeepSeek to GPT-OSS, model censorship doesn't transfer. This article analyzes the separability of capabilities and behavioral constraints in knowledge distillation and its implications for AI safety.

Jul 30, 2026·2 min

Grok 4.5 Released: A Next-Gen AI Model Targeting Coding and Agentic Tasks

Grok 4.5 is officially released, purpose-built for coding, agentic tasks, and knowledge work. A deep dive into its core positioning, efficient reasoning, three key use cases, and value for developers.

Jul 30, 2026·3 min

Is LLM Inference Really That Expensive? Breaking Down the Cost Reduction Logic of GPU Compute and Inference Frameworks

Analyzing real LLM inference costs: from B200 GPU compute gains, vLLM framework optimization to MTP multi-token prediction, explaining why serving costs are widely overestimated.

Jul 29, 2026·3 min

Ollama Template Silently Overridden After GGUF Import: A Troubleshooting Guide for Custom TEMPLATE Being Ignored

Analysis of Ollama silently overriding custom TEMPLATE with GGUF-embedded templates after import. Learn to verify active templates via /api/show to prevent evaluation failures.

Jul 28, 2026·4 min

Kimi K3 Released: 2.8 Trillion Parameter Open-Source Model Tops Global Coding Leaderboard

Moonshot AI releases Kimi K3, a 2.8 trillion parameter open-source model using MoE architecture that tops the global frontend coding arena at under $1 per task, beating GPT and Claude.

Jul 28, 2026·2 min

Kimi 3 Added to Pro Subscription: Accelerating Commercialization of Chinese LLMs

Kimi 3 joins the Pro subscription plan, giving paying users direct access to the latest flagship model. Analysis of Kimi 3's upgrades, Moonshot AI's subscription strategy, and China's evolving LLM landscape.

Jul 28, 2026·2 min

Kimi 3 Included in Pro Subscription: Accelerating Commercialization of Chinese LLMs

Kimi 3 is now included in the Pro subscription plan, giving paying users direct access to the latest flagship model. This article analyzes Kimi 3's upgrades, Moonshot AI's subscription strategy, and shifts in China's LLM competitive landscape.

Jul 28, 2026·3 min

Deep Dive into Inkling: The First Frontier Open-Source Multimodal LLM from the West

Thinking Machines releases Inkling, an open-source multimodal LLM with near-trillion MoE parameters, 1M token context, Apache 2.0 license. Deep dive into architecture, benchmarks, and pricing.

Jul 27, 2026·4 min

The Dao of DeepSeek: Liang Wenfeng on Vision, Restraint, and the Philosophy of Open Source

Analysis of DeepSeek founder Liang Wenfeng's rare investor dialogue, exploring the company's vision-driven culture, strategic restraint toward AGI, and open-source philosophy in the US-China AI race.

Jul 27, 2026·5 min

Will Chinese Open-Source Models Burst the US AI Bubble? A Deep Dive into the Transmission Chain

Chinese open-source models like Kimi K3 and DeepSeek approach US closed-source performance at a fraction of the cost. This deep dive analyzes the transmission chain from price competition to valuation reassessment.

Jul 27, 2026·2 min

Jensen Huang Champions Open-Source AI: Distillation Is Not Plagiarism, DeepSeek and Kimi Are Excellent

NVIDIA CEO Jensen Huang defends open-source AI, calls distillation legitimate learning, praises DeepSeek and Kimi, and co-signs open letter with 20+ companies while OpenAI and Google stay silent.