#Sparse MoE
175 related articles
·4 min
Kimi K3 Released: 2.8 Trillion Parameter Open-Source Model Tops Global Coding Leaderboard
Moonshot AI releases Kimi K3, a 2.8 trillion parameter open-source model using MoE architecture that tops the global frontend coding arena at under $1 per task, beating GPT and Claude.
Read more →
·3 min
Kimi K3 Deep Dive: How a 3 Trillion Parameter Open-Weight Model Reaches the Frontier
Deep dive into Kimi K3: the largest open-weight model at 3 trillion parameters, surpassing Opus-level models in Agentic coding with 896-expert MoE architecture, 1M token context, at Sonnet pricing.
Read more →
·3 min
Deep Dive into Inkling: The First Frontier Open-Source Multimodal LLM from the West
Thinking Machines releases Inkling, an open-source multimodal LLM with near-trillion MoE parameters, 1M token context, Apache 2.0 license. Deep dive into architecture, benchmarks, and pricing.
Read more →
·4 min
Colibri: Running a 744-Billion-Parameter LLM on an Ordinary Laptop
Colibri uses MoE hot-cold separation and 4-bit quantization to run 744B-parameter models like GLM 5.2 on consumer hardware. Learn about its three-tier memory architecture and speculative decoding.
Read more →
·4 min
Laguna S 2.1 Deep Dive: Hands-On Local Deployment of a 118B Parameter Coding Model
In-depth review of Poolside's Laguna S 2.1 open-source coding model: MoE architecture, RL training, DGX Spark local deployment, and real-world agentic coding tests with 8B active parameters.
Read more →
·2 min
Kimi K3 Launches on Telnyx Inference API: A New Path for Chinese LLMs Going Global
Moonshot AI's Kimi K3 is now available on Telnyx Inference API. Explore how Chinese LLMs are entering global developer ecosystems through third-party inference platforms.
Read more →
·3 min
Open Source vs. Closed Source: Who Will Win the US-China AI Battle?
Chinese open-source models DeepSeek and Kimi K3 are challenging OpenAI's closed-source dominance. Analyzing the business logic, chip ecosystems, and US-China strategic dynamics behind the open vs. closed AI debate.
Read more →
·3 min
Kimi K3 Launches on Ollama Cloud: Free Tier, User Experience, and Developer Guide
Kimi K3 officially launches on Ollama Cloud as an "extra high usage" model. This guide covers free tier quotas, cloud inference experience, technical advantages, and how developers can seamlessly call this high-performance LLM.
Read more →
·2 min
DeepSeek V4 Official Release Imminent: What 1.6 Trillion Parameters Really Means
DeepSeek V4 official release is imminent. V4 Pro features 1.6 trillion parameters with million-character context. Explore the D-SPARK acceleration framework, dynamic pricing, and V4's leap to production-grade AI.
Read more →
·5 min
Will Chinese Open-Source Models Burst the US AI Bubble? A Deep Dive into the Transmission Chain
Chinese open-source models like Kimi K3 and DeepSeek approach US closed-source performance at a fraction of the cost. This deep dive analyzes the transmission chain from price competition to valuation reassessment.
Read more →
·3 min
Open Source vs. Closed Source: Who Will Win the US-China AI Battle?
Chinese open-source models DeepSeek and Kimi K3 challenge OpenAI's closed-source dominance. Analysis of open vs. closed AI strategies, CUDA moat erosion, and the US-China strategic battle for AI supremacy.
Read more →
·3 min
Deep Dive into the Kimi-K3 Technical Report: A Comprehensive Analysis of Architecture, Long-Context Processing, and Reasoning Capabilities
Deep dive into Moonshot AI's Kimi-K3 technical report, analyzing its long-context processing, MoE architecture, reasoning improvements, and its position in global AI competition.
Read more →
·3 min
Deep Dive into the Kimi-K3 Technical Report: Architecture, Long Context, and Reasoning Capabilities
Deep analysis of Moonshot AI's Kimi-K3 technical report covering long context processing, MoE architecture, reasoning capabilities, and China's position in the global AI competition.
Read more →
·2 min
Kimi-K3 Lands on HuggingFace: A Full Breakdown of Moonshot AI's Open-Source Strategy
Moonshot AI's Kimi-K3 model is set to launch on HuggingFace. A deep dive into its architecture, licensing, community reactions, and strategic implications for the global open-source AI landscape.
Read more →
·3 min
Laguna S 2.1: The Open-Source Coding Model That's 14x Smaller Yet Stronger
Poolside releases Laguna S 2.1, an open-source agentic coding model: 118B total params with only 8B active, scoring 40.4% on DeepSWE — ~4.5x DeepSeek V4 Pro Max. Supports 1M-token context, deployable on a single workstation.
Read more →
·3 min
How China's Open-Source LLMs Are Closing In on America's Closed-Source Giants
Kimi, Alibaba Qwen, and DeepSeek leverage MoE architecture, home-field data advantages, and the open-source flywheel to close in on OpenAI and Anthropic at ultra-low cost. A deep dive into China's open-source LLM catch-up.
Read more →
·6 min
How the Creator of Redis Squeezed a 284B-Parameter DeepSeek into an Ordinary Laptop
Redis creator antirez built DS4 "Dwarf Star," a pure-C inference engine, using asymmetric quantization to compress DeepSeek V4 Flash from 500GB to 80.8GB for local 128GB unified-memory deployment at 26.7 tokens/sec.
Read more →
·6 min
How the Creator of Redis Squeezed a 284-Billion-Parameter DeepSeek Into an Ordinary Laptop
Redis author antirez built the pure-C inference engine DS4 "Dwarf Star," compressing DeepSeek V4 Flash from 500GB to 80.8GB via asymmetric quantization for local deployment on 128GB unified memory at 26.7 tokens/sec.
Read more →
·3 min
The T-Parameter Era of Open-Source LLMs: Four Chinese AI Companies Break the Trillion-Parameter Barrier
Moonshot AI, Alibaba, DeepSeek, and Meituan all crossed the trillion-parameter threshold. China's open-source LLMs made the B-to-T leap in just 18 months.
Read more →
·4 min
Complete Guide: Connecting DeepSeek and Other Chinese LLMs to Codex
No ChatGPT account? No problem. Learn how to connect DeepSeek and other Chinese LLMs to Codex using the Codex++ management tool — including Base URL setup, API Key creation, and token top-up.
Read more →