#MoE fine-tuning
179 related articles
·2 min
SenseNova-Vision Training Data Pipeline Explained: A Guide to Fine-Tuning Unified Vision Models
SenseNova-Vision adds a complete training data pipeline with dataset registration, format converters, and end-to-end docs, making unified vision model fine-tuning for segmentation, OCR, and editing far more accessible.
Read more →
·2 min
Behind the Open-Source Model Frenzy: Who Will Provide Cheap Inference Services?
Open-source LLM weights don't equal low-cost access for developers. This article analyzes the inference service gap in open-source AI and how providers like Together AI and Groq are addressing it.
Read more →
·2 min
Behind the Open-Source Model Frenzy: Who Will Provide Cheap Inference Services?
Open-source LLM weights don't mean developers can use them cheaply. This article examines the inference service gap in open-source AI and how providers like Together AI and Groq are addressing it.
Read more →
·2 min
Why Top AI Startups Are No Longer Publishing Research: The Deep Reasons Behind the Shift from Openness to Secrecy
Exploring why top AI startups shifted from open research to secrecy, analyzing how commercial competition and talent pressure drive this change, and its impact on academia, innovation, and open source.
Read more →
·3 min
What Are AI Model Weights, Really? The Deep Learning Truth Revealed by a Meme
Starting from a viral Reddit meme, we dive deep into AI neural network weights — what they are, why they can't be read visually, and how open weights drive technological democratization.
Read more →
·4 min
GPT-6 Reportedly Completed, Claude Opus 5 Leaked: The AI Model Race Accelerates
GPT-6 may be completed, Anthropic's Claude Honeycomb appears to be an early Opus 5 version, Kimi K3 is imminent, and Google Gemini faces further delays. Deep analysis of the latest AI model competition.
Read more →
·4 min
GPT-6 Reportedly Completed, Claude Opus 5 Leaked: The AI Model Race Accelerates
GPT-6 may be complete, Anthropic's mysterious Claude Honeycomb appears to be an early Opus 5 version, Kimi K3 is imminent, and Google Gemini continues to delay. Deep analysis of the latest AI model competition.
Read more →
·4 min
Kimi K3 Released: 2.8 Trillion Parameter Open-Source Model Tops Global Coding Leaderboard
Moonshot AI releases Kimi K3, a 2.8 trillion parameter open-source model using MoE architecture that tops the global frontend coding arena at under $1 per task, beating GPT and Claude.
Read more →
·3 min
Deep Dive into Inkling: The First Frontier Open-Source Multimodal LLM from the West
Thinking Machines releases Inkling, an open-source multimodal LLM with near-trillion MoE parameters, 1M token context, Apache 2.0 license. Deep dive into architecture, benchmarks, and pricing.
Read more →
·4 min
Kimi K2/K3 Technical Speculation: Deep Dive into RL Hyperparameters and Multi-Teacher Distillation
Deep analysis of RL hyperparameter tuning challenges and 9-policy multi-teacher distillation in Kimi K2/K3 training, exploring the shift from scale to training craft.
Read more →
·4 min
The Dao of DeepSeek: Liang Wenfeng on Vision, Restraint, and the Philosophy of Open Source
Analysis of DeepSeek founder Liang Wenfeng's rare investor dialogue, exploring the company's vision-driven culture, strategic restraint toward AGI, and open-source philosophy in the US-China AI race.
Read more →
·2 min
Jensen Huang Praises DeepSeek and Kimi: Markets Have Twice Misjudged the Impact of Chinese Open-Source Models
NVIDIA CEO Jensen Huang says markets have twice misjudged the impact of DeepSeek and Kimi, arguing Chinese open-source models boost rather than reduce overall AI compute demand.
Read more →
·2 min
Kimi-K3 Lands on HuggingFace: A Full Breakdown of Moonshot AI's Open-Source Strategy
Moonshot AI's Kimi-K3 model is set to launch on HuggingFace. A deep dive into its architecture, licensing, community reactions, and strategic implications for the global open-source AI landscape.
Read more →
·3 min
GLM 5.2 Hands-On: An Open-Source, Low-Cost Model That Rivals Opus
In-depth hands-on review of GLM 5.2: a 753B-parameter open-source model with a 1M-token context, rivaling Opus 4.8 at about one-tenth the price. Full setup guide for Claude Code and Cursor.
Read more →
·2 min
Grok 4.5 Hands-On Review: Code Generation and Research Visualization Capabilities
Hands-on review of xAI's Grok 4.5: one-shot web code generation and research figures rivaling top journal visuals. Covers core capabilities, Claude Opus comparison, and aggregation platform tips.
Read more →
·5 min
Why Are China's Open-Source AI Models Getting Stronger? A Deep Dive Into Three Comeback Strategies
Facing US chip bans and closed-source monopoly, how do China's open-source AI models keep fighting back? A deep dive into three core paths: open-source pricing games, optical interconnect positioning, and on-device scenarios.
Read more →
·5 min
Why Are China's Open-Source AI Models Getting Stronger? A Deep Dive into Three Comeback Paths
Facing US chip bans and closed-source monopolies, how do China's open-source AI models keep striking back? A deep dive into three core paths: open-source pricing-power games, optical interconnect positioning, and edge-side use cases.
Read more →
·5 min
Liang Wenfeng's In-Depth Confession: DeepSeek's Philosophy of Restraint, Open-Source Strategy, and AGI Roadmap
DeepSeek founder Liang Wenfeng systematically explains: a KPI-free culture, 10-month break-even pricing, long-term open-source strategy, continual learning to break the AGI bottleneck, and his prediction of a mature domestic chip ecosystem within a year.
Read more →
·4 min
jlens-gguf: Bringing Jacobian Lens Visualization and Steering to llama.cpp Local LLMs
jlens-gguf is an open-source tool bringing Anthropic's Jacobian Lens interpretability method to GGUF and llama.cpp, enabling internal observation, real-time steering, and abliteration for both dense and MoE models.
Read more →
·5 min
China Weighs Restricting Top AI Model Exports as DeepSeek Develops Its Own Inference Chip
China's Commerce Ministry weighs restricting overseas access to top open-weight AI models from Alibaba, ByteDance, and DeepSeek, while DeepSeek develops its own inference chip amid a US-China AI export standoff.
Read more →