#sparse activation
164 related articles
Deep Dives·3 min
Microsoft Tutel: A Deep Dive into the MoE Model Acceleration Library with FP4/FP8 Low-Precision Support
A deep dive into Microsoft's open-source Tutel MoE optimization library, supporting FP8, NVFP4, and MXFP4 multi-precision computation for DeepSeek, Kimi-K2, Qwen3, and other leading MoE models.
Read more →
Product Reviews·2 min
Unsloth: 80% VRAM Reduction — The Best Open-Source Tool for Local LLM Fine-Tuning
Unsloth is an open-source LLM training tool with 63K+ GitHub stars, supporting Gemma 4, Qwen 3, DeepSeek. Reduces VRAM by 50–80%, enabling RTX 4090 to fine-tune 7B models with a no-code Web UI.
Read more →
Tutorials·3 min
DeepSeek API Integration Guide: Deep Dive into a 37K-Star GitHub Open Source Project
Deep analysis of the 37K-star awesome-deepseek-integration GitHub project, covering DeepSeek API integration with VS Code, Obsidian, LangChain, and more mainstream tools.
Read more →
Product Reviews·5 min
Unsloth: The Open-Source Tool That Speeds Up Local LLM Fine-Tuning by 5x
Unsloth is an open-source LLM training tool with 63,000+ GitHub Stars. It supports local fine-tuning of Gemma 4, Qwen3, DeepSeek and more, with Web UI, VRAM optimization, and 2-5x training speedup on consumer GPUs.
Read more →