#小模型
2 related articles
·1 min
Hyper-Connections: The First Major Improvement to Residual Connections in a Decade
Deep dive into ByteDance's Hyper-Connections: expanding residual connections from one to multiple learnable pathways, significantly improving training under the same compute budget.
Read more →
Tech Frontiers·1 min
Wukong 2.2P Open Source: 35B MOE Model Outperforms Qwen3.6-27B at 3–5x the Speed
Wukong 2.2P 35B MOE model is now open source. Using adversarial hybrid distillation, it outperforms Qwen3.6-27B. Runs at 158 tokens/s on RTX 4090 with only 8.9GB VRAM. Supports 256K context.
Read more →