#模型蒸馏

Wukong 2.2P Open Source: 35B MOE Model Outperforms Qwen3.6-27B at 3–5x the Speed

Wukong 2.2P 35B MOE model is now open source. Using adversarial hybrid distillation, it outperforms Qwen3.6-27B. Runs at 158 tokens/s on RTX 4090 with only 8.9GB VRAM. Supports 256K context.