Nemotron-3.5-Lightning
An efficient mixture-of-experts model in NVIDIA's Nemotron series, with 30B total parameters and 3B active parameters, positioned for lightweight, high-speed inference.
Timeline (last 90 days)
On the AutomationBench evaluation, LFM2.5-24B-A2B scored 27.69%, higher than Qwen3.6-35B-A3B's 8.72%, Gemma-4-26B-A4B's 5.46% and Nemotron-3.5-Lightning's 2.61%.
LFM2.5-24B-A2B outperforms Qwen3.6-35B-A3B, Gemma-4-26B-A4B-it, and Nemotron-3.5-Lightning (30B-A3B) on multiple instruction-following and agentic benchmarks, but lags on knowledge-intensive benchmarks such as SWE-Bench Verified and GPQA Diamond.
All Facts (2)
On the AutomationBench evaluation, LFM2.5-24B-A2B scored 27.69%, higher than Qwen3.6-35B-A3B's 8.72%, Gemma-4-26B-A4B's 5.46% and Nemotron-3.5-Lightning's 2.61%.
50%UnverifiedLFM2.5-24B-A2B outperforms Qwen3.6-35B-A3B, Gemma-4-26B-A4B-it, and Nemotron-3.5-Lightning (30B-A3B) on multiple instruction-following and agentic benchmarks, but lags on knowledge-intensive benchmarks such as SWE-Bench Verified and GPQA Diamond.
50%