Unverified50% confidenceBenchmarkExact time
LFM2.5-24B-A2B scored 80.71% on ToolSandbox, 65.01% on BFCL v4, 96.75% on IFEval and 48.09% on LiveClaw.
1
Sources
50%
Confidence
Short-term (~14 days)
Relevance
10/14/2026
First Seen
Valid until: 10/28/2026
Sources
Related Entities
Related Claims
UnverifiedOn the SWE-bench Verified evaluation, LFM2.5-24B-A2B scored 51.00%, trailing Qwen3.6-35B-A3B's 66.20% and Claude Sonnet 5.5's 55.2%.74% similarUnverifiedOn the AutomationBench evaluation, LFM2.5-24B-A2B scored 27.69%, higher than Qwen3.6-35B-A3B's 8.72%, Gemma-4-26B-A4B's 5.46% and Nemotron-3.5-Lightning's 2.61%.71% similarUnverifiedLFM2.5-24B-A2B scored 48.09 on the LiveClaw benchmark.70% similarUnverifiedOn the BFCL tool-calling test, SmolLM3-3B scores 0.945, slightly above Gemma 4 E2B's 0.927, but the difference is not significant; Qwen3-4B (0.940), Qwen3-1.7B (0.935), Qwen2.5-1.5B (0.910), and Granite 3.3 2B (0.920) are all at the same level as Gemma.66% similarUnverifiedIn the tool-calling benchmark BFCL, Qwen3 scored 83%.65% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1029992API
curl https://kongchang.com/api/v1/knowledge/claims/1029992MCP
get_claim(id=1029992)