Unverified50% confidenceBenchmarkExact time
Beam reaches 76.5% on SWE Bench Pro v2-Hard (BF16), 80.1% on Terminal Bench v2.1 (BF16), 90.6% on GPQA Diamond (BF16), and 80.8% on MCP Atlas tool calling (BF16).
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/19/2026
First Seen
Valid until: 1/17/2027
Sources
Related Entities
Related Claims
UnverifiedReflection AI self-reports that Beam scores 80.9 on SWE-Bench Verified, 80.1 on Terminal-Bench 2.1, and 97.8 on AIME 2026.67% similarUnverifiedBeam reaches 81.6% on SWEBench Verified (BF16).66% similarUnverifiedJetBrains self-reported evaluation results: Mellum2.1 scores 47.0% on SWE-bench Verified, 28.0% on SWE-bench Pro, 17.4% on Terminal-Bench 2.1, 82.0% on LiveCodeBench v6, and 91.5% on HumanEval+.60% similarUnverifiedAlibaba's official figures show Qwen3.8 Flash scoring 62.5 on SWE-Bench Pro, leading Claude Opus 4.6 by approximately 9 points; 73.9 on Cowork Bench versus DeepSeek's 45.1; and 55.7 on Job Bench, exceeding Opus 4.6 by approximately 20 points.59% similarUnverifiedThe IQ3S tier scores 92.93 on GPQA Diamond (vs. BF16 baseline 91.92), 86.86 on LiveCodeBench V6 (vs. 87.43), with a three-task average of 93.26 vs. 93.12, and a file size less than one quarter of BF16 (approximately 22%).59% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1070570API
curl https://kongchang.com/api/v1/knowledge/claims/1070570MCP
get_claim(id=1070570)