Unverified50% confidenceBenchmarkExact time
The benchmark published by Bespoke Labs covers 33 public datasets and 3,880 manually labeled decisions; Jeff 1.1B achieves the highest average accuracy at 76%, Nimble 9B at 75.7%, Jeff 1.4B at 73.3%, and the 0.8B version at 63.5%.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/7/2026
First Seen
Valid until: 1/5/2027
Sources
Related Entities
Related Claims
UnverifiedThe Top3 configuration achieved an accuracy of 97.148%, a weighted F1 of 97.055%, and an MCC of 0.9675, comprehensively outperforming the Full21 configuration using all 21 metrics (accuracy 95.999%, weighted F1 95.521%, MCC 0.9549).68% similarUnverifiedIn the LongMemEval benchmark, BM25 accuracy improved from 78.8% to 85.2% with 5 chunks.65% similarUnverifiedThe locally run Gemma 26B achieved an accuracy of only 49.2% across 453 scored predictions, while its paired always-predict-up baseline had an accuracy of 53.4%.65% similarUnverifiedEfficientNet 从 B0 到 B7，模型参数从 5.3M 增长到 66M，Top-1 精度从 77.1% 提升到 84.3%64% similarUnverifiedpplx-decider-v1-27b achieved an average score of 85.7% across 11 benchmarks, outperforming the comparison target Jev (official data).64% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/984296API
curl https://kongchang.com/api/v1/knowledge/claims/984296MCP
get_claim(id=984296)