Unverified50% confidenceFactExact time
The benchmark improvement from 7.9% to 48.1% refers to the change in the model's accuracy on a certain math benchmark; 7.9% is close to random guessing, while 48.1% indicates the model has substantive problem-solving ability.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
11/4/2026
First Seen
Valid until: 2/2/2027
Sources
Related Entities
Related Claims
UnverifiedA single "trusted source" prompt caused 7 out of 8 tested models to reverse between 45% and 88% of their correct answers.77% similarUnverifiedOne AI model's score on the MATH500 math test rose from 7.9% to 48.1%, an increase of about sixfold, stemming from modifying 0.016% of another model's weights.77% similarUnverified研究数据表明，在数学竞赛级别问题上，启用深度推理的模型准确率可从不足30%提升至80%以上76% similarUnverifiedPerplexity reported in its research benchmarks that the new model achieved a 9% improvement in accuracy compared to the old model at half the cost.75% similarUnverifiedPerformance benchmark results are subject to statistical fluctuation, requiring multiple runs to take the median or P95/P99 percentiles for evaluation.75% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1135367API
curl https://kongchang.com/api/v1/knowledge/claims/1135367MCP
get_claim(id=1135367)