Unverified50% confidenceBenchmarkExact time
VERS reduces the number of generated tokens by 45.8% on the full GSM8K test set, with accuracy dropping by only 0.82 percentage points.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
11/3/2026
First Seen
Valid until: 2/1/2027
Sources
Related Entities
Related Claims
UnverifiedOn competition problems, VERS loses 3-7 percentage points of accuracy across all model sizes.75% similarUnverifiedWhen mainstream models' accuracy on GSM8K approaches 95% or above, the benchmark loses its discriminative power.73% similarUnverified接受率随位置逐级衰减：GSM8K从位置0的0.92下滑至约0.53，MTBench从0.78急跌至0.13，因误差在连续猜测中累积72% similarUnverifiedMFGS reduces total GMACs by 52% to 55%, meaning the compute required by the model for the same task is nearly halved.72% similarUnverified研究表明，即使在 GSM8K 或 MATH 数据集上接近满分的模型，面对稍作变形或需要跨领域组合的问题时性能下降可达30-50个百分点70% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1130557API
curl https://kongchang.com/api/v1/knowledge/claims/1130557MCP
get_claim(id=1130557)