Unverified50% confidenceBenchmarkExact time
In schemagate's benchmark, on the Spider dataset's 1034 questions the pure mathematical ranking accuracy is 80.3%, and 96.5% after re-ranking; on the BIRD dataset's 1534 questions the pure mathematical ranking is 88.6%, and 96.7% after re-ranking.
1
Sources
50%
Confidence
Long-term
Relevance
10/16/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe complete system achieved an accuracy of 77.3% across six simulator-derived report fields.65% similarUnverifiedOn the math reasoning task GSM8K, OQ4E answered 954 questions correctly (95.4%), while 8-bit only answered 924 correctly (92.4%), with the 4-bit version coming out 3 percentage points higher.65% similarUnverifiedschemagate's fix includes three changes: raising max_tokens from 120 to 1024; adding a fake model in tests that refuses to answer when max_tokens is below 512; and having the benchmark record whether the model gave an answer on each question.63% similarUnverifiedGPT-6 Astra peaked at 98% on Frontier Math Tier 4, and still reached 83% without enabling reasoning or using chain-of-thought.62% similarUnverifiedIn the task of completing the last Token of an FP8 quantization function, after DeepSeek-V4-Flash-Base adds equal-sign decorations before the code, when the number of equal signs modulo 4 is 0 or 1 the error rate is as high as 71.3%, and when the remainder is 2 or 3 the accuracy returns to 91.5%.61% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1049519API
curl https://kongchang.com/api/v1/knowledge/claims/1049519MCP
get_claim(id=1049519)