Unverified50% confidenceBenchmarkExact time
Running the full pipeline with real Gemma on 32 briefs: 22 of 25 budgets read correctly, 25 of 27 deadlines read correctly, zero errors, zero fabrication.
1
Sources
50%
Confidence
Long-term
Relevance
10/18/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedAll four models correctly read all 48 clean invoices and 48 placebo invoices, with zero errors across 4,704 scoring responses, and 0 of the 521 fabricated numbers happened to equal the true total that was obscured.75% similarUnverifiedRetesting with the same 20 files, 18 compiled directly; after one more iteration letting the sessions receive compiler error messages, it reached 19.68% similarUnverifiedA developer reviewed 27 prompts accumulated over one year, of which 22 failed the reproducibility test (i.e., others using the prompts could not obtain the same output as the author).66% similarUnverifiedThis benchmark uses 10 original short documents of 200 to 250 words each, with 18 planted anomalies, 37 scoring entries in total (18 dirty and 19 clean), testing 13 models with 74 prompts per model.64% similarUnverifiedA hand-crafted library of 22 calculators achieved perfect accuracy on the 440 cases it supported, but abstained on the remaining cases, yielding an overall coverage rate of only 40.0%.64% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1063604API
curl https://kongchang.com/api/v1/knowledge/claims/1063604MCP
get_claim(id=1063604)