Unverified50% confidenceBenchmarkExact time
At the 0.81 threshold, the proportion of cached answers that "fit the question" is 5.8 to 10.7 percentage points lower than fresh answers; converted to all responses, the overall quality loss is about 2 to 3 percentage points; Haiku 5.5 has the largest gap (10.7 percentage points), with a cached-answer pass rate of only 67.9%.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/19/2026
First Seen
Valid until: 1/17/2027
Sources
Related Entities
Related Claims
UnverifiedIn a test of 119 pairs of "near-identical questions", at the 0.81 threshold 62% of modified questions incorrectly hit; even raised to 0.90, 25% still hit; the hit rate for genuine synonymous rewrites dropped from 39% to 4%.76% similarUnverifiedFor the 7B model, accuracy with the solver was 75.31% versus 72.02% for direct calculation, a paired improvement of +3.29 percentage points, with a 95% cluster interval of [-3.49, 10.38] crossing zero, making the advantage non-significant.74% similarUnverifiedIn the control group where the answer key was removed from the prompt, the match rate plummeted from 63% to 1% (1/75).74% similarUnverifiedAcross the four models, total calls dropped from 12000 to 3588, tokens dropped 70.1%, and cost dropped 69.6%; about 70% of requests were answered by the cache, of which exact matching contributed about 39% and the semantic layer contributed an additional about 31%.74% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1065409API
curl https://kongchang.com/api/v1/knowledge/claims/1065409MCP
get_claim(id=1065409)