Unverified50% confidenceEventExact time
When the benchmark set grew from 10 tasks to 20, an agent that originally passed all 10/10 showed 10 failures under the new counting method, causing it to be misjudged as capability decay and automatically quarantined.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/18/2026
First Seen
Valid until: 1/16/2027
Sources
Related Entities
Related Claims
UnverifiedThe power-law exponent between test loss and compute is approximately 0.05, meaning that every 10x increase in compute yields approximately a 12% improvement in model performance.73% similarUnverifiedThe validity of efficiency figures such as "10x" often depends on specific benchmarks, tasks, and comparison conditions.73% similarUnverifiedThere were 100 tasks on which performance losses relative to the baseline persisted across all three repetitions, while persistent wins occurred on only 1 task.72% similarUnverified全栈优化的叠加效应使得过去18个月内每token的推理成本下降了约10倍71% similarUnverifiedOn a test set of 100 tickets, SupportOps-AI had an escalation error rate of 18%, a hallucination rate of 6%, an infinite-loop rate of 3%, and a complete failure/unresolved rate of 4%.71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1057689API
curl https://kongchang.com/api/v1/knowledge/claims/1057689MCP
get_claim(id=1057689)