Unverified50% confidenceBenchmarkExact time
Under the stress profile weighted toward permanent faults, the task completion score plummeted from 8.08 points with no faults to 3.23 points, a drop of about 60%.
1
Sources
50%
Confidence
Long-term
Relevance
10/26/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedIn long-chain tasks, if each step has an error rate of approximately 5%, the overall success rate may drop to below 36% after 20 steps.74% similarVerifiedINT8 quantization loses approximately 0.5% accuracy while halving VRAM usage; INT4 quantization compresses VRAM to 1/4 of the original with an accuracy loss of approximately 1–3%.73% similarUnverifiedIn an API outage scenario with a 30% failure rate, RATED reduces the failure selection rate from 86.2% to 2.9%.73% similarUnverifiedScoring with completion-style proxy metrics will classify failures that terminate cleanly but produce incorrect results as successes, which is a flaw in many current agent evaluations.73% similarVerifiedResearch indicates that at Q4 precision and above, performance loss is within 1–3% for most tasks.72% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1098596API
curl https://kongchang.com/api/v1/knowledge/claims/1098596MCP
get_claim(id=1098596)