Unverified50% confidenceFactExact time
"Cheap, Consistent, Calibrated, but Biased?" tested 8 typed decision models (TDMs) with probabilistic outputs and 7 LLM evaluators, finding that each TDM was biased on 3-8 of 12 bias tests, with emotional tone having the largest effect, causing accuracy to plummet from 99% to 42%.
1
Sources
50%
Confidence
Long-term
Relevance
10/15/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedFor an invoice classification model with 97% accuracy, when a reviewer examines 300 invoices per day, only about 9 will be wrong, and errors are buried among correct items, causing the reviewer's rejection rate to approach zero.68% similarUnverifiedPrecision bias refers to the tendency for people to assign higher credibility to statements containing precise numbers; experiments show that subjects rated the credibility of "41.3%" significantly higher than "approximately 40%".68% similarUnverifiedAmong 19 studies that reported which direction the evaluator's errors lean, 12 lean toward passing work that should have failed, 3 lean in the opposite direction, and 4 are mixed.67% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1034836API
curl https://kongchang.com/api/v1/knowledge/claims/1034836MCP
get_claim(id=1034836)