Unverified50% confidenceFactExact time
Confidence-based routing is also referred to in academia and industry as 'selective prediction' or 'classification with a reject option,' with the core being granting the model the right not to answer.
1
Sources
50%
Confidence
Long-term
Relevance
10/8/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe judge model itself may exhibit biases—for example, tending to give higher scores to responses that resemble its own style—so it is recommended to select a model from a different vendor than the model being evaluated to reduce systematic bias.72% similarUnverifiedThere is a systematic bias in annotator preferences, with higher scores given to polite, clearly structured, and risk-averse responses.70% similarUnverifiedThe distributional shift is driven by two key factors: the recipient's prior weight and the candidate evidence skew.70% similarUnverifiedThe paper argues that heuristic pair selection methods completely decouple the choice of preference pairs from user utility, which is an overlooked flaw.70% similarUnverified'Position bias' is a systematic bias documented in multiple studies: LLMs in two-option comparisons tend to favor the option listed first or last69% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/987686API
curl https://kongchang.com/api/v1/knowledge/claims/987686MCP
get_claim(id=987686)