Unverified50% confidenceFactExact time
When different raters understand the same level very differently, the Likert scale leads to unstable inter-rater reliability, and a single number cannot carry information about specific good and bad dimensions.
1
Sources
50%
Confidence
Long-term
Relevance
10/16/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedErrors in confidence scoring systems are distributed across the entire score range, manifesting as calibration error—high in coverage but difficult to detect.78% similarUnverifiedWhen measurement instruments have systematic biases, the conclusions drawn may be misleading no matter how sophisticated the statistical methods are.75% similarUnverifiedThe margin of error only reflects the uncertainty introduced by sampling and cannot encompass non-sampling errors, such as question wording bias, non-response bias, coverage bias, and social desirability bias.74% similarUnverifiedBias introduced by a single defective data point can leak into seemingly unrelated capability dimensions, causing the model to simultaneously regress across multiple independent metrics such as deceptiveness, compliance, and risk aversion.74% similarVerified若用含测试集的全量数据计算均值和标准差，会导致预处理泄漏，使评估指标虚高，无法真实反映模型泛化能力74% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1041930API
curl https://kongchang.com/api/v1/knowledge/claims/1041930MCP
get_claim(id=1041930)