Unverified50% confidenceFactExact time
For a question asking which cognitive biases the papers involve, one generation honestly said the papers did not name specific biases and relevancy gave it 0; another generation confidently listed a bias that does not exist in the corpus and relevancy instead gave it 0.58, with only faithfulness catching the fabrication (0.17).
1
Sources
50%
Confidence
Long-term
Relevance
10/19/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe TRACES benchmark's control design includes 42 problematic papers and control papers that are structurally topic-matched but have good academic reputations; if the models' refusal rate for problematic papers drops significantly in the control group, it indicates that their behavior is driven by topic prominence rather than methodological judgment.72% similarUnverifiedThe paper redefines faithfulness evaluation as a context-aware "alignment-then-labeling" problem: first identify phrase-level correspondences between informal and formal statements, then assign a faithfulness label to each pair under explicitly given contextual interpretations and assumptions.70% similarUnverifiedA paper published in Nature pointed out that current evaluation methods imperceptibly reward confident answers while penalizing honest uncertainty.69% similarUnverifiedWhen the known information is insufficient to judge customer fit, the honest output should be 'insufficient to judge' rather than giving a confident score.69% similarUnverifiedConfidence scores only reflect recognition reliability at the character level and do not represent semantic correctness.69% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1065198API
curl https://kongchang.com/api/v1/knowledge/claims/1065198MCP
get_claim(id=1065198)