Unverified50% confidenceOpinionExact time
In AutoKon, when agreement between automated and human review drops, the cause is almost always the rubric letting two reasonable reviewers score the same photo differently, not the model getting worse.
1
Sources
50%
Confidence
Long-term
Relevance
10/18/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedAI judges show outcome bias when scoring: when only the run outcome is changed (while the Agent's decision process is the same), the AI judge gives a lower PROCESS score in the version where the outcome is wrong.72% similarUnverifiedThere is no stable mapping between a model's self-evaluation score and its actual accuracy; rephrase the same prompt and the score may drift substantially.69% similarUnverifiedAI detectors judge the statistical distribution of text rather than semantic authenticity, and detector accuracy systematically decreases as generative models produce more natural output.69% similarUnverified在事实性评估任务上模型评判者准确率仍显著低于人类专家，但在风格、连贯性等主观维度已接近人类评审员间一致性水平69% similarUnverifiedIn A/B testing, accuracy differences of less than 2% are usually hard to distinguish, and a larger sample size is needed to reach reliable conclusions.67% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1061904API
curl https://kongchang.com/api/v1/knowledge/claims/1061904MCP
get_claim(id=1061904)