Verified80% confidenceFactTime unknown
The LLM-as-Judge method can achieve over 80% agreement with human expert scoring.
6
Sources
80%
Confidence
Long-term
Relevance
6/1/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedResearch shows that the agreement rate between LLM judges and human scores is approximately 80%, approaching but not yet surpassing the level of human inter-annotator agreement (approximately 81%).82% similarUnverified研究表明经过良好校准的LLM裁判与人工标注的一致性可达80%以上81% similarUnverified2023年学术界研究发现，顶级大模型作为评判者与人类专家的判断一致性可达80%以上81% similarUnverified研究表明LLM裁判与人类专家的一致性在许多任务上可达80%以上80% similarUnverified研究发现强大的LLM在评估开放式问答质量方面与人类评分者的一致性可达80%以上80% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/24752API
curl https://kongchang.com/api/v1/knowledge/claims/24752MCP
get_claim(id=24752)