Unverified50% confidenceBenchmarkExact time
研究发现强大的LLM在评估开放式问答质量方面与人类评分者的一致性可达80%以上
1
Sources
50%
Confidence
Long-term
Relevance
7/15/2026
First Seen
Sources
Related Claims
Unverified研究表明经过良好校准的LLM裁判与人工标注的一致性可达80%以上80% similarVerifiedThe LLM-as-Judge method can achieve over 80% agreement with human expert scoring.80% similarUnverified研究表明LLM裁判与人类专家的一致性在许多任务上可达80%以上79% similarUnverifiedResearch shows that the agreement rate between LLM judges and human scores is approximately 80%, approaching but not yet surpassing the level of human inter-annotator agreement (approximately 81%).77% similarUnverified2023年学术界研究发现，顶级大模型作为评判者与人类专家的判断一致性可达80%以上73% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/513809API
curl https://kongchang.com/api/v1/knowledge/claims/513809MCP
get_claim(id=513809)