Unverified50% confidenceOpinionExact time
众包式盲测评测被认为比传统学术基准测试（如MMLU、HumanEval）更能反映模型在开放式对话中的综合表现
1
Sources
50%
Confidence
Long-term
Relevance
8/24/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedTop-tier models have approached the level of human judges on many evaluation tasks, but exhibit biases such as a tendency to give higher scores to longer responses69% similarUnverifiedResearch finds that when a prompt assigns the model the role of a rigorous academic researcher, both its citation density and authenticity are significantly higher than in a general conversational role.69% similarUnverified人类标注者在评估答案时存在信息越丰富越好的认知偏差，导致奖励模型将篇幅与质量隐性挂钩，是模型冗余的成因之一67% similarUnverifiedCurrent mainstream LLM evaluation benchmarks such as MMLU, HumanEval, and MT-Bench focus primarily on knowledge capabilities and instruction-following abilities, and systematic evaluation of sycophantic behavior has yet to form an industry standard.66% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/795684API
curl https://kongchang.com/api/v1/knowledge/claims/795684MCP
get_claim(id=795684)