Unverified50% confidenceFactExact time
Aggregate metrics naturally dilute concentrated failure patterns, making localized failures invisible within the overall number
1
Sources
50%
Confidence
Long-term
Relevance
10/2/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedAggregate metrics (such as multi-task average scores) have an inherent ability to dilute failures; when simpler tasks constitute the majority, the average score can mask significant degradation on a small number of high-difficulty tasks.78% similarUnverifiedCommonly used aggregate metrics (such as overall accuracy and evidence coverage) miss claim-level patterns, and macro-level numbers can become disconnected from actual per-claim changes.74% similarUnverified聚合多个基准的评测方式降低了单一基准被针对性优化(刷榜)的风险73% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/968364API
curl https://kongchang.com/api/v1/knowledge/claims/968364MCP
get_claim(id=968364)