Unverified50% confidenceTradeoffExact time
In domain-specific NER tasks, human-machine aggregated agreement metrics (such as high kappa values) can be misleading, and the choice of evaluation metric must match task complexity.
1
Sources
50%
Confidence
Long-term
Relevance
9/23/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedAggregate metrics (such as multi-task average scores) have an inherent ability to dilute failures; when simpler tasks constitute the majority, the average score can mask significant degradation on a small number of high-difficulty tasks.72% similarUnverifiedComplete shift invariance is not always the optimal choice; classification tasks favor invariance while object detection tasks need to preserve positional information.71% similarUnverified深度估计任务因其回归性质对精度更敏感，可能需要混合精度策略——对敏感层保持 FP16 而对其他层使用 INT870% similarUnverifiedIn class-imbalanced scenarios, accuracy alone can be misleading and needs to be combined with a confusion matrix for more fine-grained evaluation.68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/942792API
curl https://kongchang.com/api/v1/knowledge/claims/942792MCP
get_claim(id=942792)