Unverified50% confidenceFactExact time
For annotation consistency, Cohen's kappa was 0.781 (range 0.753-0.807) and Fleiss' kappa was 0.77.
1
Sources
50%
Confidence
Long-term
Relevance
11/6/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedCohen's kappa reaches 0.964 on boundary-matched spans, but drops sharply to a macro F1 of 0.753 after incorporating missed entities, boundary errors, and label corrections.71% similarUnverifiedOn held-out human-annotated data, the best cascaded scheme achieved macro precision 0.86, recall 0.76, and F1 0.79.68% similarUnverifiedOn accuracy: τ=0.4 is 0.7305, the hosted single run is 0.7085, the local single run is 0.7320, and τ=0.6 is 0.7115.68% similarUnverifiedOn the manually validated Track B v1.0 gold set (161 entries), the post-arbitration Cohen's kappa value reached 0.85.68% similarUnverified标注者间一致性IAA常用Cohen's Kappa系数(两个标注者)和Fleiss' Kappa系数(多个标注者)计算,Kappa值为1表示完全一致,0表示与随机一致无差异67% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1142370API
curl https://kongchang.com/api/v1/knowledge/claims/1142370MCP
get_claim(id=1142370)