Unverified50% confidenceFactExact time
Human annotation was completed by two groups of three fluent English speakers each, with Fleiss' Kappa values of 0.65 and 0.57 respectively for the two groups, showing no significant difference.
1
Sources
50%
Confidence
Long-term
Relevance
10/5/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedEven experienced human experts performing the same review task often achieve inter-group Kappa values of only 0.4–0.6.69% similarUnverifiedThe audit results show that automatic labels agree with human consensus on 90.3% of claims, with a Cohen's Kappa coefficient of 0.87.68% similarUnverifiedA study published in Nature in 2020 found that Cohen's Kappa coefficient for different reviewers' scores on the same paper is typically less than 0.3.64% similarUnverifiedCohen's Kappa系数适用于两名评审者、类别变量的情景，其值介于-1到1之间，通常认为0.6以上属于中等一致性，0.8以上为高度一致62% similarUnverifiedThe standard interpretation of Cohen's Kappa is typically: κ < 0.20 slight, 0.21–0.40 fair, 0.41–0.60 moderate, 0.61–0.80 substantial, and above 0.80 almost perfect.56% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/977918API
curl https://kongchang.com/api/v1/knowledge/claims/977918MCP
get_claim(id=977918)