Unverified50% confidenceFactExact time
Inter-rater agreement is a statistical metric measuring how consistently multiple raters score the same object, commonly quantified using Cohen's Kappa, Krippendorff's Alpha, or the intraclass correlation coefficient (ICC).
1
Sources
50%
Confidence
Long-term
Relevance
10/18/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedCohen's kappa is a statistical measure of agreement between two evaluators, ranging from -1 to 1, which discounts chance agreement arising from random guessing78% similarUnverified人工评估常用标注者间一致性（IAA）指标如Cohen's Kappa和Krippendorff's Alpha来确保评估质量可靠性，一般Kappa大于0.7为可接受水平76% similarUnverifiedInter-rater reliability is commonly measured using Cohen's Kappa coefficient to ensure consistency and objectivity in classification standards76% similarUnverifiedTraditional codebook development follows an iterative reliability testing process, repeatedly revising based on inter-rater agreement metrics (such as Cohen's Kappa or Krippendorff's Alpha) until agreement reaches an acceptable threshold (typically Kappa ≥ 0.7).70% similarVerifiedCredibility is higher only when multiple independent evaluation sources reach consistent conclusions, and multiple evaluation sources should be cross-validated.70% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1064065API
curl https://kongchang.com/api/v1/knowledge/claims/1064065MCP
get_claim(id=1064065)