Unverified50% confidenceFactExact time
Inter-rater reliability is commonly measured using Cohen's Kappa coefficient to ensure consistency and objectivity in classification standards
1
Sources
50%
Confidence
Long-term
Relevance
9/28/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedTraditional codebook development follows an iterative reliability testing process, repeatedly revising based on inter-rater agreement metrics (such as Cohen's Kappa or Krippendorff's Alpha) until agreement reaches an acceptable threshold (typically Kappa ≥ 0.7).75% similarUnverified人工评估常用标注者间一致性（IAA）指标如Cohen's Kappa和Krippendorff's Alpha来确保评估质量可靠性，一般Kappa大于0.7为可接受水平71% similarUnverifiedCohen's kappa is a statistical measure of agreement between two evaluators, ranging from -1 to 1, which discounts chance agreement arising from random guessing66% similarUnverifiedKey dimensions for API consistency verification include mathematical reasoning accuracy, code generation quality, long-text processing capability, and instruction-following compliance.65% similarUnverifiedCommonly used metrics for code quality assessment include cyclomatic complexity, code duplication rate, unit test coverage, and whether SOLID principles are followed.65% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/957152API
curl https://kongchang.com/api/v1/knowledge/claims/957152MCP
get_claim(id=957152)