Unverified50% confidenceFactExact time
On the consensus reference standard formed after review, another annotator's agreement with that consensus on 200 randomly sampled tweets was 60.5% (κ=0.517).
1
Sources
50%
Confidence
Long-term
Relevance
11/6/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedAnswer balancing requires that the yes/no labels of each question type be roughly matched in distribution, so that the expected accuracy of random guessing stays around 50%.69% similarUnverifiedUnder the condition of n=100 with an even split of positive and negative samples, the 95% confidence interval for 55% accuracy is roughly 45%–65%, which covers the 50% baseline, so the 5 percentage point gap may be random fluctuation.68% similarUnverifiedThe results of the NeurIPS 2022 consistency experiment showed that approximately 50% of papers received completely different accept/reject decisions between the two groups of reviewers68% similarUnverifiedOn science questions answered based on the literature, the best evaluator, o3, agreed with the human vote 65.1% of the time, while random guessing is 50%.68% similarUnverified研究表明人类评估者在判断LLM输出的事实准确性时,正确率往往只有50%-70%68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1141719API
curl https://kongchang.com/api/v1/knowledge/claims/1141719MCP
get_claim(id=1141719)