Unverified50% confidenceFactExact time
Score questions correspond to regression tasks or ordinal classification, and their evaluation metrics focus on MAE, RMSE, or the Spearman correlation coefficient rather than accuracy.
1
Sources
50%
Confidence
Long-term
Relevance
10/26/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe authors note that limitations of this comparison include output length differences that may affect ROUGE scores, the absence of human evaluation and factuality evaluation, and rankings based solely on automatic metrics.72% similarUnverifiedAcademic research shows that when scoring criteria are strictly restricted to binary pass/fail standards, automated scorers can provide scalable, reproducible scores that are highly correlated with expert human judgment.69% similarUnverifiedMost existing LLM-assisted screening evaluation methods rely on traditional metrics such as accuracy, which can be misleading on highly class-imbalanced systematic review datasets.69% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1101575API
curl https://kongchang.com/api/v1/knowledge/claims/1101575MCP
get_claim(id=1101575)