Unverified50% confidenceFactExact time
DSB-IFEval employs two complementary quantitative metrics: Instruction Adherence Score (IAS) and Persona Adherence Score (PAS)
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
9/5/2026
First Seen
Valid until: 12/4/2026
Sources
Related Entities
Related Claims
Unverified人工评估常用标注者间一致性（IAA）指标如Cohen's Kappa和Krippendorff's Alpha来确保评估质量可靠性，一般Kappa大于0.7为可接受水平68% similarUnverified数据标注评估考核中常见的质量指标包括标注者间一致性（IAA）和与黄金标准的偏差67% similarUnverifiedDSB-IFEval is a benchmark specifically designed to evaluate implicit instruction-following capabilities in real-time voice interaction63% similarUnverifiedThe research team employed a twelve-metric matrix on the EBM-NLP word-level PICO classification task, including imbalance-sensitive metrics such as balanced accuracy, macro-averaged F1, and ROC-AUC61% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/860701API
curl https://kongchang.com/api/v1/knowledge/claims/860701MCP
get_claim(id=860701)