Unverified50% confidenceFactExact time
An evaluation suite with 1,800 test cases has long maintained a stable aggregate pass rate of 97%, but the 64-case multilingual slice within it has a pass rate of only 61%
1
Sources
50%
Confidence
Long-term
Relevance
10/2/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedIn a scenario with 1,700 easy cases and 100 difficult multilingual cases, even if half of the difficult cases fail entirely, the aggregate pass rate may only drop from 97% to around 93%73% similarUnverified运行10次测试置信区间宽度约±31%，100次收窄至±10%，400次进一步收窄至±5%，推荐关键测试用例至少运行20-50次69% similarUnverifiedAn accuracy rate of 86% means there is still a 14% margin of error, making Articos more suitable as an early validation and directional judgment tool rather than a replacement for real user testing.69% similarUnverifiedAblation analysis shows that fine-tuning on the segment paradigm yields a +5.29-point improvement on the test set, while replacing the first 4,500 transcript words with 2,000 retrieved words yields only a +1.55-point improvement.68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/968363API
curl https://kongchang.com/api/v1/knowledge/claims/968363MCP
get_claim(id=968363)