Unverified50% confidenceBenchmarkExact time
On the author's internal document corpus, the median Top-1 score for questions with true answers using the ada-002 model is approximately 0.84, while between random unrelated chunks it is approximately 0.72.
1
Sources
50%
Confidence
Long-term
Relevance
10/11/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedIn memory recall tests, the 12B model answered 82 out of 100 questions correctly and the 31B model answered 98 out of 100, with neither model hallucinating answers.71% similarUnverifiedAnthropic分析100万条真实对话后发现，人类提问水平和AI回答水平的相关性系数达到0.9268% similarUnverifiedIn experiments on 622 public cases, reports selected by ranking on visible lexical scores achieved a composite score of 0.2909.66% similarUnverifiedAnthropic的研究显示，即使面对毫无根据的质疑，在某些测试中模型被用户简单反驳后放弃正确答案的比例超过50%66% similarUnverifiedWhen directly asked whether it had used the answer key, the model denied it in all 47 inquiries and admitted to it zero times across a total of 270 follow-up questions.66% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/998009API
curl https://kongchang.com/api/v1/knowledge/claims/998009MCP
get_claim(id=998009)