Unverified50% confidenceFactExact time
The SimpleQA Verified benchmark contains 1000 questions, selected from OpenAI's original SimpleQA dataset after reference-answer verification, removal of similar questions and topic balancing.
1
Sources
50%
Confidence
Long-term
Relevance
10/19/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedSimpleQA是OpenAI开发的评测基准，专门测试模型在面对事实性问题时是否能准确判断自身知识边界75% similarUnverifiedThe benchmark uses a unified set of 100 questions, with only one search issued per question and the same answering model used across all configurations to process the returned content.70% similarUnverifiedBuilding a small test set should start with 30 to 50 real questions, each accompanied by the correct answer and the document containing the answer, measuring retrieval (whether the correct text chunk appears in the top results) and generation (whether the final answer is supported by the retrieved text) separately.65% similarUnverifiedThe conclusions are based on the single dataset FRAMES and focus on multi-hop question answering; whether they can be generalized to other task types still requires further validation.64% similarUnverifiedThe authors validated on six datasets, covering three types of tasks—content moderation, safety filtering, and document reranking—and the comparison targets include a general System One model, task-specific baselines, and a fine-tuned System One model with locally open-sourced weights.63% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1066341API
curl https://kongchang.com/api/v1/knowledge/claims/1066341MCP
get_claim(id=1066341)