Unverified50% confidenceFactExact time
GPQA Diamond is the hardest and most strictly filtered subset of GPQA, with 198 questions written by PhD-level question writers in physics, chemistry, and biology, designed so that even non-experts allowed to use search engines would struggle to answer correctly in a short time.
1
Sources
50%
Confidence
Long-term
Relevance
10/19/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedGPQA is a benchmark designed for PhD-level scientific question answering, with questions difficult enough that domain experts can only answer approximately 65% correctly.80% similarUnverifiedGPQA Diamond is a multiple-choice question set targeting doctoral-level scientific knowledge, covering biology, chemistry, and physics, with domain experts averaging approximately 65% accuracy.80% similarUnverifiedGPQA is a PhD-level scientific question-answering benchmark designed by NYU researchers, with questions that avoid knowledge points answerable through simple searches.76% similarUnverifiedGPQA is a graduate-level scientific question-answering benchmark, and SWE-bench targets real-world software engineering tasks.68% similarUnverifiedQ&A.AI uses GPT-4 to provide instant answers and can resolve 80% of basic queries, but fails on complex questions because the algorithm oversimplifies them.58% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1067103API
curl https://kongchang.com/api/v1/knowledge/claims/1067103MCP
get_claim(id=1067103)