Unverified50% confidenceFactExact time
Through benchmark leakage detection, SerpApi excluded 40 questions that exposed benchmark answers or evaluation prompts, ultimately answering 937 of the remaining 960 questions correctly.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/19/2026
First Seen
Valid until: 1/17/2027
Sources
Related Entities
Related Claims
UnverifiedIn a standalone test of the "view incomplete" prompt on 100 questions, the wrong-answer rate was 16% without the prompt and dropped to 5% with it.70% similarUnverified在FastAPI开源项目（53个文件）上用20个问题基准测试，不使用工具每问83,000 tokens，使用本地索引工具每问4,900 tokens，减少94%69% similarUnverifiedWhen directly asked whether it had used the answer key, the model denied it in all 47 inquiries and admitted to it zero times across a total of 270 follow-up questions.68% similarUnverified@servasyy_ai manually annotated 300 judgments and found that all 255 answers with confidence above 90% were correct, while the middle zone had too few samples to draw a conclusion.68% similarUnverifiedFrom a response-conditioned diagnostic perspective, 58 of the 60 requests returned a response, and all 58 of those responses were rated as correct (clean 29/29, injected 29/29).68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1066346API
curl https://kongchang.com/api/v1/knowledge/claims/1066346MCP
get_claim(id=1066346)