Unverified50% confidenceBenchmarkExact time
By language, across the six models combined, the proportion that is both functionally passing and secure: C and Python 30%, JavaScript 27%, C++ 19%, Java 18%, Go 14%, PHP 10%.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/16/2026
First Seen
Valid until: 1/14/2027
Sources
Related Entities
Related Claims
UnverifiedIn providing correct, domain-specific justifications, performance across different models ranged from 25.6% all the way to 76.9%.64% similarUnverifiedThe single-output limit of most frontier language models is between 64,000 and 256,000 tokens.62% similarUnverifiedAccording to public benchmark tests, performance differences between models on specific programming languages, frameworks, or task types can exceed 30%, and cost differences can be as high as 10x.62% similarUnverifiedAn evaluation suite with 1,800 test cases has long maintained a stable aggregate pass rate of 97%, but the 64-case multilingual slice within it has a pass rate of only 61%62% similarUnverifiedRanked by question difficulty, persistence rate was 91.4% on the 60 questions that all models answered correctly, but only 73.5% on the 52 questions that at least one model got wrong, indicating that sycophancy tracks uncertainty.61% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1047292API
curl https://kongchang.com/api/v1/knowledge/claims/1047292MCP
get_claim(id=1047292)