Unverified50% confidenceBenchmarkExact time
Qwen3-32B with thinking mode disabled approved all eight applications in the opening technical writing job family (including four that did not meet the experience requirement), with only 39% of families having all eight correct and 41% of unqualified applicants incorrectly approved.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/12/2026
First Seen
Valid until: 1/10/2027
Sources
Related Entities
Related Claims
UnverifiedCode replay inherits errors from the extraction stage; in the cluster sufficiency test, gpt-oss-120b's pass rate actually dropped from 56% to 40%.60% similarUnverifiedThe benchmark started with 15,606 raw scoring records, which after cleaning yielded 351 qualifying cases, with placeholder scores accounting for 31% of all scoring rows being excluded.60% similarUnverifiedOn a test subset of 152 completely untouched questions, anchored hybrid retrieval achieved 42.11%, while the planner-guided method reached only 36.84%.58% similarUnverifiedIn 11 of the 12 models, between 87.5% and 100% of capitulation cases stopped at the exact wrong number provided by the user, meaning capitulation typically involves switching sides entirely.57% similarUnverifiedOn TriviaQA, the error rate of answered questions (under the exact match scoring criterion) decreased from 23.0% to 14.5%.57% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1003875API
curl https://kongchang.com/api/v1/knowledge/claims/1003875MCP
get_claim(id=1003875)