Unverified50% confidenceFactExact time
The released checkpoint changes its answer due to cyclic rotation of options on 25.8% of questions (confidence interval 22.9-28.7%).
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
11/9/2026
First Seen
Valid until: 2/7/2027
Sources
Related Entities
Related Claims
UnverifiedThe impact of reasoning-chain corruption on final answers was relatively small (2%–30%), and only 2.9%–35.3% of support-judgment flips co-occurred with answer changes.79% similarUnverifiedMerely changing the order of options could shift the share of a certain option for GPT-6-luna from 16% to 40%; changing the internal ids of options affected Jev's answers by 37.9 points (out of 100), almost equal to the effect of removing all hand information (37.1 points).75% similarUnverifiedIn a test of 119 pairs of "near-identical questions", at the 0.81 threshold 62% of modified questions incorrectly hit; even raised to 0.90, 25% still hit; the hit rate for genuine synonymous rewrites dropped from 39% to 4%.75% similarUnverifiedOn 605 English questions, the released checkpoint's answer flip rate was 19.7%.74% similarUnverifiedWhen option order is reversed, the open-weight model Laya changes 30% of its answers.74% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1149596API
curl https://kongchang.com/api/v1/knowledge/claims/1149596MCP
get_claim(id=1149596)