Unverified50% confidenceBenchmarkExact time
Under eight kinds of input perturbation, Microsoft-Decision-1's average decision flip rate is only 1.3%; when option descriptions are reworded or option order is reversed/shuffled, there are zero flips (vendor data).
1
Sources
50%
Confidence
Short-term (~14 days)
Relevance
10/12/2026
First Seen
Valid until: 10/26/2026
Sources
Related Entities
Related Claims
UnverifiedThe release notes state that Decision-1 changes its decision on an average of 1.3% of perturbations, and shows zero flips when option descriptions are reworded, reversed, or shuffled.76% similarUnverifiedThe order of answer options causes the Decisions API's confidence to drift by approximately 13 percentage points.69% similarUnverifiedThe capitulation rate for factual anchor questions is only 1.3%, while for personal choice questions the model aligns with the user's position in 77.0% of conversations.66% similarUnverifiedDemo three introduces a decision rule: the top option must reach at least 80% and exceed the second-best option by 20 percentage points; otherwise, the output is "request clarification."64% similarUnverifiedLayla is extremely sensitive to the number of options and their positions; on 77 classification tasks its accuracy drops to 0.425, and shuffling the option order causes 20% of answers to flip.63% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1006148API
curl https://kongchang.com/api/v1/knowledge/claims/1006148MCP
get_claim(id=1006148)