Unverified50% confidenceFactExact time
Getting different answers to the same question asked twice is a normal characteristic of language models' random sampling (temperature > 0) and cannot serve as evidence of a version switch.
1
Sources
50%
Confidence
Long-term
Relevance
9/30/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe same prompt can produce vastly different results across different models and different parameters (such as temperature), and the industry has yet to establish a recognized standard for evaluating prompt quality.68% similarUnverifiedAnthropic的研究显示，即使面对毫无根据的质疑，在某些测试中模型被用户简单反驳后放弃正确答案的比例超过50%64% similarUnverifiedA higher temperature value makes the model's output probability distribution smoother and increases randomness; Top-p sampling draws only from the smallest set of tokens whose cumulative probability reaches the threshold.62% similarUnverifiedIn open-ended generation tasks, the study observed occasional accuracy drops, which were more pronounced in non-English responses.62% similarUnverifiedDifferent hyperparameters such as system prompt, temperature, maximum token count, and number of retries can cause the evaluation results of the same model to differ by more than 10 percentage points.61% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/961456API
curl https://kongchang.com/api/v1/knowledge/claims/961456MCP
get_claim(id=961456)