Unverified50% confidenceFactExact time
Different hyperparameters such as system prompt, temperature, maximum token count, and number of retries can cause the evaluation results of the same model to differ by more than 10 percentage points.
1
Sources
50%
Confidence
Long-term
Relevance
8/11/2026
First Seen
Sources
DeepSeek V4 Flash Terminal-Bench 2.1得分82.7%意味着什么
Related Claims
UnverifiedThe same prompt can produce vastly different results across different models and different parameters (such as temperature), and the industry has yet to establish a recognized standard for evaluating prompt quality.75% similarUnverifiedA higher temperature value makes the model's output probability distribution smoother and increases randomness; Top-p sampling draws only from the smallest set of tokens whose cumulative probability reaches the threshold.74% similarUnverifiedResearch shows that the performance gap between different prompt designs can exceed 10 percentage points even for the same model.72% similarPartially VerifiedResearch shows that the output quality of the same model can vary by several times under different prompts.72% similarUnverified不同模型在基准测试上的性能差异往往远小于同一模型在不同任务类型、不同输入格式下的行为差异71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/732403API
curl https://kongchang.com/api/v1/knowledge/claims/732403MCP
get_claim(id=732403)