Unverified50% confidenceDecision RuleExact time
Problem quality control requires the model to have an accuracy above 80% at n=10, temperature=0.8, and without chain-of-thought, and the intermediate quantities must never appear in the prompt.
1
Sources
50%
Confidence
Long-term
Relevance
10/12/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedDifferent hyperparameters such as system prompt, temperature, maximum token count, and number of retries can cause the evaluation results of the same model to differ by more than 10 percentage points.77% similarUnverifiedEven under temperature 0 conditions, 0.07% to 10.2% of rows across five executions still change their operator output, with the exact proportion depending on the model76% similarUnverifiedModels' standard accuracy on the passage-level ranking task was only 0% to 13%.73% similarUnverifiedFor structured tasks such as code completion and syntax checking, small models with 7B–13B parameters can achieve over 90% accuracy, with inference costs as low as 1/50 or less of those of top-tier models.67% similarUnverifiedRanked by question difficulty, persistence rate was 91.4% on the 60 questions that all models answered correctly, but only 73.5% on the 52 questions that at least one model got wrong, indicating that sycophancy tracks uncertainty.67% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1012077API
curl https://kongchang.com/api/v1/knowledge/claims/1012077MCP
get_claim(id=1012077)