Unverified50% confidenceBenchmarkExact time
In the pre-registered experiment, the 4B model passed 70 of the same 96 trials.
1
Sources
50%
Confidence
Short-term (~14 days)
Relevance
11/11/2026
First Seen
Valid until: 11/25/2026
Sources
Related Entities
Related Claims
UnverifiedIn the pre-registered experiment, the 12B model passed all 96 trials on the 24-task order-desk test suite (96/96).78% similarUnverifiedThe researchers collected 4,249 run trajectories from four frontier models, plus 4,486 additional trials from 26 models.71% similarUnverified2024年一项研究对GPT-4在Temperature=0下的代码生成任务进行100次测试,发现约8%的测试用例存在跨次运行的输出差异70% similarUnverifiedThe research team tested the performance of lightweight models on 716 placement intents using four prompting settings (including zero-shot and few-shot reasoning).67% similarUnverifiedThe paper conducts experiments on the FineWeb-Edu dataset at four model scales, from 60M to 1B parameters.67% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1161192API
curl https://kongchang.com/api/v1/knowledge/claims/1161192MCP
get_claim(id=1161192)