Unverified50% confidenceFactExact time
For LLMs, the experimental object cannot be frozen: closed-source models cannot have their weights fixed, and open-source models also produce numerical-level deviations due to differences in inference frameworks, quantization precision, and hardware.
1
Sources
50%
Confidence
Long-term
Relevance
11/3/2026
First Seen
Sources
Old Conclusions Meet New Models: Insights from LLM Replication Research
hackernewshackernews11/3/2026
Related Entities
Related Claims
UnverifiedFor the LLM component, Reimer prefers open-weight models, with controllability as the core reason; closed frontier models have structural problems such as speed possibly declining over their lifecycle and not necessarily catering to P99 latency.77% similarUnverifiedLLM网关面临泄漏抽象问题，模型能力的本质差异会泄漏到上层，如system prompt格式、temperature参数语义、function calling调用规范差异75% similarUnverifiedThe implications for LLM engineering practice include: do not directly treat the probabilities output by the model as decision confidence; in scenarios where handoff to a human is not possible, a conservative fallback strategy should be explicitly designed; threshold selection requires statistical guarantees.74% similarUnverifiedLLM在推理阶段参数是冻结的，模型不会因用户交互而更新权重，因此本质上是无状态的74% similarVerifiedOpen-source models still lag behind top closed-source models on some complex reasoning and long-context tasks.74% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1130386API
curl https://kongchang.com/api/v1/knowledge/claims/1130386MCP
get_claim(id=1130386)