Unverified50% confidenceTradeoffExact time
温度超参数τ越小分布越集中，模型对难负样本越敏感，但τ过小会导致梯度对异常值敏感、训练不稳定
1
Sources
50%
Confidence
Long-term
Relevance
7/16/2026
First Seen
Sources
Related Claims
UnverifiedThe higher the temperature parameter, the flatter the probability distribution output by Softmax, and the more creative and diverse the output; the lower the temperature, the sharper the distribution and the more deterministic and conservative the output.74% similarUnverified对MoE模型的量化需要格外谨慎，因稀疏激活使专家参数数值分布集中，低比特量化易造成路由偏差导致能力退化74% similarUnverifiedSome models carry the risk of over-optimization toward test sets, causing leaderboard scores to deviate from real-world performance (benchmark saturation).72% similarUnverifiedTemperature controls the flatness of the sampling distribution; a higher value tends toward selecting lower-probability words, while Top-p dynamically narrows the candidate vocabulary set through a cumulative probability threshold.72% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/527097API
curl https://kongchang.com/api/v1/knowledge/claims/527097MCP
get_claim(id=527097)