Unverified50% confidenceFactExact time
The temperature T plays a key role in Ambient SFT: at high temperatures the softmax output tends toward uniformity, and the KL term's constraint on the distribution becomes coarse-grained, requiring only that the model stay consistent with the teacher on larger class groupings.
1
Sources
50%
Confidence
Long-term
Relevance
11/18/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedSoft-label distillation uses a temperature hyperparameter T, dividing logits by T before applying softmax; the larger T is, the smoother the distribution becomes.68% similarUnverifiedSoft-DTW controls the degree of smoothing via a temperature parameter γ; when γ→0 it degenerates to the original DTW, and as γ increases the gradients become smoother but the metric accuracy is somewhat reduced.59% similarUnverifiedLandauer原理指出不可逆计算的每次信息擦除必然产生热量,具体为kT·ln2焦耳/比特59% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1182996API
curl https://kongchang.com/api/v1/knowledge/claims/1182996MCP
get_claim(id=1182996)