Unverified50% confidenceFactExact time
The complete training objective is L = α·L_CE(y, p_s) + (1-α)·T²·L_KL(p_t^T, p_s^T), where T² is a gradient correction factor introduced by temperature scaling.
1
Sources
50%
Confidence
Long-term
Relevance
9/21/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedTemperature and Top-k are decoding strategies at the inference stage and do not affect the training process63% similarUnverifiedTraining hundred-billion-parameter models such as GPT-3 requires scheduling strategies such as learning rate warmup and cosine annealing, as well as engineering techniques such as mixed-precision training and gradient accumulation.61% similarUnverifiedThe core process of training a model is to iteratively update parameters in the direction of the loss function's gradient via gradient descent.59% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/937979API
curl https://kongchang.com/api/v1/knowledge/claims/937979MCP
get_claim(id=937979)