Unverified50% confidenceOpinionExact time
In the CS231n assignments, students get stuck when deriving the softmax cross-entropy gradient because it involves the coupling of the Jacobian with probability normalization; implementing the batchnorm backward pass tests an even finer grasp of the chain rule.
1
Sources
50%
Confidence
Long-term
Relevance
10/14/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedEntropy collapse is especially prominent in long Chain-of-Thought training, because reward signals are only given at the end of the reasoning chain and gradient signals at intermediate steps are extremely sparse.67% similarUnverified如果交叉熵稳步下降而Dice波动剧烈，问题几乎可以确定出在Dice损失的配置上65% similarUnverifiedThe model uses class-weighted cross-entropy loss, assigning each class a weight inversely proportional to its frequency to mitigate data imbalance.64% similarUnverifiedCross-entropy loss often converges faster than MSE in classification tasks because, when paired with softmax output, gradients do not vanish in the saturation region.64% similarUnverifiedLLM的幻觉问题源于其训练目标是最小化交叉熵损失而非优化命题真值，是与生成机制深度耦合的固有特性而非偶发缺陷63% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1029095API
curl https://kongchang.com/api/v1/knowledge/claims/1029095MCP
get_claim(id=1029095)