Unverified50% confidenceFactExact time
The log-score (i.e., cross-entropy) penalizes extreme errors more aggressively, and tends toward negative infinity when a model predicts the wrong answer with a probability close to 1.0.
1
Sources
50%
Confidence
Long-term
Relevance
9/28/2026
First Seen
Sources
Related Entities
Related Claims
Unverified当模型对某个训练样本的预测概率接近1时，该样本对应的交叉熵损失趋近于零，模型几乎无法获得梯度更新信号72% similarVerifiedThe cross-entropy loss in classification tasks is essentially the negative of the log-likelihood function, and minimizing cross-entropy is equivalent to maximizing the log-likelihood of the model on the training data.71% similarUnverifiedFinite-sample estimation of entropy rate faces a systematic negative bias problem, where plug-in estimators tend to underestimate the true entropy; this can be compensated using the Miller-Madow correction by adding a (k-1)/(2N) term.71% similarUnverifiedThe loss function (cross-entropy) of logistic regression is essentially negative log-likelihood.71% similarUnverifiedEven well-prompted, schema-constrained models with 8 billion to 14 billion parameters still have an error rate of a few percent on real-world inputs—this is a rate to design around, not a bug to eliminate.70% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/956115API
curl https://kongchang.com/api/v1/knowledge/claims/956115MCP
get_claim(id=956115)