Unverified50% confidenceFactExact time
线性回归的最小二乘损失与逻辑回归的交叉熵损失分别对应高斯噪声假设与伯努利分布假设下的最大似然估计
1
Sources
50%
Confidence
Long-term
Relevance
7/14/2026
First Seen
Sources
掌握数学和Python后，如何系统入门机器学习
Related Claims
UnverifiedAssuming the data follows a Bernoulli or multinomial distribution, maximizing the likelihood is equivalent to minimizing the cross-entropy loss function.78% similarUnverifiedMinimizing cross-entropy is equivalent to minimizing the KL divergence between the true distribution and the predicted distribution.71% similarUnverifiedFocal Loss adds a modulating factor (1-p_t)^γ before the standard cross-entropy loss, with γ typically set to 2, causing the model to focus on hard examples.70% similarUnverifiedFinite-sample estimation of entropy rate faces a systematic negative bias problem, where plug-in estimators tend to underestimate the true entropy; this can be compensated using the Miller-Madow correction by adding a (k-1)/(2N) term.69% similarVerifiedThe cross-entropy loss in classification tasks is essentially the negative of the log-likelihood function, and minimizing cross-entropy is equivalent to maximizing the log-likelihood of the model on the training data.68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/503609API
curl https://kongchang.com/api/v1/knowledge/claims/503609MCP
get_claim(id=503609)