Unverified50% confidenceFactExact time
The paper introduces an entropy-regularized loss to prevent the routing distribution from becoming overly concentrated, encouraging a more diverse routing distribution.
1
Sources
50%
Confidence
Long-term
Relevance
10/8/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe model uses class-weighted cross-entropy loss, assigning each class a weight inversely proportional to its frequency to mitigate data imbalance.74% similarVerifiedCross-entropy loss originates from KL divergence in information theory and measures the degree of difference between the true probability distribution and the predicted probability distribution.69% similarUnverified如果交叉熵稳步下降而Dice波动剧烈，问题几乎可以确定出在Dice损失的配置上69% similarUnverifiedScaling Laws表明模型的交叉熵损失会随着计算量、数据量和参数量的增加而平滑下降，且这种下降关系可以用简单的幂律函数精确拟合67% similarUnverifiedEntropy collapse refers to the premature convergence of a model policy's output distribution, resulting in a loss of exploration capability and the model becoming trapped in a local optimum.66% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/986859API
curl https://kongchang.com/api/v1/knowledge/claims/986859MCP
get_claim(id=986859)