Unverified50% confidenceOpinionExact time
作者将该现象解读为梯度下降在训练中刻意将某些模式和概念安放在噪声区间
1
Sources
50%
Confidence
Long-term
Relevance
7/16/2026
First Seen
Sources
Related Claims
UnverifiedHigh bias means the model is too simple and leads to underfitting, while high variance means the model has learned noise and leads to overfitting, and the two tend to trade off against each other.75% similarUnverifiedExperiments show that after only a few generations of self-training, the variance of model outputs drops sharply and the text tends toward homogeneity72% similarUnverifiedDuring cross-domain fine-tuning, an excessively large learning rate will destroy pre-trained weights, while an excessively small one will result in almost no learning, requiring a careful trade-off.71% similarUnverifiedThe understanding of text-to-image models is essentially large-scale statistical association, and generation quality drops significantly when dealing with long-tail concepts that appear rarely in the training set.70% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/530589API
curl https://kongchang.com/api/v1/knowledge/claims/530589MCP
get_claim(id=530589)