Unverified50% confidenceFactExact time
Kaiming initialization (He initialization) sets the variance proportional to twice the inverse of the input dimension, designed specifically for ReLU and its variants.
1
Sources
50%
Confidence
Long-term
Relevance
10/14/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedHe initialization targets ReLU and its variants, scaling the variance to twice that of Xavier.66% similarUnverifiedHe初始化针对ReLU激活函数设计，通过将权重方差设为2/n来保证各层激活值方差稳定59% similarUnverifiedXavier initialization (Glorot, 2010) and He initialization (He et al., 2015) are based on Gaussian or uniform distributions and maintain stable gradient flow by designing variances of 1/n and 2/n respectively (where n is the input dimension).56% similarUnverifiedXavier initialization was proposed by Glorot in 2010 and He initialization was proposed by He et al. in 2015; their variances are designed to be 1/n and 2/n respectively (where n is the input dimension).55% similarUnverifiedMuon优化器由Kosson等研究者提出，核心改进在于对梯度更新矩阵进行正交化处理51% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1027617API
curl https://kongchang.com/api/v1/knowledge/claims/1027617MCP
get_claim(id=1027617)