Unverified50% confidenceFactExact time
Xavier initialization (Glorot, 2010) and He initialization (He et al., 2015) are based on Gaussian distributions and ensure that the output variance of each layer is consistent with the input by designing the variance to be 1/n and 2/n respectively, where n is the input dimension.
1
Sources
50%
Confidence
Long-term
Relevance
9/1/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedXavier初始化适用于Sigmoid或Tanh等饱和激活函数，根据输入输出维度调整方差范围71% similarUnverified主流权重初始化方法如 He 初始化、Xavier 初始化均假设输入数据大致服从零均值分布62% similarUnverifiedThe Glivenko–Cantelli theorem guarantees that as the sample size increases, the empirical distribution function converges uniformly to the true distribution function.58% similarUnverified许多现代 embedding 模型会对输出做归一化，向量集中分布在高维球面锥形区域，任意两个embedding的余弦相似度通常落在偏正区间（如0.2到0.9）58% similarVerified混合专家架构MoE通过稀疏激活机制，推理时只激活模型总参数的1/8至1/457% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/834062API
curl https://kongchang.com/api/v1/knowledge/claims/834062MCP
get_claim(id=834062)