Unverified50% confidenceFactExact time
The eigenvalues of orthogonal matrix initialization have a modulus of 1, which neither grows nor decays exponentially under repeated matrix multiplication, effectively mitigating vanishing and exploding gradients.
1
Sources
50%
Confidence
Long-term
Relevance
9/9/2026
First Seen
Sources
Related Entities
Related Claims
Unverified梯度爆炸的数学本质与链式法则和矩阵连乘的谱范数相关，当雅可比矩阵的最大奇异值持续大于1时，梯度会随层数指数级增长73% similarUnverifiedFlattening a matrix and feeding it to an MLP results in a non-fixed input dimension due to variable row counts, and breaks permutation invariance.72% similarUnverifiedWhen the factors multiplied by the chain rule are continuously less than 1, gradients decay exponentially (vanishing); when they are continuously greater than 1, gradients grow exponentially (exploding).69% similarUnverified正交变换保持向量的L2范数和向量间夹角不变，正交矩阵的条件数恒为167% similarUnverified哈达玛变换用于量化预处理时不会引入额外的数值不稳定性，因为其条件数恒为166% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/884843API
curl https://kongchang.com/api/v1/knowledge/claims/884843MCP
get_claim(id=884843)