Unverified50% confidenceFactExact time
When the spectral radius of the combined operator is less than 1, the iterative process converges stably to a fixed point.
1
Sources
50%
Confidence
Long-term
Relevance
10/7/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedWhen the factors multiplied by the chain rule are continuously less than 1, gradients decay exponentially (vanishing); when they are continuously greater than 1, gradients grow exponentially (exploding).75% similarUnverifiedThe eigenvalues of orthogonal matrix initialization have a modulus of 1, which neither grows nor decays exponentially under repeated matrix multiplication, effectively mitigating vanishing and exploding gradients.71% similarUnverifiedLow-rank decomposition and quantization compression are orthogonally complementary dimensions; quantizing the smaller matrices A and B separately results in smaller errors, and the combined compression ratio can reach several times that of either method alone71% similarUnverifiedModel collapse occurs in two progressive stages: in the early collapse stage the output mean drifts, and in the late collapse stage the output variance approaches zero and generated content converges into a homogeneous, singular pattern.70% similarUnverifiedWhen ε ≈ 1, the gradient second-moment term in the denominator is diluted, adaptive scaling has almost no effect, and the optimizer behaves close to pure SGD.70% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/983409API
curl https://kongchang.com/api/v1/knowledge/claims/983409MCP
get_claim(id=983409)