Unverified50% confidenceFactExact time
The paper's proposed ZE-EDEN method uses a second-moment codebook that excludes zero and rescales the quantized second-moment blocks to mitigate the preconditioner distortion caused by the positive quantization lower bound.
1
Sources
50%
Confidence
Long-term
Relevance
10/13/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe paper's proposed ZIP-SR method retains zero in the second-moment codebook and performs the probability computation for stochastic rounding in the preconditioner space.65% similarUnverifiedWhen ε ≈ 1, the gradient second-moment term in the denominator is diluted, adaptive scaling has almost no effect, and the optimizer behaves close to pure SGD.65% similarVerifiedLoRA decomposes the weight update matrix ΔW into the product of two small matrices A and B whose ranks are much lower than the original matrix, reducing parameter count to as little as one ten-thousandth of the original or even less.64% similarUnverifiedThe residual structure makes F=0 the default option—as long as the F(x) weights are close to zero, the residual block degenerates into an identity mapping, thereby resolving the optimization difficulty of SGD in learning identity mappings.63% similarUnverifiedSol的论证使用堆积论证：一旦单零点密度超过1/2就会强制出现线性数量级的紧密三元组，每个三元组对应一个正谱缺陷63% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1013231API
curl https://kongchang.com/api/v1/knowledge/claims/1013231MCP
get_claim(id=1013231)