Unverified50% confidenceFactExact time
Muon orthogonalizes the matrix after the momentum update (for example, approximating the polar decomposition via Newton-Schulz iteration) and is often used in large-scale language model training.
1
Sources
50%
Confidence
Long-term
Relevance
11/1/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe MuonW and MuonH optimizers can guarantee at least linear growth of the cumulative effective learning rate under given conditions.63% similarUnverified科学机器学习（SciML）将传统科学计算与机器学习融合，通常将物理定律、守恒方程或微分方程作为约束嵌入模型训练过程63% similarUnverifiedIn the forward process, masked diffusion replaces any token with the [MASK] token at a certain rate, with the final state being a fully masked sequence, and its reverse process aligns closely with the BERT-style masked language model training objective.62% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1124201API
curl https://kongchang.com/api/v1/knowledge/claims/1124201MCP
get_claim(id=1124201)