[KongchangAI]
Unverified50% confidenceSolutionExact time

In the NanoGPT Speedrun, Muon is typically applied only to the matrix weights of hidden layers, while the embedding layer and output layer retain AdamW.

1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
9/12/2026
First Seen
Valid until: 12/11/2026

Sources

Related Entities

Related Claims

Cite This Claim

Stable URI
https://kongchang.com/claim/910677
API
curl https://kongchang.com/api/v1/knowledge/claims/910677
MCP
get_claim(id=910677)