Unverified50% confidenceSolutionExact time
延迟解耦(Delayed Untying)的核心思想是:训练前2/3阶段将embed与lm_head绑定共享,到达某个节点后复制权重和优化器状态,然后让二者作为独立参数分别训练
1
Sources
50%
Confidence
Long-term
Relevance
8/24/2026
First Seen
Sources
Related Entities
Related Claims
Unverified输入嵌入与输出投影层在训练早期共享有利于稳定性,训练后期分离有利于表达力,构成一种权衡70% similarVerifiedDQN introduced two key innovations—experience replay and target networks—where the former breaks the strong temporal correlation in sequential data to stabilize training, and the latter prevents training oscillation and divergence.68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/793876API
curl https://kongchang.com/api/v1/knowledge/claims/793876MCP
get_claim(id=793876)