Unverified50% confidenceOpinionExact time
Traditional SGD analyses treat momentum as an auxiliary variable or simply drop it, ignoring the geometrically decaying memory that the momentum state itself carries as a recursive variable.
1
Sources
50%
Confidence
Long-term
Relevance
10/14/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedSVD 分解是理解低秩近似与模型压缩（如 LoRA 等参数高效微调方法）的基础63% similarUnverified稀疏自编码器（SAE）的思路是将模型某一层的激活值投影到更高维的稀疏空间，通过约束每次激活时只有少量特征被激活，迫使模型学习出更解耦的单义特征61% similarUnverifiedThe learnable parameters of hyperdimensional classifiers are low-bit angle values, which the paper refers to as phase memory.61% similarUnverifiedThe experience reuse mechanism is conceptually similar to a combination of RAG and few-shot prompting; it deliberately avoids model fine-tuning and shares the same lineage as external memory solutions such as MemGPT (now Letta).61% similarUnverifiedState Space Models (SSMs) pull the direction back toward fixed-size recurrent memory, but use a different state structure and update rules.59% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1023456API
curl https://kongchang.com/api/v1/knowledge/claims/1023456MCP
get_claim(id=1023456)