Unverified50% confidenceFactExact time
Imposing a rank cap on the Transformer's MLP input weights delays grokking onset compared with a full-rank decomposition control group.
1
Sources
50%
Confidence
Long-term
Relevance
10/27/2026
First Seen
Sources
Related Entities
Related Claims
Unverified标准Transformer在处理需要精确计数、栈操作或复杂状态依赖的任务时表现不稳定，与其注意力机制的软寻址特性有关72% similarUnverifiedTransformer模型存在位置偏差，对中间位置信息的检索能力尤其薄弱，即lost in the middle问题71% similarVerifiedTransformer overcomes the long-range dependency attenuation caused by sequential computation in RNN/LSTM architectures, while natively supporting parallel computation.70% similarVerifiedThe prefill stage of Transformer inference is primarily bottlenecked by compute (FLOPS), while the decode stage is primarily bottlenecked by memory bandwidth.70% similarUnverifiedWhen a Transformer outputs tokens through sampling, it permanently loses information about which possibilities the model considered and their respective confidence levels (a lossy process).69% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1102244API
curl https://kongchang.com/api/v1/knowledge/claims/1102244MCP
get_claim(id=1102244)