Unverified50% confidenceFactExact time
Anthropic 团队曾在小型 Transformer 中识别出负责复制粘贴上文 token 的 induction head（归纳头）
1
Sources
50%
Confidence
Long-term
Relevance
8/27/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedAnthropic团队于2022年解析了Transformer内部的归纳头（induction heads）机制74% similarUnverifiedThe original paper on Switch Transformer discusses the design of introducing auxiliary loss functions to enforce uniform distribution among experts.63% similarUnverifiedHugging Face Transformers封装了预训练模型的加载、微调和推理流程62% similarUnverified残差连接是 Transformer 的核心创新之一，每一层的输出是输入加上该层的变换结果62% similarUnverified在Transformer中残差流的写入操作是线性叠加（加法），使不同模块的贡献保持可分离性，是机制可解释性追踪信息来源的数学基础60% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/809962API
curl https://kongchang.com/api/v1/knowledge/claims/809962MCP
get_claim(id=809962)