[KongchangAI]
Unverified50% confidenceBenchmarkExact time

In experiment 3, the researchers removed the input and output layers and kept only four Transformer blocks, and the LLM correctly determined all of the languages the model was trained on (Python, English, and romaji Japanese), and was able to locate the attention head responsible for copying (the induction head).

1
Sources
50%
Confidence
Long-term
Relevance
11/6/2026
First Seen

Sources

Related Entities

Related Claims

Cite This Claim

Stable URI
https://kongchang.com/claim/1143752
API
curl https://kongchang.com/api/v1/knowledge/claims/1143752
MCP
get_claim(id=1143752)