[KongchangAI]
Unverified50% confidenceFactExact time

Logit lens directly multiplies the residual stream representation at a certain intermediate layer by the model's final unembedding matrix, projects it back into vocabulary space, and reads out the most likely next word for that layer; its advantage is that it requires no training and is almost zero-cost, and its disadvantage is that the semantics gradually drift as the number of layers deepens.

1
Sources
50%
Confidence
Long-term
Relevance
10/12/2026
First Seen

Sources

Related Entities

Related Claims

Cite This Claim

Stable URI
https://kongchang.com/claim/1012070
API
curl https://kongchang.com/api/v1/knowledge/claims/1012070
MCP
get_claim(id=1012070)