Polysemanticity

The phenomenon in which a single neuron in a neural network responds to multiple unrelated features. It is a core obstacle in the field of mechanistic interpretability, making it difficult for researchers to clearly map internal network activations to specific concepts.