Functional Localization
A phenomenon in neural networks whereby the capacity for a specific task is concentrated in a small number of layers or components rather than being distributed uniformly across the entire network. It is a notable finding in mechanistic interpretability research.
Timeline (last 90 days)
The critical components identified by EAP are concentrated in specific layers, indicating the existence of functional localisation in the model.
The existence of functional localisation provides theoretical support for directions such as parameter-efficient fine-tuning and modular editing.
All Facts (2)
The critical components identified by EAP are concentrated in specific layers, indicating the existence of functional localisation in the model.
50%UnverifiedThe existence of functional localisation provides theoretical support for directions such as parameter-efficient fine-tuning and modular editing.
50%