ConceptNeuron-Level Specialization
Neuron-Level Specialization
A phenomenon in MoE models in which the contribution of individual neurons within an expert diverges toward specific domains. It is finer-grained and more stable than expert-level specialization.
Timeline (last 90 days)
Nov 11
Domain specialization at the neuron level is consistent across samples, far exceeding the ambiguous signals observed at the expert level.
Unverified50%