[KongchangAI]
ConceptNeuron-Level Specialization

Neuron-Level Specialization

A phenomenon in MoE models in which the contribution of individual neurons within an expert diverges toward specific domains. It is finer-grained and more stable than expert-level specialization.

Timeline (last 90 days)

Nov 11

Domain specialization at the neuron level is consistent across samples, far exceeding the ambiguous signals observed at the expert level.

Unverified50%

All Facts (1)

Source Articles