Sparse Probing

A method for identifying functional neuron subsets within neural networks. L1 regularization is applied during linear probe training to enforce sparse weights; L2-constrained measurement then quantifies the predictive capacity of sparse features. Repeated experiments are used to determine stable, consistently important neurons.