Linear Probing
A neural network interpretability technique in which lightweight linear classifiers are trained on the hidden states of individual model layers to detect whether a given layer's representations encode specific attribute information.
Timeline (last 90 days)
The smooth degradation at 60% sparsity was measured under a linear probing protocol, and the abstract does not provide data on whether performance is equally stable in downstream fine-tuning or zero-shot scenarios.
Through linear probing or a simple classifier, the language identity of each frame can be read out along the language selectivity dimension, without additional annotated data or large-scale fine-tuning.
All Facts (2)
The smooth degradation at 60% sparsity was measured under a linear probing protocol, and the abstract does not provide data on whether performance is equally stable in downstream fine-tuning or zero-shot scenarios.
50%UnverifiedThrough linear probing or a simple classifier, the language identity of each frame can be read out along the language selectivity dimension, without additional annotated data or large-scale fine-tuning.
50%