Minimal Pair
A classic experimental design in linguistics and psycholinguistics that constructs sentence pairs identical except for one critical component, isolating that component's contribution by comparing differences in internal representations.
Timeline (last 90 days)
The paper "Present but Hard to Read: Probing Latent Reasoning with Minimal Pairs" uses minimal-pair experiments to challenge the default assumption that "if a probe cannot read it out, the model does not represent it."
For research that relies on probe conclusions to infer what a model "knows," minimal-pair designs and synthetic nulls should become standard configuration.
In the minimal-pair design, the question within each pair remains the same while one key fact changes, in order to test whether the model responds accordingly to changes in evidence.
Minimal pairs are an experimental design method borrowed from linguistics, where the term refers to two words that differ by only one phoneme.
Minimal pairs can isolate the effect of a single key fact, thereby improving the causal interpretability of the evaluation.
All Facts (5)
The paper "Present but Hard to Read: Probing Latent Reasoning with Minimal Pairs" uses minimal-pair experiments to challenge the default assumption that "if a probe cannot read it out, the model does not represent it."
50%UnverifiedFor research that relies on probe conclusions to infer what a model "knows," minimal-pair designs and synthetic nulls should become standard configuration.
50%UnverifiedIn the minimal-pair design, the question within each pair remains the same while one key fact changes, in order to test whether the model responds accordingly to changes in evidence.
50%UnverifiedMinimal pairs are an experimental design method borrowed from linguistics, where the term refers to two words that differ by only one phoneme.
50%UnverifiedMinimal pairs can isolate the effect of a single key fact, thereby improving the causal interpretability of the evaluation.
50%