[KongchangAI]
Conceptmatched intervention

Matched Intervention

An experimental design for performing causal interventions in activation space. By applying perturbations of equal dimension and similar norm but differing direction, it separates the effects of perturbation magnitude from those of direction or location on model behavior.

Timeline (last 90 days)

Nov 18

Matched intervention experiments show that perturbing the answer subspace significantly changes model predictions, whereas perturbing the disagreement representation (even with the same dimensions) barely changes predictions, with an effect similar to a random subspace.

Unverified50%
Nov 18

Matched intervention applies perturbations of the same dimension and similar norm to two conditions, changing only the direction in which the perturbation lies, thereby separating the effect of perturbation magnitude from that of direction/position.

Unverified50%

All Facts (2)

Source Articles