Activation Patching
A standard causal intervention method in mechanistic interpretability research. It operates by replacing activations at specific layer positions from a clean forward pass into a corrupted forward pass, then observing changes in output to identify causally critical positions for information processing within a model's internal computations.
Core Facts
Timeline (last 90 days)
The intervention experiment copied the transient state at the answer position in a number prompt to another number prompt at five different depths, observing which prompt the final animal score followed; this method is essentially an Activation Patching technique.
All Facts (3)
AUC值域为0.5到1.0，0.5代表随机猜测、1.0代表完美预测，不受样本类别不平衡影响
75%UnverifiedThe intervention experiment copied the transient state at the answer position in a number prompt to another number prompt at five different depths, observing which prompt the final animal score followed; this method is essentially an Activation Patching technique.
50%Unverified激活修补由Meng等人在2022年的ROME论文中广泛推广，其原理是将一次运行中某层的激活值移植到另一次运行中观察输出变化，从而进行因果推断
50%