Causal Sensitivity
A metric for measuring explanation faithfulness that intervenes on intermediate reasoning steps and observes the proportion of change in the final output, reflecting whether intermediate steps are genuine causes of the answer.
Timeline (last 90 days)
Experiments in the paper show that while maintaining competitive predictive performance, CausalCoT improves the causal sensitivity of intermediate reasoning steps by an average of 12 percentage points over the strongest baseline, with a maximum improvement of 21 percentage points.
Causal sensitivity is a metric for explanation faithfulness: it examines the proportion of cases in which the final output changes accordingly when intermediate reasoning steps are artificially altered.
All Facts (2)
Experiments in the paper show that while maintaining competitive predictive performance, CausalCoT improves the causal sensitivity of intermediate reasoning steps by an average of 12 percentage points over the strongest baseline, with a maximum improvement of 21 percentage points.
50%UnverifiedCausal sensitivity is a metric for explanation faithfulness: it examines the proportion of cases in which the final output changes accordingly when intermediate reasoning steps are artificially altered.
50%