Conceptcounterfactual audit
Counterfactual Audit
A causal-inference-style evaluation method that holds other variables fixed while artificially changing one key variable and observes whether the outcome changes accordingly, in order to test whether that variable is a genuine causal factor.
Timeline (last 90 days)
Oct 13
The study uses counterfactual auditing to test the chain-of-thought faithfulness of legal AI: while keeping the case facts fixed and unchanged, it replaces the legal basis cited by the model and decodes the decision tendency from the model's hidden states, in order to judge whether the decision truly depends on the cited basis.
Unverified50%