ConceptCMI / Conditional Mutual Information
Conditional Mutual Information
An information-theoretic measure of the residual dependence between two random variables given a conditioning variable. In privacy analysis, it is used to quantify the amount of information about a single record that is leaked by the training process.
Timeline (last 90 days)
Oct 12
The information leaked during training is measured by conditional mutual information (CMI), and for DP-SGD this leakage bound depends only on two hyperparameters: the sampling rate and the noise multiplier.
Unverified50%