Conceptspectral scaling
Spectral scaling
A scaling method proposed in DP-μP that combines the signal-to-noise ratio condition with matrix spectral properties to provide learning-rate scaling rules for different privacy optimizers.
Timeline (last 90 days)
Oct 19
DP-μP proposes a spectral scaling formula that combines the SNR condition with matrix spectral properties to give concrete scaling rules for different optimizers.
Unverified50%