ConceptExcess Risk

Excess Risk

The difference between a model's risk on the test set and the optimal Bayes risk, measuring the additional generalization loss a model incurs due to memorization.

Timeline (last 90 days)

Oct 15

The authors construct a family of sampling priors such that the ratio between the "proposed penalty" and the "actual excess risk" grows exponentially with the sample size.

Unverified50%

All Facts (1)

Unverified

The authors construct a family of sampling priors such that the ratio between the "proposed penalty" and the "actual excess risk" grows exponentially with the sample size.

50%

Source Articles

Memorization Lower Bound Overturned: Posterior Frequencies Yield Exact CorrectionOct 15