ConceptOverparameterized Model
Overparameterized Model
A model whose number of parameters far exceeds the number of training samples. Such models exhibit a benign loss landscape, are easy to optimize and achieve good generalization performance.
Timeline (last 90 days)
Nov 2
The paper provides critical point classification results under the two-neuron ReLU teacher-student model setting, and these results echo prior work on matrix factorization and overparameterized models.
Unverified50%