ConceptHTMP / 高温Marchenko-Pastur分布 / High-Temperature Marchenko-Pastur
Marchenko-Pastur Distribution
A classical result in random matrix theory describing the eigenvalue distribution of large random matrices. Its high-temperature variant (HTMP) increases the variance parameter to produce heavier distribution tails, making it suitable for characterizing the heavy-tailed phenomena observed in weight matrices of trained deep neural networks.