[KongchangAI]
ConceptHTMP / 高温Marchenko-Pastur分布 / High-Temperature Marchenko-Pastur

Marchenko-Pastur Distribution

A classical result in random matrix theory describing the eigenvalue distribution of large random matrices. Its high-temperature variant (HTMP) increases the variance parameter to produce heavier distribution tails, making it suitable for characterizing the heavy-tailed phenomena observed in weight matrices of trained deep neural networks.

Source Articles