Person
Gnanapragasam
Gnanapragasam is a researcher who co-authored the paper "A Fix for Softmax and Cross-Entropy" with Barron and Tschannen, studying numerical precision issues in cross-entropy computation.
Timeline (last 90 days)
Nov 2
The paper "A Fix for Softmax and Cross-Entropy" by Barron, Gnanapragasam and Tschannen (October 2026) points out that standard cross-entropy computation rounds the gradient of the correct answer to exactly zero when the model is sufficiently confident (a margin of about 5.5 under bf16).
Unverified50%