Causal Cross-Entropy Loss

A training loss function for autoregressive sequence generation that computes prediction error uniformly for every token position in the sequence, without distinguishing the hierarchical structure to which tokens belong.