Calibration Temperature Decoding

A decoding method for large language models that exploits model calibration properties. When a model is well calibrated, fitting a single scalar temperature offline yields near-optimal decoding performance, with zero additional inference-time overhead.