held-out BPB
Bits per byte on a held-out set, a metric measuring the compression efficiency of a language model; a lower value indicates that the model predicts unseen text more accurately.
Timeline (last 90 days)
In a new quality-driven search, reusing the findings revealed by Arena achieved lower training loss under matched data and FLOPs, and lower held-out BPB at the same model size.
Held-out BPB (bits per byte) is a metric that measures the compression efficiency of a language model, where a lower value indicates more accurate prediction of unseen text.
All Facts (2)
In a new quality-driven search, reusing the findings revealed by Arena achieved lower training loss under matched data and FLOPs, and lower held-out BPB at the same model size.
50%UnverifiedHeld-out BPB (bits per byte) is a metric that measures the compression efficiency of a language model, where a lower value indicates more accurate prediction of unseen text.
50%