FP8 quantization can compress the weights of a 7B model from approximately 14GB (FP16) to approximately 7GB.