When choosing a quantization format, it is better to choose a slightly larger format that does not trigger CPU offloading (such as FP4) than to blindly pursue the smallest file size.