Compared with the previous generation A100, the Hopper architecture has significant improvements in FP8 precision, the Transformer engine and NVLink interconnect bandwidth, making it the de facto standard hardware for large-scale language model training since 2023.