The arithmetic intensity of the decoding stage in LLM autoregressive generation is extremely low: for a 7B-parameter FP16 model, one forward pass requires loading approximately 14 GB of weights but executes only about 14 GFLOPs of computation, resulting in an arithmetic intensity of approximately 1 FLOP/Byte, making it a bandwidth-bound workload.