For million-token-level contexts, KV Cache can consume tens or even hundreds of gigabytes of GPU memory, becoming the primary bottleneck for long-context inference.