CPU Offloading

A large model deployment strategy that distributes model weights across GPU VRAM and system RAM on a per-layer basis, transferring layers on demand during inference. This approach enables local execution of models that exceed the memory capacity of a single GPU.