TensorRT Edge-LLM

An NVIDIA software stack for optimizing large language model inference on edge devices. Built on the core TensorRT toolchain, it improves edge-side LLM deployment efficiency through techniques such as operator fusion, precision quantization, and automatic kernel tuning.