[KongchangAI]
Product

TensorRT

NVIDIA推出的高性能深度学习推理优化器与运行时,自2015年发布,支持算子融合、精度校准(FP32/FP16/INT8/FP8)、内核自动调优、动态形状,是GPU推理部署的事实标准工具链

Timeline (last 90 days)

Aug 26

对于工程部署,ONNX Runtime、TensorRT等推理框架对Windows的支持已相当完善

Unverified50%
Aug 4

TensorRT optimizes inference performance through layer fusion, precision calibration, and automatic kernel tuning

Unverified90%
Aug 4

TensorRT only supports the NVIDIA ecosystem

Unverified85%

All Facts (3)

Source Articles