[KongchangAI]
Concept尾声融合 / epilogue fusion

epilogue fusion

A GPU kernel optimization technique that fuses element-wise operations following matrix multiplication—such as bias addition and activation functions—into the epilogue stage of a GEMM kernel. By avoiding intermediate result write-backs to device memory, this approach significantly reduces memory access overhead and lowers latency.

Timeline (last 90 days)

Sep 11

PyTorch 2.14 integration supports epilogue fusion, which fuses element-wise operations such as bias addition, activation functions, and scaling into the epilogue stage of GEMM kernels.

Unverified50%

All Facts (1)

Source Articles