Concept尾声融合 / epilogue fusion
epilogue fusion
A GPU kernel optimization technique that fuses element-wise operations following matrix multiplication—such as bias addition and activation functions—into the epilogue stage of a GEMM kernel. By avoiding intermediate result write-backs to device memory, this approach significantly reduces memory access overhead and lowers latency.
Timeline (last 90 days)
Sep 11
PyTorch 2.14 integration supports epilogue fusion, which fuses element-wise operations such as bias addition, activation functions, and scaling into the epilogue stage of GEMM kernels.
Unverified50%