Format-Aware Fusion

An engineering optimization technique for FP4 low-precision training that co-designs quantization producers, scaling domains, and consumer layouts to eliminate hidden overhead from format conversion and layout reshuffling, thereby translating the theoretical throughput advantages of FP4 into practical training gains.