1 related articles
DeepSpeed is no longer just ZeRO. Recent updates bring optimized tensor, sequence, and expert parallelism for MoE training, now rivaling top frameworks with ZeRO-level ease of use.
