transformer_engine/pytorch/module/linear.py · a0754757660ac5a747b0be54c5398fca032161aa · OpenDAS / TransformerEngine · GitLab

Find file Blame History Permalink

fix gradient accumulation fusion for FSDP (#2371) · d8f1e68f

Lifu Zhang authored Nov 12, 2025

Signed-off-by: Lifu Zhang <lifuz@login-lyris01.lyris.clusters.nvidia.com>
Co-authored-by: Lifu Zhang <lifuz@login-lyris01.lyris.clusters.nvidia.com>
Co-authored-by: Tim Moon <4406448+timmoon10@users.noreply.github.com>

d8f1e68f

linear.py 74.7 KB