transformer_engine/pytorch/fp8.py · 63822008af2e4e693d2fa9dc854f70fdf1d39bf9 · OpenDAS / TransformerEngine

Full activation recompute checkpointing bug fix (#31) · d10dfb57

Kirthi Shankar Sivamani authored Nov 23, 2022



fix checkpoint loading bug for FAR
Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>
Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>

d10dfb57

fp8.py 15.9 KB

Replace fp8.py