transformer_engine/pytorch/utils.py · a9cfbfd3841932d60f4b5c78bb48393f1e8e3d31 · OpenDAS / TransformerEngine · GitLab

Find file Blame History Permalink

[PyTorch] Improve memory usage in backward of LayerNormLinear and LayerNormMLP (#509) · a9cfbfd3
Kirthi Shankar Sivamani authored Nov 13, 2023
```
Improve PyTorch memory usage
Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>
```
a9cfbfd3

utils.py 6.83 KB