docs/api/pytorch.rst · 63822008af2e4e693d2fa9dc854f70fdf1d39bf9 · OpenDAS / TransformerEngine

"googlemock/include/vscode:/vscode.git/clone" did not exist on "0d263789198e021b688942c55d483ad670c66f22"

Fix bugs for full activation recompute in FP8 (#24) · c149c145

Kirthi Shankar Sivamani authored Nov 16, 2022



* Fix bugs for full activation recompute in FP8
Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>

* Ensure identical numerics in recomputation for pipeline parallelism
Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>

* expose checkpoint API and add docs
Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>

* complete checkpointing docs
Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>
Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>

c149c145

pytorch.rst 913 Bytes

Replace pytorch.rst