-
Frank Lin authored
* NVTE_OVERRIDE_MAX_SEQ_LEN Signed-off-by:
Frank Lin <eee4017@gmail.com> * small fix Signed-off-by:
Frank Lin <eee4017@gmail.com> * preserve old amax_and_scale_update_inplace and new amax_and_scale_update_inplace Signed-off-by:
Frank Lin <eee4017@gmail.com> * remove useless code path; try to simplify logic within the baseline Signed-off-by:
Frank Lin <eee4017@gmail.com> * simplify logic Signed-off-by:
Frank Lin <eee4017@gmail.com> * small fix Signed-off-by:
Frank Lin <eee4017@gmail.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * fix comments from Timmoon Signed-off-by:
Frank Lin <eee4017@gmail.com> * fix comments from Timmoon Signed-off-by:
Frank Lin <eee4017@gmail.com> * Update transformer_engine/paddle/distributed.py Co-authored-by:
Tim Moon <4406448+timmoon10@users.noreply.github.com> Signed-off-by:
Frank Lin <eee4017@gmail.com> * diable bw fp8 update Signed-off-by:
Frank Lin <eee4017@gmail.com> * fix lint Signed-off-by:
Frank Lin <eee4017@gmail.com> * fix ci error Signed-off-by:
Frank Lin <eee4017@gmail.com> --------- Signed-off-by:
Frank Lin <eee4017@gmail.com> Co-authored-by:
Frank Lin (Engrg-Hardware 1) <fralin@nvidia.com> Co-authored-by:
pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by:
Tim Moon <4406448+timmoon10@users.noreply.github.com>
3a9a4c83