- 03 Jul, 2024 1 commit
-
-
Reese Wang authored
* Integrate experimental ragged offset Signed-off-by:
Reese Wang <rewang@nvidia.com> * Use per sequence based offsets Signed-off-by:
-
- 02 Jul, 2024 2 commits
-
-
Tim Moon authored
Fix typo when selecting tuned RMSNorm kernels Signed-off-by:Tim Moon <tmoon@nvidia.com>
-
Frank Lin authored
* NVTE_OVERRIDE_MAX_SEQ_LEN Signed-off-by:
Frank Lin <eee4017@gmail.com> * small fix Signed-off-by:
Tim Moon <4406448+timmoon10@users.noreply.github.com> Signed-off-by:
Frank Lin (Engrg-Hardware 1) <fralin@nvidia.com> Co-authored-by:
pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by:
-
- 01 Jul, 2024 1 commit
-
-
Charlene Yang authored
* update FE to 1.5.2 Signed-off-by:
Charlene Yang <8636796+cyanguwa@users.noreply.github.com> * enable unfused attn for cross attn Signed-off-by:
-
- 26 Jun, 2024 3 commits
-
-
Kirthi Shankar Sivamani authored
* Add example of formatting files locally Signed-off-by:
Kirthi Shankar Sivamani <ksivamani@nvidia.com> * review Signed-off-by:
-
Charlene Yang authored
* disable CP-THD tests for fused attn on <sm90 Signed-off-by:
-
Tim Moon authored
cache was added in Python 3.9. Signed-off-by:
-
- 25 Jun, 2024 2 commits
-
-
Edenzzzz authored
* fix compilation Signed-off-by:
Edenzzzz <wtan45@wisc.edu> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci Signed-off-by:
-
Xin Yao authored
* GroupedGEMM via multi-stream cublas * fix A/B is nullptr while D is not nullptr * add fp8 grouped gemm * register with TorchScript * add the GroupedLinear layer --------- Signed-off-by:
Xin Yao <xiny@nvidia.com> Signed-off-by:
Phuong Nguyen <phuonguyen@nvidia.com> Co-authored-by:
Jiang Shao <jiangs@nvidia.com> Co-authored-by:
Qi Zhang <qizhang@nvidia.com> Co-authored-by:
-
- 24 Jun, 2024 1 commit
-
-
Phuong Nguyen authored
* adding option to select only .cpp files in a dir in the build tool * change cmake build path --------- Signed-off-by:
-
- 18 Jun, 2024 5 commits
-
-
Tim Moon authored
Release GIL in PyTorch pybind11 functions Signed-off-by: -
Charlene Yang authored
* simplify offset tensors Signed-off-by:
-
Charlene Yang authored
fix tp_initialized error Signed-off-by: -
Kirthi Shankar Sivamani authored
Signed-off-by: -
Kirthi Shankar Sivamani authored
* Remove optional UB build leftovers Signed-off-by:
-
- 17 Jun, 2024 2 commits
-
-
Sangkug Lym authored
* Add the option to use SM for P2P comm in TP overlap Signed-off-by:
Sangkug Lym <slym@nvidia.com> * cleanup Signed-off-by:
-
Alp Dener authored
replaced plain C asserts with NVTE_CHECK to avoid unused-variable warnings Signed-off-by:Alp Dener <adener@nvidia.com>
-
- 15 Jun, 2024 2 commits
-
-
Phuong Nguyen authored
* rm tensor check if the workspace is empty Signed-off-by:
-
Charlene Yang authored
* subclass DPA with BaseModule and test with test_gpt_checkpointing Signed-off-by:
-
- 14 Jun, 2024 4 commits
-
-
Pavel Shamis (Pasha) authored
* A hot fix to disable CE deadlock check Signed-off-by:
Pavel Shamis (Pasha) <pasharesearch@gmail.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci --------- Signed-off-by:
-
Kirthi Shankar Sivamani authored
* Apply formatting Signed-off-by:
-
Kirthi Shankar Sivamani authored
* Initial config test Signed-off-by:
-
Charlene Yang authored
* add attention docs Signed-off-by:
-
- 13 Jun, 2024 7 commits
-
-
Tim Moon authored
Signed-off-by: -
Alp Dener authored
* added DL framework callbacks for bootstrapping userbuffers without MPI Signed-off-by:
-
BoxiangW authored
* Add norm_factor arg into DotProductAttention Signed-off-by:
Boxiang Wang <boxiangw@nvidia.com> * Change kwarg name from `norm_factor` to `softmax_scale` Signed-off-by:
BoxiangW <45734921+BoxiangW@users.noreply.github.com> --------- Signed-off-by:
-
Phuong Nguyen authored
add more options for PR template Signed-off-by: -
Phuong Nguyen authored
* Splitted cpp_extensions.py, renamed mlp.py and fused_attn.py Signed-off-by:
-
Alp Dener authored
reverting autocast API back to PyTorch v2.3.1 and below Signed-off-by: -
Xin Yao authored
* expose multi_tensor_* kernels Signed-off-by:
-
- 12 Jun, 2024 7 commits
-
-
Oleg Goncharov authored
* Merged CT+dbias+dact into a single template Signed-off-by:
Oleg Goncharov <ogoncharov@nvidia.com> * Moved gated activations ifrom the cast_transpose_fused ito a sseparate cpp file Signed-off-by:
Oleg Goncharov <64355998+Oleg-Goncharov@users.noreply.github.com> * Update transformer_engine/common/transpose/cast_transpose_fusion.cu Co-authored-by:
-
rybakov authored
Signed-off-by:
Oleg Rybakov <orybakov@nvidia.com> Co-authored-by:
-
Sudhakar Singh authored
skip switching to nvfuser for torch >= 2.2 Signed-off-by:Sudhakar Singh <sudhakars@nvidia.com>
-
Kirthi Shankar Sivamani authored
Add top level path to search for .so in test build Signed-off-by: -
Ming-Xu Huang authored
* Reformat FP8 Meta 1. Reformat FP8 meta to be one-set-per-tensor. 2. Remove fp8_max and scale_inv. 3. Remove unused functions in fp8.py Signed-off-by:
Ming Huang <mingh@nvidia.com> * Fix unit-tests Signed-off-by:
-
Alp Dener authored
added @torch._disable_dynamo fixed deprecation warnings with torch autocast API for TE checkpoint Signed-off-by: -
Alp Dener authored
restricted fsdp asserts on primary fp8 weights to TE modules Signed-off-by:
-
- 11 Jun, 2024 2 commits
-
-
Keshav Balasubramanian authored
Signed-off-by:Keshav <keshavb@nvidia.com>
-
Phuong Nguyen authored
* added distributed test for ln_mlp primitive * added distributed test for LayerNorm layer * changed error messages --------- Signed-off-by:
-
- 10 Jun, 2024 1 commit
-
-
Phuong Nguyen authored
- Made order of gated act consistent in all branches Signed-off-by:
-
