- 03 Sep, 2024 2 commits
-
-
Ruibin Cheung authored
[PyTorch] Add contiguous check for grouped gemm Signed-off-by:
beinggod <zhangruibin@01.ai> Co-authored-by:
Kirthi Shankar Sivamani <ksivamani@nvidia.com>
-
Kirthi Shankar Sivamani authored
* Improvements for wheels Signed-off-by:
-
- 30 Aug, 2024 2 commits
-
-
Xiaowei Ren authored
* fix qkv_dtype of FP8+CP Signed-off-by:
Xiaowei Ren <xren@nvidia.com> * config cp correction dtype of FP8+CP Signed-off-by:
pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by:
Charlene Yang <8636796+cyanguwa@users.noreply.github.com>
-
Charlene Yang authored
* fix FP8 logic when FA3 is not installed Signed-off-by:
-
- 29 Aug, 2024 1 commit
-
-
Xin Yao authored
* remove dtype from args * update docs with permutation ops --------- Signed-off-by:Xin Yao <xiny@nvidia.com>
-
- 27 Aug, 2024 1 commit
-
-
Kirthi Shankar Sivamani authored
Signed-off-by:
-
- 24 Aug, 2024 2 commits
-
-
Kirthi Shankar Sivamani authored
bump cudnn-frontend version Signed-off-by: -
hXl3s authored
* Limit number of architectures build Signed-off-by:
Lukasz Pierscieniewski <lukaszp@nvidia.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci --------- Signed-off-by:
Tim Moon <4406448+timmoon10@users.noreply.github.com>
-
- 23 Aug, 2024 3 commits
-
-
Charlene Yang authored
* WIP: add fa3 Signed-off-by:
-
Alexandros Koumparoulis authored
Signed-off-by:Alexandros Koumparoulis <akoumparouli@nvidia.com>
-
Frédéric Bastien authored
* Use jit instead of pjit --------- Signed-off-by:
Frederic Bastien <fbastien@nvidia.com> Co-authored-by:
Phuong Nguyen <36155692+phu0ngng@users.noreply.github.com>
-
- 22 Aug, 2024 2 commits
-
-
NVJiangShao authored
* Add permutation functions * Add permutation ops * Remove the dependency on cutlass * Move permutation.py out of module dir * Rewrite the unit test and enable skipping if FP8 is unavailable * Rename exposed C++ API and reorder its parameters + take NVTETensor as inputs * Use Float8Tensor for FP8 input * Move dtype to ctx --------- Signed-off-by:
Jiang Shao <jiangs@nvidia.com> Co-authored-by:
Qi Zhang <qizhang@nvidia.com> Co-authored-by:
-
Kirthi Shankar Sivamani authored
* Re-add framework specific required dependencies for source build Signed-off-by:
-
- 21 Aug, 2024 4 commits
-
-
Charlene Yang authored
* add support for padding in UnfusedDPA Signed-off-by:
-
Xiaowei Ren authored
* add window_size to AttnFuncWithCP Signed-off-by:
Xiaowei Ren <xren@cs-cw-dfw-login-01.cm.cluster>
-
Charlene Yang authored
* update FE to 1.6 Signed-off-by:
-
Tim Moon authored
* Perform scale-inv update in cast-transpose kernels Signed-off-by:
Tim Moon <tmoon@nvidia.com> * Perform scale-inv update in cast and activation kernels Signed-off-by:
-
- 20 Aug, 2024 1 commit
-
-
hXl3s authored
feat(pytorch): Allow TransformerLayer and MultiheadAttention to accept sequence length parameters (#1066) * Added ability for seqlen for transformer and mha layer Signed-off-by:
Przemek Tredak <ptredak@nvidia.com> --------- Signed-off-by:
-
- 19 Aug, 2024 3 commits
-
-
Frédéric Bastien authored
Signed-off-by:
-
Przemyslaw Tredak authored
Signed-off-by: -
Kirthi Shankar Sivamani authored
Signed-off-by:
-
- 16 Aug, 2024 2 commits
-
-
Shijie authored
* support dtype casting fusion in FusedAdam Signed-off-by:
Shijie Wang <jaywan@nvidia.com> * minor changes Signed-off-by:
-
Xiaowei Ren authored
* add window_size to AttnFuncWithCP Signed-off-by:
-
- 15 Aug, 2024 2 commits
-
-
Charlene Yang authored
fix typos regarding t in thd Signed-off-by: -
Marks101 authored
Signed-off-by:
Markus Schnoes <markus.schnoes@gmx.de> Co-authored-by:
-
- 14 Aug, 2024 6 commits
-
-
Tim Moon authored
* Bump minimum CUDA version to 12.0 Signed-off-by:
-
Phuong Nguyen authored
* add default path for ffi include * add an option to get XLA_HOME from env --------- Signed-off-by:Phuong Nguyen <phuonguyen@nvidia.com>
-
Phuong Nguyen authored
Remove total time measurement Signed-off-by: -
Reese Wang authored
* Propagate sm_margin to the underly layernorm kernels --------- Signed-off-by:
Reese Wang <rewang@nvidia.com> Co-authored-by:
-
Kirthi Shankar Sivamani authored
* Switch to nltk>3.8.1 and new data Signed-off-by:
-
Phuong Nguyen authored
* implemented custom call with ffi in csrc * moved headers of misc to misc.h, add ffi.h * ActLu and DActLu lowering with ffi_lowering * CastTranspose with ffi_lowering * enabled cudaGraph * added 4d input test case to TestActivationLu * added operand_output_aliases for CastTranspose * added env var NVTE_JAX_WITH_FFI, default value = 1 * replace casting ActivationEnum by taking its value --------- Signed-off-by:
-
- 13 Aug, 2024 7 commits
-
-
Tim Moon authored
* Use minimal CUDA container for PyTorch GitHub build Signed-off-by:
-
Phuong Nguyen authored
rm test_dgeglu Signed-off-by: -
Phuong Nguyen authored
* add timing for build * using perf_counter --------- Signed-off-by: -
Charlene Yang authored
* update example/benchmark scripts Signed-off-by:
-
Charlene Yang authored
* merge k_channels and v_channels back to kv_channels and accept a tuple Signed-off-by:
-
vasunvidia authored
* DGRAD-RS overlap bug fix This PR fixes a bug in enabling DGRAD-RS overlap by adding the layer to the correct method list. Previously, the RS-DGRAD overlap layer was incorrectly added to pipeline method list even if ring_exchange method is specified in config. Signed-off-by:
Vasudevan Rengasamy <vrengasamy@nvidia.com> * Bug fix for ring_exchange ReduceScatter ring_exchange RS uses main_stream for last GEMM chunk. But the send/recv streams wait for stream_compute during last chunk. Signed-off-by:
-
Kirthi Shankar Sivamani authored
Signed-off-by:
-
- 12 Aug, 2024 2 commits
-
-
Przemyslaw Tredak authored
Signed-off-by: -
Phuong Nguyen authored
* added threading build back * integrating threading for pytorch and paddle extensions * added messages --------- Signed-off-by:
-
