- 15 Oct, 2025 1 commit
-
-
Paul Gibbons authored
* fixes for start_end_list usage in TE debug Signed-off-by:
Paul Gibbons <pgibbons@nvidia.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci --------- Signed-off-by:
pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by:
Paweł Gadziński <62263673+pggPL@users.noreply.github.com>
-
- 14 Oct, 2025 5 commits
-
-
Tim Moon authored
* Require cuDNN 9.14.0+ for fused attention with FP8 current scaling Signed-off-by:
Tim Moon <tmoon@nvidia.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci --------- Signed-off-by:
Kirthi Shankar Sivamani <ksivamani@nvidia.com>
-
Kirthi Shankar Sivamani authored
* Initial API change Signed-off-by:
Tim Moon <4406448+timmoon10@users.noreply.github.com> * fix nvfp4 test Signed-off-by:
-
Kshitij Lakhani authored
* Add BRCM support when creating a test mask for fused attn Signed-off-by:
Kshitij Lakhani <klakhani@nvidia.com> * Add support for BRCM to correctly generate the mask needed for calculating the seqlens and offsets for THD Signed-off-by:
-
Evgeny Tsykunov authored
* Fix update_quantized in ref nvfp4 quantizer Signed-off-by:
Evgeny <etsykunov@nvidia.com> * Subclass quantization API Signed-off-by:
-
Kshitij Lakhani authored
Fix test path so that it gets triggered Signed-off-by:
-
- 13 Oct, 2025 5 commits
-
-
Selvaraj Anandaraj authored
* FSDP grad fusion support Signed-off-by:
Selvaraj Anandaraj <selvaraja@login-ptyche01.ptyche.clusters.nvidia.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Re-factored grad overwriting usage Signed-off-by:
Selvaraj Anandaraj <selvaraja@login-ptyche02.ptyche.clusters.nvidia.com> * Update transformer_engine/pytorch/ops/basic/basic_linear.py Co-authored-by:
Selvaraj Anandaraj <selvaraja@nvidia.com> * Update transformer_engine/pytorch/ops/fused/backward_linear_add.py Co-authored-by:
-
jberchtold-nvidia authored
assertion check Signed-off-by:Jeremy Berchtold <jberchtold@nvidia.com>
-
jberchtold-nvidia authored
* Improve error message for cublas fp8 gemm with incorrect shape Signed-off-by:
-
Peter St. John authored
Signed-off-by:
Peter St. John <pstjohn@nvidia.com> Co-authored-by:
-
Selvaraj Anandaraj authored
* Added multi-layout support for attention Signed-off-by:
Pawel Gadzinski <pgadzinski@nvidia.com> --------- Signed-off-by:
-
- 09 Oct, 2025 5 commits
-
-
Peter St. John authored
Don't pickle an empty dict in LayerNorm and BasicOperation layers Signed-off-by:
-
jberchtold-nvidia authored
Signed-off-by:
Phuong Nguyen <phuonguyen@nvidia.com>
-
Kirthi Shankar Sivamani authored
* Update minimum python version to 3.10 and update CI Signed-off-by:
-
Kirthi Shankar Sivamani authored
Deprecate old float8_tensor.py Signed-off-by: -
Kirthi Shankar Sivamani authored
Catch unsupported GEMM during recipe init Signed-off-by:
-
- 08 Oct, 2025 2 commits
-
-
Hua Huang authored
* Try async copy of grouped GEMM group_sizes data Signed-off-by:
Hua Huang <huah@nvidia.com> --------- Signed-off-by:
-
Kirthi Shankar Sivamani authored
Unblock path for fusing NVFP4 quantize and bgrad Signed-off-by:
-
- 07 Oct, 2025 3 commits
-
-
vcherepanov-nv authored
Signed-off-by:Vladimir Cherepanov <vcherepanov@nvidia.com>
-
Kirthi Shankar Sivamani authored
* Improve docstring for NVFP4 recipe Signed-off-by:
Przemyslaw Tredak <ptrendx@gmail.com> Signed-off-by:
Copilot <175728472+Copilot@users.noreply.github.com> Signed-off-by:
-
Phuong Nguyen authored
* reuse amax for current scaling Signed-off-by:
-
- 06 Oct, 2025 3 commits
-
-
Kirthi Shankar Sivamani authored
* Update test requirements for HF Signed-off-by:
-
Kiv Chen authored
[Build] fix: python platlib path Signed-off-by:
Kiv Chen <sdckivenchen@gmail.com> Co-authored-by:
-
Phuong Nguyen authored
* not fuse bias for output all reduction case + unit tests Signed-off-by:
-
- 05 Oct, 2025 1 commit
-
-
Przemyslaw Tredak authored
* Added the NVFP4 part to the low precision tutorial Signed-off-by:
Przemek Tredak <ptredak@nvidia.com> * Added the runtime results Signed-off-by:
-
- 04 Oct, 2025 2 commits
-
-
Kirthi Shankar Sivamani authored
* Fix in FP8 attention selection logic Signed-off-by:
-
Tim Moon authored
Signed-off-by:
-
- 03 Oct, 2025 2 commits
-
-
Jan Bielak authored
* Update to_string(NVTEScalingMode) to include block scaling Signed-off-by:
Jan Bielak <jbielak@nvidia.com> * Add `nvte_swizzle_block_scaling_to_mxfp8_scaling_factors` Signed-off-by:
-
vthumbe1503 authored
Signed-off-by:Varun Thumbe <vthumbe@nvidia.com> *Jax integration for clamped swiglu. This is the continuation of PR which added Clamped Swiglu(used in GPT OSS) support in TE along with Pytorch integration. This PR hooks up the clamped swiglu and dswiglu's nvte APIs to TE Jax.
-
- 02 Oct, 2025 4 commits
-
-
hx authored
* fix overflow of int32 in permute kernels Signed-off-by:
Hongxiao Bai <hongxiaob@nvidia.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci --------- Signed-off-by:
Xin Yao <xiny@nvidia.com> Co-authored-by:
-
jberchtold-nvidia authored
Fix shard map issue Signed-off-by:
-
jberchtold-nvidia authored
Fix code block in fp8_autocast docstring Signed-off-by:
-
Tim Moon authored
* Make sure to set usages for linear op quantizers before forward Signed-off-by:
-
- 01 Oct, 2025 7 commits
-
-
Przemyslaw Tredak authored
* Fix the cublas workspace alignment Signed-off-by:
-
Kirthi Shankar Sivamani authored
Fix passing args to nvfp4 recipe Signed-off-by: -
Kirthi Shankar Sivamani authored
Disable debug build for cutlass GEMM Signed-off-by: -
Evgeny Tsykunov authored
Fix QuantizedTensorBase -> QuantizedTensorStorage Signed-off-by: -
Phuong Nguyen authored
fix rng_state shape Signed-off-by:
jberchtold-nvidia <158520091+jberchtold-nvidia@users.noreply.github.com>
-
Phuong Nguyen authored
* rm using_global_amax_of_x Signed-off-by:
-
Evgeny Tsykunov authored
* Introduce QuantizerBase Signed-off-by:
-
