- 09 Mar, 2026 1 commit
-
-
wuyf1 authored
Signed-off-by:
Wuyufan <Wuyf1@sugon.com> 解决了如下问题： 1. FA 48个单测报错问题（fA输入:[B,S,H,D] reshape to [blocknums,blocksize,H,D]）. 2. 在解决FA 报错的时候一个kernel launch error. 3. norm_mlp问题暂时用rest_rng_state解决 See merge request dcutoolkit/deeplearing/TransformerEngine!77 Co-authored-by:
Tangao <2205747538@qq.com> Co-authored-by:
wuyufffan <1095978552@qq.com>
-
- 24 Feb, 2026 1 commit
-
-
wenjh authored
Signed-off-by:wenjh <wenjh@sugon.com>
-
- 23 Jan, 2026 1 commit
-
-
maxiao3 authored
1,Resolve out-of-bounds issues for types struct 2,Fix TestFusedCastFloat8Vectorwise test case failure Signed-off-by:maxiao3 <maxiao3@sugon.com> See merge request dcutoolkit/deeplearing/TransformerEngine!73
-
- 12 Jan, 2026 1 commit
-
-
wenjh authored
Signed-off-by:
-
- 09 Jan, 2026 1 commit
-
-
wenjh authored
Signed-off-by:
-
- 08 Jan, 2026 1 commit
-
-
wenjh authored
Signed-off-by:
-
- 07 Jan, 2026 1 commit
-
-
wenjh authored
Signed-off-by:
-
- 31 Dec, 2025 3 commits
-
-
wenjh authored
Signed-off-by: -
wenjh authored
Signed-off-by: -
wenjh authored
Signed-off-by:
-
- 10 Dec, 2025 1 commit
-
-
tabuchixiangcai3 authored
Signed-off-by:
-
- 03 Dec, 2025 1 commit
-
-
wenjh authored
-
- 26 Nov, 2025 1 commit
-
-
Tim Moon authored
Do not initialize recipe state in base op class Op attrs may not be set. Move recipe state initialization to linear op constructor. Signed-off-by:Tim Moon <tmoon@nvidia.com>
-
- 23 Nov, 2025 2 commits
-
-
Tim Moon authored
Only disable Flash Attention in Userbuffers test on A100 Signed-off-by: -
Sudhakar Singh authored
* Add support for THD+CP+SWA through A2A comms Signed-off-by:
Sudhakar Singh <sudhakars@nvidia.com> * unblock the `padding`+`THD`+`CP(A2A)` with SWA case in A2A forward Signed-off-by:
greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com> Signed-off-by:
pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by:
-
- 20 Nov, 2025 6 commits
-
-
Kirthi Shankar Sivamani authored
Initial changes to remove pytorch overheads Signed-off-by:Kirthi Shankar Sivamani <ksivamani@nvidia.com>
-
Tim Moon authored
Disable Flash attention in Userbuffers tests Signed-off-by: -
Charlene Yang authored
* fix test_current_device Signed-off-by:
Charlene Yang <8636796+cyanguwa@users.noreply.github.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci --------- Signed-off-by:
-
Paweł Gadziński authored
* fix Signed-off-by:
Pawel Gadzinski <pgadzinski@nvidia.com> * fix Signed-off-by:
-
Paweł Gadziński authored
* fix Signed-off-by:
-
Charlene Yang authored
* [Common] Deleted unused header (#2324) Deleted unused header Signed-off-by:
Oleg Goncharov <ogoncharov@nvidia.com> Signed-off-by:
Peter Dykas <wdykas@nvidia.com> * [JAX] L1_jax_distributed_test suit with individual executions (#2321) * L1 rework Signed-off-by:
Phuong Nguyen <phuonguyen@nvidia.com> * comment out test_multi_process_grouped_gemm for now Signed-off-by:
Jeremy Berchtold <jberchtold@nvidia.com> * Set HF_HUB_OFFLINE to disable any network calls to HF when the pre-downloaded dataset is available Signed-off-by:
Przemek Tredak <ptredak@nvidia.com> Signed-off-by:
kunlunl <kunlunl@nvidia.com> * Rename keep_columnwise to manual_post_all_gather_processing & Optimize unit test Signed-off-by:
Tim Moon <4406448+timmoon10@users.noreply.github.com> Signed-off-by:
Kshitij Lakhani <klakhani@nvidia.com> * Consolidate documentation for DPA in JAX Co-authored-by:
Kshitij Lakhani <33047503+KshitijLakhani@users.noreply.github.com> * Correctly update the documentation for defaults in JAX DPA Co-authored-by:
tdophung <tdophung@nvidia.com> * Formatting Signed-off-by:
Oleg Goncharov <64355998+Oleg-Goncharov@users.noreply.github.com> Co-authored-by:
root <root@gpu-h100-0496.cm.cluster> Co-authored-by:
Paweł Gadziński <62263673+pggPL@users.noreply.github.com> Co-authored-by:
jberchtold-nvidia <158520091+jberchtold-nvidia@users.noreply.github.com> Co-authored-by:
Kunlun Li <94586211+kunlunl@users.noreply.github.com> Co-authored-by:
Michael Goldfarb <mgoldfarb@nvidia.com> Co-authored-by:
wdykas <73254672+wdykas@users.noreply.github.com>
-
- 14 Nov, 2025 3 commits
-
-
Paweł Gadziński authored
* init Signed-off-by:
root <root@ptyche0312.ptyche.clusters.nvidia.com> Co-authored-by:
-
jberchtold-nvidia authored
* Refactor to avoid storing a global quantization config so direct recipe passing works as intended Signed-off-by:
-
Robin Zhang authored
* reset cudagraph Signed-off-by:
Robin Zhang <robinz@nvidia.com> * use closure instead of mutable default values Signed-off-by:
-
- 13 Nov, 2025 2 commits
-
-
jberchtold-nvidia authored
* Support for checkpointing quantizations Signed-off-by:
JAX Toolbox <jax@nvidia.com> * Checkpoint quantizations Signed-off-by:
-
Evgeny Tsykunov authored
Fix amax computation using output_t data in normalization Signed-off-by:Evgeny <etsykunov@nvidia.com>
-
- 12 Nov, 2025 1 commit
-
-
Sudhakar Singh authored
* enable applying rope offsets in backwared Signed-off-by:
-
- 11 Nov, 2025 1 commit
-
-
vthumbe1503 authored
* fix for float8 tensor fsdp2 training Signed-off-by:
Varun Thumbe <vthumbe@nvidia.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * zeros_like should return fp32 for fsdp2 to work Signed-off-by:
-
- 10 Nov, 2025 1 commit
-
-
Teddy Do authored
* Changing default activations in MLP, TransformerLayer, dropout rate after FC1 to 0, and return_layernorm_output to False Signed-off-by:
-
- 07 Nov, 2025 1 commit
-
-
jberchtold-nvidia authored
* Add test to check jaxpr that amax is reused for nvfp4 recipe Signed-off-by:
-
- 06 Nov, 2025 1 commit
-
-
Kunlun Li authored
* Make cast_master_weights_to_fp8 compatible with older MCore version Signed-off-by:
-
- 05 Nov, 2025 1 commit
-
-
Paweł Gadziński authored
* code drop Signed-off-by:
-
- 04 Nov, 2025 1 commit
-
-
Paweł Gadziński authored
* code drop Signed-off-by:
-
- 03 Nov, 2025 7 commits
-
-
Phuong Nguyen authored
* L1 rework Signed-off-by:
-
zhaochao authored
-
zhaochao authored
Signed-off-by:zhaochao <zhaochao1@sugon.com>
-
zhaochao authored
Signed-off-by: -
zhaochao authored
Signed-off-by: -
zhaochao authored
Signed-off-by: -
zhaochao authored
Signed-off-by:
-
