GitLab

Signed-off-by: Tangao <2205747538@qq.com>

grouped_linear supports activation offloading

See merge request dcutoolkit/deeplearing/TransformerEngine!62

Signed-off-by: wenjh <wenjh@sugon.com>

Signed-off-by: wenjh <wenjh@sugon.com>

Signed-off-by: wenjh <wenjh@sugon.com>

[DCU] Skip some tests in test_sanity.py

See merge request dcutoolkit/deeplearing/TransformerEngine!61

[DCU]Fix some bugs

See merge request dcutoolkit/deeplearing/TransformerEngine!56

Fix build error

See merge request dcutoolkit/deeplearing/TransformerEngine!60

Fix hipblaslt handle manage

See merge request dcutoolkit/deeplearing/TransformerEngine!59

Fix user args core dump in mt

See merge request dcutoolkit/deeplearing/TransformerEngine!57

Signed-off-by: zhaochao <zhaochao1@sugon.com>

Signed-off-by: zhaochao <zhaochao1@sugon.com>

Signed-off-by: zhaochao <zhaochao1@sugon.com>

Signed-off-by: zhaochao <zhaochao1@sugon.com>

Signed-off-by: zhaochao <zhaochao1@sugon.com>

Signed-off-by: zhaochao <zhaochao1@sugon.com>

Signed-off-by: zhaochao <zhaochao1@sugon.com>

[DCU]Fix memory overflow and test-didistributed in L1_pytorch_istributed_unittest

See merge request dcutoolkit/deeplearing/TransformerEngine!49

Signed-off-by: Tangao <2205747538@qq.com>

Update activation offload code to align with the official version

See merge request dcutoolkit/deeplearing/TransformerEngine!52

Signed-off-by: Przemek Tredak <ptredak@nvidia.com>

* [PyTorch] Add record_stream and untyped_storage func op in QuantizedTensor
Signed-off-by: xiaoxi-wangfj <690912414@qq.com>

* Update transformer_engine/pytorch/tensor/float8_blockwise_tensor.py
Co-authored-by: Tim Moon <4406448+timmoon10@users.noreply.github.com>
Signed-off-by: xiaoxi-wangfj <690912414@qq.com>

* Update transformer_engine/pytorch/tensor/float8_blockwise_tensor.py
Co-authored-by: Tim Moon <4406448+timmoon10@users.noreply.github.com>
Signed-off-by: xiaoxi-wangfj <690912414@qq.com>

---------
Signed-off-by: xiaoxi-wangfj <690912414@qq.com>
Co-authored-by: Tim Moon <4406448+timmoon10@users.noreply.github.com>

Signed-off-by: Selvaraj Anandaraj <selvaraja@login-ptyche02.ptyche.clusters.nvidia.com>
Co-authored-by: Selvaraj Anandaraj <selvaraja@login-ptyche02.ptyche.clusters.nvidia.com>
Co-authored-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>

Merge branch 'develop_v2.8' of http://10.16.6.30/dcutoolkit/deeplearing/TransformerEngine into develop_v2.8

Signed-off-by: Tangao <2205747538@qq.com>

* Enhance Latest News section with recent TE and FP8 developments

- Adds NVFP4 pretraining research paper with PR #2177 reference
Signed-off-by: Santosh Bhavani <santosh.bhavani@live.com>

* update nvfp4 reference
Signed-off-by: Santosh Bhavani <santosh.bhavani@live.com>

* Update README.rst
Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>

---------
Signed-off-by: Santosh Bhavani <santosh.bhavani@live.com>
Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>
Co-authored-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>

* fixes for start_end_list usage in TE debug
Signed-off-by: Paul Gibbons <pgibbons@nvidia.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci



---------
Signed-off-by: Paul Gibbons <pgibbons@nvidia.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Paweł Gadziński <62263673+pggPL@users.noreply.github.com>

Signed-off-by: wenjh <wenjh@sugon.com>

* Require cuDNN 9.14.0+ for fused attention with FP8 current scaling
Signed-off-by: Tim Moon <tmoon@nvidia.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci



---------
Signed-off-by: Tim Moon <tmoon@nvidia.com>
Co-authored-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>