Commits · 7a923605dc3aa02751c3be1fedfefdd7a7c3e232 · OpenDAS / TransformerEngine

21 Aug, 2025 1 commit
- [DCU] tensorwise int8 train opt · 7a923605
  yuguo authored Aug 21, 2025
  
  7a923605
19 Aug, 2025 1 commit
- add swap env · d19a5a44
  evt_fugx1 authored Aug 19, 2025
  
  d19a5a44
13 Aug, 2025 2 commits
- Formatted · c6dae0e5
  wenjh authored Aug 13, 2025
```
Signed-off-by: wenjh <wenjh@sugon.com>
```
  c6dae0e5
- Delete tmpArgs in groupedgemm · 3cdceb87
  wenjh authored Aug 13, 2025
```
Signed-off-by: wenjh <wenjh@sugon.com>
```
  3cdceb87
12 Aug, 2025 1 commit
- Use hipMemcpy rather than hipMemcpyAsync · 1f97aebb
  wenjh authored Aug 12, 2025
```
Signed-off-by: wenjh <wenjh@sugon.com>
```
  1f97aebb
11 Aug, 2025 1 commit
- Fix hipblaslt_goupedgemm · 8665c111
  wenjh authored Aug 11, 2025
```
Signed-off-by: wenjh <wenjh@sugon.com>
```
  8665c111
08 Aug, 2025 2 commits
- [DCU] add tmp_userArgs for blaslt groupgemm · 14aaa48a
  yuguo authored Aug 08, 2025
  
  14aaa48a
- [DCU] add NVTE_INT8_SIM_FP8_TENSORWISE · 3eb6ea62
  yuguo authored Aug 08, 2025
  
  3eb6ea62
07 Aug, 2025 1 commit
- [DCU] fix channelwise train accumulate bug · 68d6c506
  yuguo authored Aug 07, 2025
  
  68d6c506
06 Aug, 2025 3 commits
- [DCU] fix channelwise train oom bug · 4a013bd5
  yuguo authored Aug 06, 2025
  
  4a013bd5
- [DCU] userargs groupedgemm · ddfbdaf4
  yuguo authored Aug 06, 2025
  
  ddfbdaf4
- [DCU] fix batchlinear core dump in 2.5 · eac0d49b
  yuguo authored Aug 06, 2025
  
  eac0d49b
05 Aug, 2025 1 commit
- [DCU] fix all gather usage · d8041744
  yuguo authored Aug 05, 2025
  
  d8041744
25 Jul, 2025 2 commits
- Disable lightop for now · ff1e14af
  wenjh authored Jul 25, 2025
```
Signed-off-by: wenjh <wenjh@sugon.com>
```
  ff1e14af
- TN w8a8 lightop · 4088797f
  wenjh authored Jul 25, 2025
```
Signed-off-by: wenjh <wenjh@sugon.com>
```
  4088797f
18 Jul, 2025 3 commits
- [DCU] fix · d9847b6d
  yuguo authored Jul 18, 2025
  
  d9847b6d
- [DCU] fix bias gradient · 736e8f8b
  yuguo authored Jul 18, 2025
  
  736e8f8b
- Optional lightop · f5349823
  wenjh authored Jul 18, 2025
```
Signed-off-by: wenjh <wenjh@sugon.com>
```
  f5349823
17 Jul, 2025 2 commits
- Use lightop replace w8a8_mutmal_extension · 1036ccfe
  wenjh authored Jul 17, 2025
```
Signed-off-by: wenjh <wenjh@sugon.com>
```
  1036ccfe
- [DCU] fix · 00738a42
  yuguo authored Jul 17, 2025
  
  00738a42
16 Jul, 2025 1 commit
- [DCU] surpport NVTE_USE_HIPBLASLT_GROUPEDGEMM · 9406ff31
  yuguo authored Jul 16, 2025
  
  9406ff31
15 Jul, 2025 3 commits
- Fix pytorch module import error · 148b5bea
  wenjh authored Jul 15, 2025
```
Signed-off-by: wenjh <wenjh@sugon.com>
```
  148b5bea
- [DCU] surpport channelwise int8 train · 793e0103
  yuguo authored Jul 15, 2025
  
  793e0103
- Fix import pytorch error · 3939e719
  wenjh authored Jul 15, 2025
```
Signed-off-by: wenjh <wenjh@sugon.com>
```
  3939e719
11 Jul, 2025 1 commit
- Support w8a8_matmul_extension · 6a20ff90
  wenjh authored Jul 11, 2025
```
Signed-off-by: wenjh <wenjh@sugon.com>
```
  6a20ff90
09 Jul, 2025 2 commits
- [DCU] channelwise batchgemm for MOE · 76023d21
  yuguo authored Jul 09, 2025
  
  76023d21
- Fix int8 gemm nt and wgrad · 5fcf30ba
  wenjh authored Jul 09, 2025
```
Signed-off-by: wenjh <wenjh@sugon.com>
```
  5fcf30ba
08 Jul, 2025 1 commit
- [DCU] Preliminary support for channelwise · 9fe13a33
  yuguo authored Jul 08, 2025
  
  9fe13a33
03 Jul, 2025 1 commit
- Fix kernel crash on block_len=64 · 40a4d896
  wenjh authored Jul 03, 2025
```
Signed-off-by: wenjh <wenjh@sugon.com>
```
  40a4d896
02 Jul, 2025 1 commit
- Resolve merge issues from develop_v2.4 · 4ef4eae6
  wenjh authored Jul 02, 2025
```
Signed-off-by: wenjh <wenjh@sugon.com>
```
  4ef4eae6
01 Jul, 2025 1 commit

[Blockwise] Add support block_len=64 support · b944277c

wenjh authored Jun 25, 2025



Add env to chose blocklen of blockwise quantize.
Signed-off-by: wenjh <wenjh@sugon.com>

Fix pytest of blockwise error
Signed-off-by: wenjh <wenjh@sugon.com>

Resolve new api in  int8 gemm test
Signed-off-by: wenjh <wenjh@sugon.com>

Fix incorrect launch parm
Signed-off-by: wenjh <wenjh@sugon.com>

Fix 1D blockwise(64) acc error
Signed-off-by: wenjh <wenjh@sugon.com>

b944277c

20 Jun, 2025 3 commits
- [DCU] fix megatron MOE int8 train bugs · 251dcc7e
  yuguo authored Jun 20, 2025
  
  251dcc7e
- [DCU] fix 2.5 compile issues · 68487b2a
  yuguo authored Jun 20, 2025
  
  68487b2a
- [DCU] fix megatron MOE int train issues · 7640a8d4
  yuguo authored Jun 20, 2025
  
  7640a8d4
19 Jun, 2025 2 commits
- [DCU] fix TORCH_COMM_CU_NUMS conflicts in 2.5 · ffbef335
  yuguo authored Jun 19, 2025
  
  ffbef335
- [DCU] add TORCH_COMM_CU_NUMS and fix · d6c32078
  yuguo authored Jun 19, 2025
  
  d6c32078
18 Jun, 2025 4 commits
- Fix build error · e704bbc8
  wenjh authored Jun 18, 2025
```
Signed-off-by: wenjh <wenjh@sugon.com>
```
  e704bbc8
- Resolve merge issue from nv of vector blockwise · 331f2fc4
  wenjh authored Jun 18, 2025
```
Signed-off-by: wenjh <wenjh@sugon.com>
```
  331f2fc4
- Fix vector blockwise acc problem · 8a03ff34
  wenjh authored Jun 18, 2025
```
Signed-off-by: wenjh <wenjh@sugon.com>
```
  8a03ff34
- [DCU] fix 2.5 compile issues · 2b1428ff
  yuguo authored Jun 18, 2025
  
  2b1428ff