Commits · mha-train-develop-bwdopt · gaoqiong / composable_kernel

01 Sep, 2023 1 commit
- modify Y_M1 · 08e2ae8d
  danyao12 authored Sep 01, 2023
  
  08e2ae8d
29 Aug, 2023 2 commits
- hd128 · 210aa44d
  danyao12 authored Aug 29, 2023
  
  210aa44d
- remove hardcode · 9809f5d4
  danyao12 authored Aug 29, 2023
  
  9809f5d4
28 Aug, 2023 4 commits
- Bwd Qloop_PT1&Split K in LDS/V in Vgpr · de4494a2
  danyao12 authored Aug 28, 2023
  
  de4494a2
- update pt2 templates for hd64 · cc18fafa
  danyao12 authored Aug 28, 2023
  
  cc18fafa
- add Gemm2KPerBlock template for split kernels · 3b395570
  danyao12 authored Aug 28, 2023
  
  3b395570
- add Gemm2KPerBlock template · 228e9cd1
  danyao12 authored Aug 28, 2023
  
  228e9cd1
25 Aug, 2023 1 commit
- Bwd Qloop_PT2&Split K in LDS/V in Vgpr · 64b5f20f
  danyao12 authored Aug 25, 2023
  
  64b5f20f
17 Aug, 2023 1 commit
- fix z pointers empty issue · e296ee56
  ltqin authored Aug 17, 2023
  
  e296ee56
16 Aug, 2023 2 commits
- fix group d data type · c9915508
  letaoqin authored Aug 16, 2023
  
  c9915508
- bias data type convert · 98df59c6
  letaoqin authored Aug 16, 2023
  
  98df59c6
15 Aug, 2023 4 commits
- fix times · 64c9f790
  letaoqin authored Aug 15, 2023
  
  64c9f790
- fix ComputeBasePtrOfStridedBatch init bug · b2df7018
  letaoqin authored Aug 15, 2023
  
  b2df7018
- aligned · 4b0a5069
  danyao12 authored Aug 15, 2023
  
  4b0a5069
- Merge pull request #846 from ROCmSoftwarePlatform/mha-train-develop-tinyfix2 · 2c42da54
  Dan Yao authored Aug 15, 2023
```
Additional fixing following last commit for using single d0 and d1 bias
```
  2c42da54
14 Aug, 2023 6 commits
- Additional fixing following last commit for using single d0 and d1 bias · 56e79bbb
  Qianfeng Zhang authored Aug 14, 2023
  
  56e79bbb
- add check to group gemm · 26fa4782
  letaoqin authored Aug 14, 2023
  
  26fa4782
- fix group gemm · 896408a5
  letaoqin authored Aug 14, 2023
  
  896408a5
- Merge pull request #845 from ROCmSoftwarePlatform/mha-train-develop-reduce-interface · 95d76f67
  Dan Yao authored Aug 14, 2023
```
Mha train develop reduce interface
```
  95d76f67
- fix comments · f158f4d4
  letaoqin authored Aug 14, 2023
  
  f158f4d4
- fix bug for void type · 80da57fd
  letaoqin authored Aug 14, 2023
  
  80da57fd
13 Aug, 2023 2 commits
- modify relative example · 90f8550b
  letaoqin authored Aug 13, 2023
  
  90f8550b
- grouped gemm remove multiple D · 855b604f
  letaoqin authored Aug 13, 2023
  
  855b604f
12 Aug, 2023 1 commit
- batched gemm reduce interface · 98212afe
  letaoqin authored Aug 12, 2023
  
  98212afe
11 Aug, 2023 3 commits
- 52 example add dropoutstep · 102c9661
  letaoqin authored Aug 11, 2023
  
  102c9661
- qloop dropout optimize · 7aa37568
  danyao12 authored Aug 11, 2023
  
  7aa37568
- Merge pull request #835 from ROCmSoftwarePlatform/mha-train-bias · 4274096b
  Dan Yao authored Aug 11, 2023
```
Add bias for flashattention fwd(v2)
```
  4274096b
10 Aug, 2023 5 commits
- change check name to d0s_n_length_stride_ · dccaf0b2
  letaoqin authored Aug 10, 2023
  
  dccaf0b2
- bias parameters update to other example · 514cee8a
  letaoqin authored Aug 10, 2023
  
  514cee8a
- remove v2r2 · d84b00c7
  letaoqin authored Aug 10, 2023
  
  d84b00c7
- grouped gemm add bias · 192dca60
  letaoqin authored Aug 10, 2023
  
  192dca60
- add bias to batched gemm · 53a74710
  letaoqin authored Aug 10, 2023
  
  53a74710
09 Aug, 2023 3 commits
- group change to multiple D · b8f08e67
  letaoqin authored Aug 09, 2023
  
  b8f08e67
- gridwise change to multiple D · fa066d60
  letaoqin authored Aug 09, 2023
  
  fa066d60
- format · ee275d4d
  letaoqin authored Aug 09, 2023
  
  ee275d4d
08 Aug, 2023 5 commits
- fix to block_work_idx_m · 1fa679c6
  letaoqin authored Aug 08, 2023
  
  1fa679c6
- Merge branch 'mha-train-develop' into mha-train-bias · d8e77f4a
  letaoqin authored Aug 08, 2023
  
  d8e77f4a
- batched gemm add do vector load · d173a2cb
  letaoqin authored Aug 08, 2023
  
  d173a2cb
- add verify d0 vector load · 9679ba63
  letaoqin authored Aug 08, 2023
  
  9679ba63
- add d vector load template parameters · 5d6bfabb
  letaoqin authored Aug 08, 2023
  
  5d6bfabb