Commits · e1980d10a7d3f02bde8abebf2eb497463f491715 · gaoqiong / composable_kernel

10 Nov, 2023 1 commit
- Update in D0 shuffled loading to support bigger KPerBlock size · e1980d10
  Qianfeng Zhang authored Nov 10, 2023
  
  e1980d10
08 Nov, 2023 2 commits
- Merge pull request #1010 from ROCmSoftwarePlatform/mha-train-develop-bias-shfl · ac3ef99c
  Dan Yao authored Nov 08, 2023
```
Add bias with shuffle for flash attention fwd
```
  ac3ef99c
- Merge pull request #1026 from ROCmSoftwarePlatform/mha-train-develop-fix-d0vgpr2lds · acea1753
  Dan Yao authored Nov 08, 2023
```
fix flash attention bwd output d0 grad
```
  acea1753
07 Nov, 2023 2 commits
- NXdlPerWave must be one · 22593950
  letaoqin authored Nov 07, 2023
  
  22593950
- fix d0 write data form vgpr to lds · 5a032110
  letaoqin authored Nov 07, 2023
  
  5a032110
03 Nov, 2023 1 commit
- fx d0 write data form vgpr to lds · d7544ea0
  letaoqin authored Nov 03, 2023
  
  d7544ea0
31 Oct, 2023 2 commits
- format · 620eeae8
  letaoqin authored Oct 31, 2023
  
  620eeae8
- d0 use D0BlockTransferSrcScalarPerVector load data · 7d50e8a5
  letaoqin authored Oct 31, 2023
  
  7d50e8a5
27 Oct, 2023 2 commits
- Merge pull request #1012 from ROCmSoftwarePlatform/mha-train-mqagqa-inference · 339b86e9
  Dan Yao authored Oct 27, 2023
```
mqa/gqa inference
```
  339b86e9
- mqa/gqa inference · c2510944
  danyao12 authored Oct 27, 2023
  
  c2510944
26 Oct, 2023 4 commits
- Merge branch 'mha-train-develop' into mha-train-develop-bias-shfl · e87ddb0e
  letaoqin authored Oct 26, 2023
  
  e87ddb0e
- update to grouped gemm · 13129772
  letaoqin authored Oct 26, 2023
  
  13129772
- restore original datatype · 5ff2d646
  danyao12 authored Oct 26, 2023
  
  5ff2d646
- Merge pull request #949 from ROCmSoftwarePlatform/mha-train-mqagqa · 4033f5df
  Dan Yao authored Oct 26, 2023
```
Grouped Query Attention/Multi Query Attention
```
  4033f5df
25 Oct, 2023 1 commit
- D0 data loading use D0BlockTransferSrcScalarPerVector · 5cc0fd88
  letaoqin authored Oct 25, 2023
  
  5cc0fd88
24 Oct, 2023 1 commit
- use a block thread cluster lengths · e938bd61
  letaoqin authored Oct 24, 2023
  
  e938bd61
23 Oct, 2023 2 commits
- remove some ignores · 29d5cbac
  letaoqin authored Oct 23, 2023
  
  29d5cbac
- bias with shuffle · 72faed1c
  letaoqin authored Oct 23, 2023
  
  72faed1c
18 Oct, 2023 4 commits
- Merge pull request #980 from ROCmSoftwarePlatform/mha-train-develop-fix-issupport · 18be6bc9
  Dan Yao authored Oct 18, 2023
```
fix mha bwd  IsSupportedArgument
```
  18be6bc9
- add static check for vector load · 422a69b2
  letaoqin authored Oct 18, 2023
  
  422a69b2
- Merge branch 'mha-train-develop' into mha-train-develop-fix-issupport · 6c971dc8
  letaoqin authored Oct 18, 2023
  
  6c971dc8
- Merge pull request #993 from ROCmSoftwarePlatform/mha-train-develop-tinyadd · f27f9158
  Dan Yao authored Oct 18, 2023
```
Two tiny udpates
```
  f27f9158
17 Oct, 2023 2 commits
- Add seed input to GeneratorTensor_4 for normal_distribution generator · 22214cae
  Qianfeng Zhang authored Oct 17, 2023
  
  22214cae
- reinterpret_cast to const char* in dumpBufferToFile to be compatible with both... · 0aa85235
  Qianfeng Zhang authored Oct 17, 2023
```
reinterpret_cast to const char* in dumpBufferToFile to be compatible with both const and non-const input pointers
```
  0aa85235
13 Oct, 2023 3 commits
- Merge pull request #988 from ROCmSoftwarePlatform/mha-train-develop-tinyfix · ca9b152d
  ltqin authored Oct 13, 2023
```
Two tiny updates
```
  ca9b152d
- Use persistent host pointer when doing hipMemcpyAsync under hipGraph environment · aef8ea3c
  Qianfeng Zhang authored Oct 13, 2023
  
  aef8ea3c
- Add pre-compile conditional selecting for using RTN BF16 convert · 6355e068
  Qianfeng Zhang authored Oct 13, 2023
  
  6355e068
11 Oct, 2023 4 commits
- add type check · b76c8e62
  letaoqin authored Oct 11, 2023
  
  b76c8e62
- add issupportargument check to light version · 4e6fd810
  letaoqin authored Oct 11, 2023
  
  4e6fd810
- resolve conflict · 957d5dee
  danyao12 authored Oct 11, 2023
  
  957d5dee
- G1/G2 -> G1Q/G1KV · 10836d41
  danyao12 authored Oct 11, 2023
  
  10836d41
10 Oct, 2023 7 commits
- add check that K_q must be a multiple of 2 · 768a05a5
  letaoqin authored Oct 10, 2023
  
  768a05a5
- Merge pull request #977 from ROCmSoftwarePlatform/mha-train-tiny-update · 3f4eae1d
  Dan Yao authored Oct 10, 2023
```
Some tiny updates
```
  3f4eae1d
- Align MakeArgumentPointer() interface of qloop_light_v1 · 9ac015bd
  Qianfeng Zhang authored Oct 10, 2023
  
  9ac015bd
- Revert the change with regard to defining dynamic buffer ygrad_gid_buf · 48a9c0b6
  Qianfeng Zhang authored Oct 10, 2023
  
  48a9c0b6
- More fix of LSEBasePtr for g_idx · 8c67fac1
  Qianfeng Zhang authored Oct 10, 2023
  
  8c67fac1
- Merge pull request #979 from ROCmSoftwarePlatform/mha-train-develop-remove-fwd-deterministic · bf6b491e
  Dan Yao authored Oct 10, 2023
```
flash attention remove fwd deterministic
```
  bf6b491e
- remove-fwd-deterministic · 454e9445
  letaoqin authored Oct 10, 2023
  
  454e9445
09 Oct, 2023 2 commits
- Fix the API pointer types in qloop_v1 device-op · 301a4d7a
  Qianfeng Zhang authored Oct 09, 2023
  
  301a4d7a
- adjust grouped kernels interface · 9574b34d
  danyao12 authored Oct 09, 2023
  
  9574b34d