Commits · 55057f09dce213a75d46df1bd1a1091e11a3c93a · gaoqiong / composable_kernel

09 Mar, 2023 5 commits
- rename and sync macro · 55057f09
  danyao12 authored Mar 09, 2023
  
  55057f09
- modify argc and macro · 51ec5aa0
  danyao12 authored Mar 09, 2023
  
  51ec5aa0
- Merge branch 'attn-bwd-develop' of... · 80ef43a2
  danyao12 authored Mar 09, 2023
```
Merge branch 'attn-bwd-develop' of https://github.com/ROCmSoftwarePlatform/composable_kernel into attn-bwd-develop
```
  80ef43a2
- refactor grouped bwd example and fix some bugs · a39dd61f
  danyao12 authored Mar 09, 2023
  
  a39dd61f
- added z tensor datatype choice for fwd pass · 19dd98c8
  guangzlu authored Mar 09, 2023
  
  19dd98c8
08 Mar, 2023 5 commits
- fix argc order · 79f3caf8
  danyao12 authored Mar 08, 2023
  
  79f3caf8
- fixed dropout random number write in gridwise attn fwd · 3724ab55
  guangzlu authored Mar 08, 2023
  
  3724ab55
- rename · 36d2871b
  danyao12 authored Mar 08, 2023
  
  36d2871b
- Merge pull request #600 from fsx950223/grouped_api · 0ace441b
  Dan Yao authored Mar 08, 2023
```
add grouped flash attention api
```
  0ace441b
- bwd template rename · 075abf92
  danyao12 authored Mar 08, 2023
  
  075abf92
07 Mar, 2023 4 commits
- let grouped fwd test more random · c56f28b0
  danyao12 authored Mar 07, 2023
  
  c56f28b0
- add corresponding templates for the different scopes and merge the bwd examples · 62357796
  danyao12 authored Mar 07, 2023
  
  62357796
- update · 8ef97116
  fsx950223 authored Mar 07, 2023
  
  8ef97116
- merge updates · d9579dc8
  fsx950223 authored Mar 07, 2023
  
  d9579dc8
06 Mar, 2023 6 commits
- fix OOB bug by carlushuang · 36ca02f3
  danyao12 authored Mar 06, 2023
  
  36ca02f3
- add cout info · 0530bca3
  danyao12 authored Mar 06, 2023
  
  0530bca3
- delete useless files · 594262ba
  danyao12 authored Mar 06, 2023
  
  594262ba
- unpate fwd/train fp16/bf16 · c80db13f
  danyao12 authored Mar 06, 2023
  
  c80db13f
- changed fwd instance parameters · da80a2e3
  guangzlu authored Mar 06, 2023
  
  da80a2e3
- updated new dropout for attn fwd · 88980945
  guangzlu authored Mar 06, 2023
  
  88980945
03 Mar, 2023 3 commits
- Merge remote-tracking branch 'origin/attn-bwd-develop' into grouped_api · 98ccee74
  fsx950223 authored Mar 03, 2023
  
  98ccee74
- Merge branch 'attn-bwd-combined-test' of... · db8018de
  danyao12 authored Mar 03, 2023
```
Merge branch 'attn-bwd-combined-test' of https://github.com/ROCmSoftwarePlatform/composable_kernel into attn-bwd-combined-test
```
  db8018de
- support fwd fp16&bf16 · c9133170
  danyao12 authored Mar 03, 2023
  
  c9133170
02 Mar, 2023 13 commits
- unpate CMakeLists.txt 2 · e1681494
  ltqin authored Mar 02, 2023
  
  e1681494
- fix conflict · 18d6a3d6
  ltqin authored Mar 02, 2023
  
  18d6a3d6
- change flashattention example exe file name · d3e87f86
  ltqin authored Mar 02, 2023
  
  d3e87f86
- unpate CMakeLists.txt · 45b52f13
  danyao12 authored Mar 02, 2023
  
  45b52f13
- batched_multihead_attention_backward_fp16.cpp -> batched_multihead_attention_backward_pt2.cpp · 4e2b1447
  ltqin authored Mar 02, 2023
  
  4e2b1447
- Merge branch 'attn-bwd-combined-test' of... · 37433ee3
  danyao12 authored Mar 02, 2023
```
Merge branch 'attn-bwd-combined-test' of https://github.com/ROCmSoftwarePlatform/composable_kernel into attn-bwd-combined-test
```
  37433ee3
- support bwd fp16&bf16 · 326e9ee8
  danyao12 authored Mar 02, 2023
  
  326e9ee8
- fix datatype · 2e1f2c37
  ltqin authored Mar 02, 2023
  
  2e1f2c37
- dropout sync with pt2 · 32b03f33
  danyao12 authored Mar 02, 2023
  
  32b03f33
- fix mask bug · 889c6bd5
  danyao12 authored Mar 02, 2023
  
  889c6bd5
- fix bugs · bfa06cf2
  fsx950223 authored Mar 02, 2023
  
  bfa06cf2
- rename · b91d052e
  danyao12 authored Mar 02, 2023
  
  b91d052e
- Fixed a bug where Z-matrix saved permute · ee54ef41
  danyao12 authored Mar 02, 2023
  
  ee54ef41
01 Mar, 2023 4 commits
- fwd&bwd combined test · c97a3a0d
  danyao12 authored Mar 01, 2023
  
  c97a3a0d
- Merge remote-tracking branch 'origin/attn-bwd-develop' into grouped_api · 627016c1
  fsx950223 authored Mar 01, 2023
  
  627016c1
- Merge pull request #609 from ROCmSoftwarePlatform/attn-bwd-bhalf-test · 906bbc60
  ltqin authored Mar 01, 2023
```
split save z matrix
```
  906bbc60
- split save z matrix for spill register issue · 0ed92c0c
  ltqin authored Mar 01, 2023
  
  0ed92c0c