Commits · cd24392e2e4c245e18180bc384c5f8f122baa5be · gaoqiong / composable_kernel

24 May, 2023 5 commits
- added batched_multihead_attention_train_v4.cpp · cd24392e
  guangzlu authored May 24, 2023
  
  cd24392e
- fixed bugs after merge · 3480e42b
  guangzlu authored May 24, 2023
  
  3480e42b
- Attn bwd develop qloop (#720) · e439b369
  guangzlu authored May 24, 2023
```
* fix decoder tensor transfer related issues

* prototype1 Q loop direction w/ layout change

* remove useless templates

* add OutputDataType&Deterministic for pt1q1

* add OutputDataType&Deterministic for pt1q2

---------
Co-authored-by: danyao12 <danyao12@amd.com>
```
  e439b369
- fixed blockwise_dropout.hpp · 26115ce7
  guangzlu authored May 24, 2023
  
  26115ce7
- modified batched_multihead_attention_train.cpp · ce31e22a
  guangzlu authored May 24, 2023
  
  ce31e22a
23 May, 2023 3 commits
- updated philox and pass pt3 · 3a9dabcf
  guangzlu authored May 23, 2023
  
  3a9dabcf
- dim=32 pass now · d37c1d0b
  guangzlu authored May 23, 2023
  
  d37c1d0b
- bwd pass now · 5d90769e
  guangzlu authored May 23, 2023
  
  5d90769e
19 May, 2023 2 commits
- fixed bug of global pos in gridwise · 644a45e9
  guangzlu authored May 19, 2023
  
  644a45e9
- fixed bug in dropout with global pos · 907413ac
  guangzlu authored May 19, 2023
  
  907413ac
18 May, 2023 1 commit
- bwd dropout refactor · 95a9bacf
  guangzlu authored May 18, 2023
  
  95a9bacf
17 May, 2023 1 commit
- modified dropout in fwd · 5e319fb8
  guangzlu authored May 17, 2023
  
  5e319fb8
08 May, 2023 1 commit
- fix shuffle GemmORepeat · 762cbddf
  danyao12 authored May 08, 2023
  
  762cbddf
28 Apr, 2023 1 commit
- restore original c_grid_desc_m0_n0_m1_n1_m2_n2 · 17774771
  danyao12 authored Apr 28, 2023
  
  17774771
27 Apr, 2023 1 commit
- pt1q1 w/o preload · 8582c75c
  danyao12 authored Apr 27, 2023
  
  8582c75c
21 Apr, 2023 1 commit
- add block_sync_lds in deterministic mode · f1a49daf
  danyao12 authored Apr 21, 2023
  
  f1a49daf
18 Apr, 2023 1 commit
- correct deterministic mode · 99ebfeba
  danyao12 authored Apr 18, 2023
  
  99ebfeba
17 Apr, 2023 2 commits
- add deterministic mode for FA unittest · 84a81ae2
  danyao12 authored Apr 17, 2023
  
  84a81ae2
- restore original rtn · e576c081
  danyao12 authored Apr 17, 2023
  
  e576c081
14 Apr, 2023 2 commits
- optimized rtn by sixie · f2c7e7c5
  danyao12 authored Apr 14, 2023
  
  f2c7e7c5
- ZDataType can be set to U16/INT32 in fwd&bwd&train examples · 0c359ae8
  danyao12 authored Apr 14, 2023
  
  0c359ae8
13 Apr, 2023 3 commits
- batched&grouped train output datatype can be selected · 3b57967f
  danyao12 authored Apr 13, 2023
  
  3b57967f
- bwd CShuffleBlockTransferScalarPerVector_NPerBlock&ZDataType · d042e931
  danyao12 authored Apr 13, 2023
  
  d042e931
- datatype of bwd output can be selected · f3e61c0a
  danyao12 authored Apr 13, 2023
  
  f3e61c0a
04 Apr, 2023 1 commit
- modify comment · f7e05f9e
  danyao12 authored Apr 04, 2023
  
  f7e05f9e
21 Mar, 2023 1 commit
- rtn in ternary way · 7c4c31cf
  danyao12 authored Mar 21, 2023
  
  7c4c31cf
20 Mar, 2023 2 commits
- add grouped train verify function · 06e45d9f
  danyao12 authored Mar 20, 2023
  
  06e45d9f
- fix grouped bwd example host issue · 0e308145
  danyao12 authored Mar 20, 2023
  
  0e308145
13 Mar, 2023 1 commit
- set grouped bwd occupancy to 1 · 665b08cf
  danyao12 authored Mar 13, 2023
  
  665b08cf
09 Mar, 2023 5 commits
- rename and sync macro · 55057f09
  danyao12 authored Mar 09, 2023
  
  55057f09
- modify argc and macro · 51ec5aa0
  danyao12 authored Mar 09, 2023
  
  51ec5aa0
- Merge branch 'attn-bwd-develop' of... · 80ef43a2
  danyao12 authored Mar 09, 2023
```
Merge branch 'attn-bwd-develop' of https://github.com/ROCmSoftwarePlatform/composable_kernel into attn-bwd-develop
```
  80ef43a2
- refactor grouped bwd example and fix some bugs · a39dd61f
  danyao12 authored Mar 09, 2023
  
  a39dd61f
- added z tensor datatype choice for fwd pass · 19dd98c8
  guangzlu authored Mar 09, 2023
  
  19dd98c8
08 Mar, 2023 5 commits
- fix argc order · 79f3caf8
  danyao12 authored Mar 08, 2023
  
  79f3caf8
- fixed dropout random number write in gridwise attn fwd · 3724ab55
  guangzlu authored Mar 08, 2023
  
  3724ab55
- rename · 36d2871b
  danyao12 authored Mar 08, 2023
  
  36d2871b
- Merge pull request #600 from fsx950223/grouped_api · 0ace441b
  Dan Yao authored Mar 08, 2023
```
add grouped flash attention api
```
  0ace441b
- bwd template rename · 075abf92
  danyao12 authored Mar 08, 2023
  
  075abf92
07 Mar, 2023 1 commit
- let grouped fwd test more random · c56f28b0
  danyao12 authored Mar 07, 2023
  
  c56f28b0