Commits · a5bad9f28d71a831b461e101dd66202f48247c65 · gaoqiong / composable_kernel

17 Feb, 2023 1 commit
- aligned with prototype2 dropout · a5bad9f2
  danyao12 authored Feb 17, 2023
  
  a5bad9f2
16 Feb, 2023 2 commits
- Merge branch 'attn-bwd-develop' into attn-bwd-dropout-pt1 · 36dc18e8
  danyao12 authored Feb 16, 2023
  
  36dc18e8
- fix save z matrix when N is not multiple 4 · 56befb6e
  danyao12 authored Feb 16, 2023
  
  56befb6e
15 Feb, 2023 6 commits
- change dropout to one parameter · 6fd1490b
  ltqin authored Feb 15, 2023
  
  6fd1490b
- rewrite acc_elementwise_op parameter · 6e676287
  ltqin authored Feb 15, 2023
  
  6e676287
- fix inclde head file · f99f419d
  ltqin authored Feb 15, 2023
  
  f99f419d
- change file name: gridwise_batched_multihead_attention_backward_xdl_cshuffle_v1.hpp · ddb90935
  ltqin authored Feb 15, 2023
  
  ddb90935
- add is_dropout parameter to gridwise · 6d7a5784
  ltqin authored Feb 15, 2023
  
  6d7a5784
- fix save z matrix when N is not multiple 4 · 63b37aa0
  ltqin authored Feb 15, 2023
  
  63b37aa0
13 Feb, 2023 5 commits
- sync attn-bwd-dropout · 9f3bc9a3
  danyao12 authored Feb 13, 2023
  
  9f3bc9a3
- Fwd drop verify2 (#585) · e9e6081a
  guangzlu authored Feb 13, 2023
```
* fixed some bugs in fwd drop verify

* Delete device_grouped_multihead_attention_forward_xdl_cshuffle
```
  e9e6081a
- pt1 fix for time kernel ,not save z matrix · f43ed837
  danyao12 authored Feb 13, 2023
  
  f43ed837
- update CMakeLists.txt · 24bf4051
  danyao12 authored Feb 13, 2023
  
  24bf4051
- sync attn-bwd-dropout · 66052232
  danyao12 authored Feb 13, 2023
  
  66052232
12 Feb, 2023 4 commits
- Merge branch 'attn-fwd-dropout-verify' into attn-bwd-dropout · bf80ceee
  guangzlu authored Feb 12, 2023
  
  bf80ceee
- changed fwd file names · a2887630
  guangzlu authored Feb 12, 2023
  
  a2887630
- fixed some bugs in example · 25d3a65b
  guangzlu authored Feb 12, 2023
  
  25d3a65b
- change fp16 xdl to bf16 · 9dc05eaa
  ltqin authored Feb 12, 2023
  
  9dc05eaa
10 Feb, 2023 6 commits
- can compile now · e675b5c3
  guangzlu authored Feb 10, 2023
  
  e675b5c3
- fix:yygrad_threadwise_copy InvalidElementAsNaN to false · c1ed00b6
  ltqin authored Feb 10, 2023
  
  c1ed00b6
- Merge pull request #574 from ROCmSoftwarePlatform/attn-fwd-train-dropout · 0016f6ac
  ltqin authored Feb 10, 2023
```
fixed bug in philox_rand.hpp
```
  0016f6ac
- Merge branch 'attn-bwd-dropout' into attn-fwd-train-dropout · cb2d4dbb
  ltqin authored Feb 10, 2023
  
  cb2d4dbb
- format · 989e3d10
  ltqin authored Feb 10, 2023
  
  989e3d10
- fix for time kernel ,not save z matrix · 0e7aeef5
  ltqin authored Feb 10, 2023
  
  0e7aeef5
09 Feb, 2023 4 commits
- added z in example · 26cc4721
  guangzlu authored Feb 09, 2023
  
  26cc4721
- added z tensor for dropout storing · c75a3c17
  guangzlu authored Feb 09, 2023
  
  c75a3c17
- merge dropout to origin bwd and remove dropout developing code · 93c0a0a1
  ltqin authored Feb 09, 2023
  
  93c0a0a1
- attn bwd pt1 add dropout function · 5eb5e316
  danyao12 authored Feb 09, 2023
  
  5eb5e316
08 Feb, 2023 2 commits
- clang format · 4f6f7f8e
  danyao12 authored Feb 08, 2023
  
  4f6f7f8e
- rename attn fwd pass files · c7fa22cb
  danyao12 authored Feb 08, 2023
  
  c7fa22cb
07 Feb, 2023 2 commits
- modified device_grouped_gemm_softmax_gemm_permute_train_xdl_cshuffle.hpp · 6b041227
  guangzlu authored Feb 07, 2023
  
  6b041227
- saved dropout random number in gridwise_batched_gemm_softmax_gemm_xdl_cshuffle_v2.hpp · 3b58c3ec
  guangzlu authored Feb 07, 2023
  
  3b58c3ec
03 Feb, 2023 1 commit
- fixed bug in philox_rand.hpp · aace9ec6
  guangzlu authored Feb 03, 2023
  
  aace9ec6
31 Jan, 2023 2 commits
- add other version ApplyDropout · cc974f0f
  ltqin authored Jan 31, 2023
  
  cc974f0f
- if z matrix ptr is null, will not save · 06ad7791
  ltqin authored Jan 31, 2023
  
  06ad7791
30 Jan, 2023 2 commits
- change parameter:remove p_dropout_in_16bits · 346b4e8d
  ltqin authored Jan 30, 2023
  
  346b4e8d
- fix scale · c2d566ff
  ltqin authored Jan 30, 2023
  
  c2d566ff
29 Jan, 2023 3 commits
- open mask · bfe2c1dc
  ltqin authored Jan 29, 2023
  
  bfe2c1dc
- remove debug code · 63e0a878
  ltqin authored Jan 29, 2023
  
  63e0a878
- host dK and dQ correct · 81157e04
  ltqin authored Jan 29, 2023
  
  81157e04