Commits · 5cc0fd88bd477f78983e73c590d2e9872f72b099 · gaoqiong / composable_kernel

25 Oct, 2023 1 commit
- D0 data loading use D0BlockTransferSrcScalarPerVector · 5cc0fd88
  letaoqin authored Oct 25, 2023
  
  5cc0fd88
24 Oct, 2023 1 commit
- use a block thread cluster lengths · e938bd61
  letaoqin authored Oct 24, 2023
  
  e938bd61
23 Oct, 2023 2 commits
- remove some ignores · 29d5cbac
  letaoqin authored Oct 23, 2023
  
  29d5cbac
- bias with shuffle · 72faed1c
  letaoqin authored Oct 23, 2023
  
  72faed1c
27 Sep, 2023 1 commit
- Merge pull request #943 from ROCmSoftwarePlatform/mha-train-develop-inference-forward · b23b3d71
  Dan Yao authored Sep 27, 2023
```
Add new flash attention forward for inference
```
  b23b3d71
26 Sep, 2023 9 commits
- change the check for vector load · 1af0a0a4
  letaoqin authored Sep 26, 2023
  
  1af0a0a4
- change 'fwd' inc file name to 'infer' · b19fe02b
  letaoqin authored Sep 26, 2023
  
  b19fe02b
- change mha infer class and file name · 6dbced07
  letaoqin authored Sep 26, 2023
  
  6dbced07
- update include file name · 63ea1d70
  letaoqin authored Sep 26, 2023
  
  63ea1d70
- rename the base class and file name · cef44211
  letaoqin authored Sep 26, 2023
  
  cef44211
- add check code for vectorload · d8998cbb
  letaoqin authored Sep 26, 2023
  
  d8998cbb
- add grouped example · 13a0c55d
  letaoqin authored Sep 26, 2023
  
  13a0c55d
- start adding grouped example and device op · 9ca20e2c
  letaoqin authored Sep 26, 2023
  
  9ca20e2c
- change file run_grouped_multihead_attention_bias_forward.inc name · 7b13018e
  letaoqin authored Sep 26, 2023
  
  7b13018e
25 Sep, 2023 7 commits
- fix class name · c703632f
  letaoqin authored Sep 25, 2023
  
  c703632f
- rename example file name · 6bc73d41
  letaoqin authored Sep 25, 2023
  
  6bc73d41
- add bias 0 · d9d68abf
  letaoqin authored Sep 25, 2023
  
  d9d68abf
- Merge branch 'mha-train-develop' of... · b15eecba
  letaoqin authored Sep 25, 2023
```
Merge branch 'mha-train-develop' of https://github.com/ROCmSoftwarePlatform/composable_kernel into mha-train-develop
```
  b15eecba
- start adding mutiple head flash attention forward for inference · 87d1e073
  letaoqin authored Sep 25, 2023
  
  87d1e073
- Merge pull request #941 from ROCmSoftwarePlatform/mha-train-tinyfix · 04c206da
  Dan Yao authored Sep 25, 2023
```
Two tiny fixes
```
  04c206da
- Two tiny fixes · d6d30a86
  Qianfeng Zhang authored Sep 25, 2023
  
  d6d30a86
22 Sep, 2023 2 commits
- Merge pull request #905 from ROCmSoftwarePlatform/mha-train-develop-grad-bias · c0c52268
  Dan Yao authored Sep 22, 2023
```
flash attention output   bias grad
```
  c0c52268
- change d0 operator variables name · c88d1173
  letaoqin authored Sep 22, 2023
  
  c88d1173
21 Sep, 2023 2 commits
- fix output error · 12c0f86a
  letaoqin authored Sep 21, 2023
  
  12c0f86a
- add assert to kinds of kerperblock · e7b90e1a
  letaoqin authored Sep 21, 2023
  
  e7b90e1a
20 Sep, 2023 3 commits
- remove unusing functions · 3e4f9f33
  letaoqin authored Sep 20, 2023
  
  3e4f9f33
- Merge branch 'mha-train-develop' into mha-train-develop-grad-bias · aea324d2
  letaoqin authored Sep 20, 2023
  
  aea324d2
- unified codes · 73611570
  danyao12 authored Sep 20, 2023
  
  73611570
19 Sep, 2023 1 commit
- Merge pull request #915 from ROCmSoftwarePlatform/mha-train-hipGraph · f04ec574
  Dan Yao authored Sep 19, 2023
```
Use hipGraph capturing and replaying method for forward verification in examples/52_xxx
```
  f04ec574
18 Sep, 2023 3 commits
- Remove the printing in device operator · 437d35a2
  Qianfeng Zhang authored Sep 18, 2023
  
  437d35a2
- Revert "Add persistent_host_memory_allocator to allocate host memory used by... · 8301d8dd
  Qianfeng Zhang authored Sep 18, 2023
```
Revert "Add persistent_host_memory_allocator to allocate host memory used by H2D/D2H transfer in hipGraph capturing"

This reverts commit 69a6dc74.
```
  8301d8dd
- Add persistent_host_memory_allocator to allocate host memory used by H2D/D2H... · 69a6dc74
  Qianfeng Zhang authored Sep 18, 2023
```
Add persistent_host_memory_allocator to allocate host memory used by H2D/D2H transfer in hipGraph capturing
```
  69a6dc74
17 Sep, 2023 2 commits
- Allocate persistent host memory for hipMemcpyAsync when hipGraph capturing is detected · fa91e1e6
  Qianfeng Zhang authored Sep 17, 2023
  
  fa91e1e6
- Fix and add hipGraphDebugDotPrint() in the example · cf133833
  Qianfeng Zhang authored Sep 17, 2023
  
  cf133833
15 Sep, 2023 1 commit
- remove nousing comments · dd2635f4
  letaoqin authored Sep 15, 2023
  
  dd2635f4
14 Sep, 2023 2 commits
- hardcode bwd bias reading SrcScalarPerVector · 761d6d82
  danyao12 authored Sep 14, 2023
  
  761d6d82
- Use StreamCaptureModeRelaxed for grouped fwd example to include more work into capturing scope · 1eb85ac6
  Qianfeng Zhang authored Sep 14, 2023
  
  1eb85ac6
13 Sep, 2023 3 commits
- Update to the forward examples under example/52_xxx to using hipGraph... · 5ef0843b
  Qianfeng Zhang authored Sep 13, 2023
```
Update to the forward examples under example/52_xxx to using hipGraph capturing and replaying for verification
```
  5ef0843b
- Use hipMemcpyAsync() to replace hipMemcpy() in grouped fwd device operator · e29a9111
  Qianfeng Zhang authored Sep 13, 2023
  
  e29a9111
- Add HIP_CHECK_ERROR for hip error checking since hip_check_error() does not really work · 299ac0a3
  Qianfeng Zhang authored Sep 13, 2023
  
  299ac0a3