Commits · 6605223278eaf000b4802acd068b373ef0e74e52 · gaoqiong / composable_kernel

"tests/models/vscode:/vscode.git/clone" did not exist on "e96c1de1913c307fddcb3e5881388a6dbb5b00b1"

12 Feb, 2023 2 commits
- changed fwd file names · a2887630
  guangzlu authored Feb 12, 2023
  
  a2887630
- change fp16 xdl to bf16 · 9dc05eaa
  ltqin authored Feb 12, 2023
  
  9dc05eaa
10 Feb, 2023 2 commits
- can compile now · e675b5c3
  guangzlu authored Feb 10, 2023
  
  e675b5c3
- fix:yygrad_threadwise_copy InvalidElementAsNaN to false · c1ed00b6
  ltqin authored Feb 10, 2023
  
  c1ed00b6
09 Feb, 2023 3 commits
- added z tensor for dropout storing · c75a3c17
  guangzlu authored Feb 09, 2023
  
  c75a3c17
- merge dropout to origin bwd and remove dropout developing code · 93c0a0a1
  ltqin authored Feb 09, 2023
  
  93c0a0a1
- attn bwd pt1 add dropout function · 5eb5e316
  danyao12 authored Feb 09, 2023
  
  5eb5e316
08 Feb, 2023 2 commits
- clang format · 4f6f7f8e
  danyao12 authored Feb 08, 2023
  
  4f6f7f8e
- rename attn fwd pass files · c7fa22cb
  danyao12 authored Feb 08, 2023
  
  c7fa22cb
07 Feb, 2023 2 commits
- modified device_grouped_gemm_softmax_gemm_permute_train_xdl_cshuffle.hpp · 6b041227
  guangzlu authored Feb 07, 2023
  
  6b041227
- saved dropout random number in gridwise_batched_gemm_softmax_gemm_xdl_cshuffle_v2.hpp · 3b58c3ec
  guangzlu authored Feb 07, 2023
  
  3b58c3ec
03 Feb, 2023 1 commit
- fixed bug in philox_rand.hpp · aace9ec6
  guangzlu authored Feb 03, 2023
  
  aace9ec6
31 Jan, 2023 2 commits
- add other version ApplyDropout · cc974f0f
  ltqin authored Jan 31, 2023
  
  cc974f0f
- if z matrix ptr is null, will not save · 06ad7791
  ltqin authored Jan 31, 2023
  
  06ad7791
30 Jan, 2023 2 commits
- change parameter:remove p_dropout_in_16bits · 346b4e8d
  ltqin authored Jan 30, 2023
  
  346b4e8d
- fix scale · c2d566ff
  ltqin authored Jan 30, 2023
  
  c2d566ff
29 Jan, 2023 2 commits
- remove debug code · 63e0a878
  ltqin authored Jan 29, 2023
  
  63e0a878
- host dK and dQ correct · 81157e04
  ltqin authored Jan 29, 2023
  
  81157e04
28 Jan, 2023 1 commit
- save z matrix · 4e79cc4b
  ltqin authored Jan 28, 2023
  
  4e79cc4b
25 Jan, 2023 1 commit
- move z matrix pos · cb914a54
  ltqin authored Jan 25, 2023
  
  cb914a54
24 Jan, 2023 1 commit
- kernel save z matrix · 1306ae6b
  ltqin authored Jan 24, 2023
  
  1306ae6b
19 Jan, 2023 1 commit
- send z matrix to kernel · d6fd270e
  ltqin authored Jan 19, 2023
  
  d6fd270e
18 Jan, 2023 3 commits
- add z matrix tensor desc · 4307a754
  ltqin authored Jan 18, 2023
  
  4307a754
- fix P computer · 4347bab1
  ltqin authored Jan 18, 2023
  
  4347bab1
- add drop parameter in device · bb06d009
  ltqin authored Jan 18, 2023
  
  bb06d009
17 Jan, 2023 3 commits
- start adding drop in device · 5012068b
  ltqin authored Jan 17, 2023
  
  5012068b
- add alpha for dV and change alpha for dK dQ · 17bb1aaa
  ltqin authored Jan 17, 2023
  
  17bb1aaa
- fixed philox generator · 8185c3d3
  guangzlu authored Jan 17, 2023
  
  8185c3d3
16 Jan, 2023 6 commits
- fixed incr() in philox_rand.hpp · d3577ab3
  guangzlu authored Jan 16, 2023
  
  d3577ab3
- move print in device_batched_gemm_softmax_gemm_permute_train_xdl_cshuffle.hpp · 1a634aca
  guangzlu authored Jan 16, 2023
  
  1a634aca
- modified method to set offset in philox · 9241ff62
  guangzlu authored Jan 16, 2023
  
  9241ff62
- add P and ds dropout · 711663bc
  qin letao authored Jan 16, 2023
  
  711663bc
- add dropout gridwise bwd · e3a2651b
  qin letao authored Jan 16, 2023
  
  e3a2651b
- change dv thread copy · 105c6a08
  qin letao authored Jan 16, 2023
  
  105c6a08
15 Jan, 2023 2 commits
- added dropou scale into device_batched_gemm_softmax_gemm_permute_train_xdl_cshuffle.hpp · 11eed39f
  guangzlu authored Jan 15, 2023
  
  11eed39f
- added dropout rescale into grouped_gemm_softmax_gemm · 2ac0eefd
  guangzlu authored Jan 15, 2023
  
  2ac0eefd
14 Jan, 2023 4 commits
- moved device_grouped_gemm_softmax_gemm_permute_xdl_cshuffle.hpp and... · 6926effa
  guangzlu authored Jan 14, 2023
```
moved device_grouped_gemm_softmax_gemm_permute_xdl_cshuffle.hpp and device_grouped_gemm_softmax_gemm_permute_train_xdl_cshuffle.hpp into device/impl/
```
  6926effa
- added dropout into batched_gemm_softmax_gemm · f196d88b
  guangzlu authored Jan 14, 2023
  
  f196d88b
- added dropout into fla training · 9fe6407e
  guangzlu authored Jan 14, 2023
  
  9fe6407e
- grouped/batched training fwd with lse storing, both fp16&bf16 are verified · 393470f5
  danyao12 authored Jan 14, 2023
  
  393470f5