Commits · 5736b460d8ae0c395ed774439d37350ec19cf6e4 · gaoqiong / composable_kernel

08 Feb, 2023 1 commit
- Merge branch 'my-attn-bwd2' into my-attn-bwd3 · 5736b460
  fsx950223 authored Feb 08, 2023
  
  5736b460
07 Feb, 2023 2 commits
- fix bugs · f9bb62d5
  fsx950223 authored Feb 07, 2023
  
  f9bb62d5
- format code · 1a1a8924
  fsx950223 authored Feb 07, 2023
  
  1a1a8924
06 Feb, 2023 3 commits
- fix bugss · e327363f
  fsx950223 authored Feb 06, 2023
  
  e327363f
- init implementation · 0fe4fb38
  fsx950223 authored Feb 06, 2023
  
  0fe4fb38
- add cmake · 9eb23b04
  fsx950223 authored Feb 06, 2023
  
  9eb23b04
03 Feb, 2023 1 commit
- fixed bug in philox_rand.hpp · aace9ec6
  guangzlu authored Feb 03, 2023
  
  aace9ec6
31 Jan, 2023 3 commits
- add other version ApplyDropout · cc974f0f
  ltqin authored Jan 31, 2023
  
  cc974f0f
- merge updates · 337d6703
  fsx950223 authored Jan 31, 2023
  
  337d6703
- if z matrix ptr is null, will not save · 06ad7791
  ltqin authored Jan 31, 2023
  
  06ad7791
30 Jan, 2023 2 commits
- change parameter:remove p_dropout_in_16bits · 346b4e8d
  ltqin authored Jan 30, 2023
  
  346b4e8d
- fix scale · c2d566ff
  ltqin authored Jan 30, 2023
  
  c2d566ff
29 Jan, 2023 9 commits
- format code · 27482328
  fsx950223 authored Jan 29, 2023
  
  27482328
- open mask · bfe2c1dc
  ltqin authored Jan 29, 2023
  
  bfe2c1dc
- add grouped backward · 24f96b50
  fsx950223 authored Jan 29, 2023
  
  24f96b50
- rename device operator · ac07f2cd
  danyao12 authored Jan 29, 2023
  
  ac07f2cd
- update CMakeLists.txt · b5af5db8
  danyao12 authored Jan 21, 2023
  
  b5af5db8
- attn bwd kernel prototype1 · d3a031a5
  danyao12 authored Jan 21, 2023
  
  d3a031a5
- remove debug code · 63e0a878
  ltqin authored Jan 29, 2023
  
  63e0a878
- host dK and dQ correct · 81157e04
  ltqin authored Jan 29, 2023
  
  81157e04
- host dV correct · bc9e2f25
  ltqin authored Jan 29, 2023
  
  bc9e2f25
28 Jan, 2023 1 commit
- save z matrix · 4e79cc4b
  ltqin authored Jan 28, 2023
  
  4e79cc4b
25 Jan, 2023 1 commit
- move z matrix pos · cb914a54
  ltqin authored Jan 25, 2023
  
  cb914a54
24 Jan, 2023 1 commit
- kernel save z matrix · 1306ae6b
  ltqin authored Jan 24, 2023
  
  1306ae6b
19 Jan, 2023 1 commit
- send z matrix to kernel · d6fd270e
  ltqin authored Jan 19, 2023
  
  d6fd270e
18 Jan, 2023 3 commits
- add z matrix tensor desc · 4307a754
  ltqin authored Jan 18, 2023
  
  4307a754
- fix P computer · 4347bab1
  ltqin authored Jan 18, 2023
  
  4347bab1
- add drop parameter in device · bb06d009
  ltqin authored Jan 18, 2023
  
  bb06d009
17 Jan, 2023 5 commits
- start adding drop in device · 5012068b
  ltqin authored Jan 17, 2023
  
  5012068b
- add alpha for dV and change alpha for dK dQ · 17bb1aaa
  ltqin authored Jan 17, 2023
  
  17bb1aaa
- Merge branch 'attn-fwd-train-dropout' into attn-bwd-dropout · 4cbab521
  ltqin authored Jan 17, 2023
  
  4cbab521
- fixed philox generator · de43a6d8
  guangzlu authored Jan 17, 2023
  
  de43a6d8
- fixed philox generator · 8185c3d3
  guangzlu authored Jan 17, 2023
  
  8185c3d3
16 Jan, 2023 7 commits
- fixed incr() in philox_rand.hpp · d3577ab3
  guangzlu authored Jan 16, 2023
  
  d3577ab3
- move print in device_batched_gemm_softmax_gemm_permute_train_xdl_cshuffle.hpp · 1a634aca
  guangzlu authored Jan 16, 2023
  
  1a634aca
- modified method to set offset in philox · 9241ff62
  guangzlu authored Jan 16, 2023
  
  9241ff62
- add P and ds dropout · 711663bc
  qin letao authored Jan 16, 2023
  
  711663bc
- add dropout gridwise bwd · e3a2651b
  qin letao authored Jan 16, 2023
  
  e3a2651b
- Merge remote-tracking branch 'origin/attn-fwd-train-dropout' into attn-bwd-dropout · 70f2adc5
  qin letao authored Jan 16, 2023
  
  70f2adc5
- change dv thread copy · 105c6a08
  qin letao authored Jan 16, 2023
  
  105c6a08