Commits · bca939ce833c8f121b04de55c53c7642324d5dc7 · gaoqiong / composable_kernel_ROCM

03 Feb, 2025 1 commit

Add pre_softmax fnctor (#1852) · bca939ce

Hashem Hashemi authored Feb 03, 2025



* Add pre_softmax fnctor

* remove stray define:wq

* Move op out of pipeline, adds it to refnc

---------
Co-authored-by: root <root@splinter-126-wr-d1.aus.dcgpu>
Co-authored-by: Max Podkorytov <4273004+tenpercent@users.noreply.github.com>

bca939ce

31 Jan, 2025 6 commits
- re-add group-mode kernels · 81e00bce
  Max Podkorytov authored Jan 31, 2025
  
  81e00bce
- remove unused cases from smoke test · c657f72b
  Max Podkorytov authored Jan 31, 2025
  
  c657f72b
- remove readme · b29432f5
  Max Podkorytov authored Jan 31, 2025
  
  b29432f5
- edit test and benchmark scripts for the new example · 60d0af7e
  Max Podkorytov authored Jan 31, 2025
  
  60d0af7e
- remove bwd related scripts · 758b2aaa
  Max Podkorytov authored Jan 31, 2025
  
  758b2aaa
- run clang-format · 37052173
  Max Podkorytov authored Jan 31, 2025
  
  37052173
30 Jan, 2025 1 commit
- fix numeric mismatches · 0d96a891
  Max Podkorytov authored Jan 30, 2025
  
  0d96a891
29 Jan, 2025 9 commits
- use cmakelists as the single source of truth for score_mod function definition · ee0654c4
  Max Podkorytov authored Jan 29, 2025
  
  ee0654c4
- reorder score mod and scale in host verification · 61108fdf
  Max Podkorytov authored Jan 29, 2025
  
  61108fdf
- use custom score for testing · 8c96b18b
  Max Podkorytov authored Jan 29, 2025
  
  8c96b18b
- modify host attention impl accounting for score_mod · 6ef86201
  Max Podkorytov authored Jan 29, 2025
  
  6ef86201
- unhardcode score_mod and pass it as a cpp expression from codegen · 510ff45f
  Max Podkorytov authored Jan 29, 2025
  
  510ff45f
- add a hardcoded score_mod · 2a198f14
  Max Podkorytov authored Jan 28, 2025
  
  2a198f14
- remove unused ops in the example; · ac9ddd93
  Max Podkorytov authored Jan 28, 2025
```
select only bf16/nodropout/nolse/batched

pass validation in the example driver
```
  ac9ddd93
- remove bwd related commands from cmakelists · 8c905605
  Max Podkorytov authored Jan 22, 2025
  
  8c905605
- copy over fmha example · 81e68c64
  Max Podkorytov authored Jan 22, 2025
  
  81e68c64