Commits · e120c9b66944cfd9fd09ff238c9c8a1dd6ff0c63 · OpenDAS / AutoAWQ

11 Sep, 2023 6 commits
- Update MPTBlock, fuse with MPTModel · dd41a223
  Casper Hansen authored Sep 11, 2023
  
  dd41a223
- Fix attention, support alibi · 7631add1
  Casper Hansen authored Sep 11, 2023
  
  7631add1
- Create MPTModel class · 90f54dbb
  Casper Hansen authored Sep 11, 2023
  
  90f54dbb
- Initialize with device · e80663bb
  Casper Hansen authored Sep 11, 2023
  
  e80663bb
- Fuse MPT block · 950851b3
  Casper Hansen authored Sep 11, 2023
  
  950851b3
- Switch to torch SDPA · d7badefc
  Casper Hansen authored Sep 11, 2023
  
  d7badefc
09 Sep, 2023 4 commits
- Fix alibi, rotary arg, neox, arg · 73c5e2bf
  Casper Hansen authored Sep 09, 2023
  
  73c5e2bf
- Fuse MPT · f3695d60
  Casper Hansen authored Sep 09, 2023
  
  f3695d60
- Implement ALiBi. · adc5304b
  Casper Hansen authored Sep 09, 2023
  
  adc5304b
- Create torch SDPA implementation · ebbbc3a5
  Casper Hansen authored Sep 09, 2023
  
  ebbbc3a5
08 Sep, 2023 6 commits
- GEMM + GEMV compatibility · 890b6aa7
  Casper Hansen authored Sep 08, 2023
  
  890b6aa7
- Use apply_rotary_emb · 64e6b3e1
  Casper Hansen authored Sep 08, 2023
  
  64e6b3e1
- Update kernel, remove unused code · a11c313a
  Casper Hansen authored Sep 08, 2023
  
  a11c313a
- Attention works · fbfa9d82
  Casper Hansen authored Sep 08, 2023
  
  fbfa9d82
- Fix MLP module · 75710806
  Casper Hansen authored Sep 08, 2023
  
  75710806
- Refactor modules, create separate GEMM and GEMV · fe314160
  Casper Hansen authored Sep 08, 2023
  
  fe314160