Commits · 84fb7e9808171dbf6b4790fd4044c2fd39aee09c · OpenDAS / AutoAWQ

06 Sep, 2023 3 commits
- Correct input sizes · ab7d68e7
  Casper Hansen authored Sep 06, 2023
  
  ab7d68e7
- Update shapes for cuda kernel · e71181bd
  Casper Hansen authored Sep 06, 2023
  
  e71181bd
- Use hf_rotary per default · b7290868
  Casper Hansen authored Sep 06, 2023
  
  b7290868
05 Sep, 2023 4 commits
- Remove CustomQuantAttention class · 42655843
  Casper Hansen authored Sep 05, 2023
  
  42655843
- Revert "Update neox kernel" · bbe1d46a
  Casper Hansen authored Sep 05, 2023
```
This reverts commit 4fe9974a.
```
  bbe1d46a
- Update neox kernel · 4fe9974a
  Casper Hansen authored Sep 05, 2023
  
  4fe9974a
- Attempt new module · 8bb8fe20
  Casper Hansen authored Sep 05, 2023
  
  8bb8fe20
02 Sep, 2023 4 commits
- Refactor MPT Quant MLP · 1df0136e
  Casper Hansen authored Sep 02, 2023
  
  1df0136e
- Refactor Llama Quant MLP · ded3ea71
  Casper Hansen authored Sep 02, 2023
  
  ded3ea71
- Refactor Llama Quant RMSNorm · 620966e8
  Casper Hansen authored Sep 02, 2023
  
  620966e8
- Refactor Llama quant attention · 2082197d
  Casper Hansen authored Sep 02, 2023
  
  2082197d
27 Aug, 2023 1 commit
- Replace print with logging, Remove uncommented code · b491c2d6
  Casper authored Aug 27, 2023
  
  b491c2d6
24 Aug, 2023 1 commit
- Integrate fused modules into AWQ model loading · 63346c34
  Casper Hansen authored Aug 24, 2023
  
  63346c34