Commits · c58ec73b1599587b25031fd7afb2e4c6ea4abfbb · OpenDAS / AutoAWQ

09 Sep, 2023 2 commits
- Remove warnings about GEMM · c58ec73b
  Casper Hansen authored Sep 09, 2023
  
  c58ec73b
- Create torch SDPA implementation · ebbbc3a5
  Casper Hansen authored Sep 09, 2023
  
  ebbbc3a5
08 Sep, 2023 10 commits
- GEMM + GEMV compatibility · 890b6aa7
  Casper Hansen authored Sep 08, 2023
  
  890b6aa7
- Use apply_rotary_emb · 64e6b3e1
  Casper Hansen authored Sep 08, 2023
  
  64e6b3e1
- Update kernel, remove unused code · a11c313a
  Casper Hansen authored Sep 08, 2023
  
  a11c313a
- Attention works · fbfa9d82
  Casper Hansen authored Sep 08, 2023
  
  fbfa9d82
- Fix MLP module · 75710806
  Casper Hansen authored Sep 08, 2023
  
  75710806
- Fix variables and no contiguous memory for GEMV · e197a733
  Casper Hansen authored Sep 08, 2023
  
  e197a733
- Fix variables · 6534f5e6
  Casper Hansen authored Sep 08, 2023
  
  6534f5e6
- Implement GEMM/GEMV in quantize function and fused modules · 5db43a7f
  Casper Hansen authored Sep 08, 2023
  
  5db43a7f
- Add deprecation warning · 9b2946b6
  Casper Hansen authored Sep 08, 2023
  
  9b2946b6
- Refactor modules, create separate GEMM and GEMV · fe314160
  Casper Hansen authored Sep 08, 2023
  
  fe314160
07 Sep, 2023 1 commit
- Support Falcon 180B · 475481b4
  Casper authored Sep 07, 2023
  
  475481b4
06 Sep, 2023 8 commits
- Bump version · a0fb91d9
  Casper authored Sep 06, 2023
  
  a0fb91d9
- Remove simple dispatch · 562c0d52
  Casper authored Sep 06, 2023
  
  562c0d52
- Multi-GPU support for quantized models · f8273a0c
  Casper Hansen authored Sep 06, 2023
  
  f8273a0c
- Get correct devices · 7cf0d987
  Casper Hansen authored Sep 06, 2023
  
  7cf0d987
- Correct input sizes · ab7d68e7
  Casper Hansen authored Sep 06, 2023
  
  ab7d68e7
- Switch to model.generate() · a4626828
  Casper Hansen authored Sep 06, 2023
  
  a4626828
- Update shapes for cuda kernel · e71181bd
  Casper Hansen authored Sep 06, 2023
  
  e71181bd
- Use hf_rotary per default · b7290868
  Casper Hansen authored Sep 06, 2023
  
  b7290868
05 Sep, 2023 8 commits
- Remove CustomQuantAttention class · 42655843
  Casper Hansen authored Sep 05, 2023
  
  42655843
- Revert "Update neox kernel" · bbe1d46a
  Casper Hansen authored Sep 05, 2023
```
This reverts commit 4fe9974a.
```
  bbe1d46a
- Update neox kernel · 4fe9974a
  Casper Hansen authored Sep 05, 2023
  
  4fe9974a
- Attempt new module · 8bb8fe20
  Casper Hansen authored Sep 05, 2023
  
  8bb8fe20
- Fix the metrics with batch size · 0f699cf9
  Casper Hansen authored Sep 05, 2023
  
  0f699cf9
- Implement batch size · 883e47d5
  Casper Hansen authored Sep 05, 2023
  
  883e47d5
- Revert to n_context arg · 4f42f509
  Casper Hansen authored Sep 05, 2023
  
  4f42f509
- support speedtest to benchmark FP16 model · bbbd525e
  Zhen Wan authored Sep 05, 2023
  
  bbbd525e
04 Sep, 2023 3 commits
- Add support for rmsnorm through class name · 47ab20a9
  Casper Hansen authored Sep 04, 2023
  
  47ab20a9
- Pass trust_remote_code to AutoModelForCausalLM · 0090ad81
  Casper Hansen authored Sep 04, 2023
  
  0090ad81
- fuse_layers bug fix · 9106ce29
  qwopqwop200 authored Sep 04, 2023
  
  9106ce29
02 Sep, 2023 5 commits
- Fix model references · 0aa4a596
  Casper Hansen authored Sep 02, 2023
  
  0aa4a596
- Refactor MPT Quant MLP · 1df0136e
  Casper Hansen authored Sep 02, 2023
  
  1df0136e
- Refactor Llama Quant MLP · ded3ea71
  Casper Hansen authored Sep 02, 2023
  
  ded3ea71
- Refactor Llama Quant RMSNorm · 620966e8
  Casper Hansen authored Sep 02, 2023
  
  620966e8
- Refactor Llama quant attention · 2082197d
  Casper Hansen authored Sep 02, 2023
  
  2082197d
31 Aug, 2023 1 commit
- Python 3.8 compatibility · bdde6c96
  Casper Hansen authored Aug 31, 2023
  
  bdde6c96
27 Aug, 2023 2 commits
- Replace print with logging, Remove uncommented code · b491c2d6
  Casper authored Aug 27, 2023
  
  b491c2d6
- Import from awq · c39ac59b
  Casper authored Aug 27, 2023
  
  c39ac59b