Commits · 4abfefc9e269db4e1e10fbf22c6bdf29c99c233d · OpenDAS / AutoAWQ

24 Sep, 2023 1 commit
- Fix typing classes · 4abfefc9
  Vik Paruchuri authored Sep 23, 2023
  
  4abfefc9
21 Sep, 2023 3 commits
- Remove fused modules (later) · 37db5759
  Casper Hansen authored Sep 21, 2023
  
  37db5759
- Fix argument · 7c48033a
  Casper Hansen authored Sep 21, 2023
  
  7c48033a
- Improve model loading · 2dada8f8
  Casper Hansen authored Sep 21, 2023
  
  2dada8f8
20 Sep, 2023 11 commits
- Add bigcode fused modules (WIP) · b49168f8
  Casper Hansen authored Sep 20, 2023
  
  b49168f8
- Remove cosine loss · 90bf52c7
  Casper Hansen authored Sep 20, 2023
  
  90bf52c7
- Better comments. Implement cosine similarity · c9d01ac3
  Casper Hansen authored Sep 20, 2023
  
  c9d01ac3
- Move import up · e205548d
  Casper Hansen authored Sep 20, 2023
  
  e205548d
- Simplify saving model · ed618bb0
  Casper Hansen authored Sep 20, 2023
  
  ed618bb0
- Remove old quantization code · d3550fec
  Casper Hansen authored Sep 20, 2023
  
  d3550fec
- Working for OPT · 724bda58
  Casper Hansen authored Sep 20, 2023
  
  724bda58
- Remove comment · 19568c52
  Casper Hansen authored Sep 20, 2023
  
  19568c52
- Add GPT BigCode support (StarCoder) · 984fd2f8
  Casper Hansen authored Sep 20, 2023
  
  984fd2f8
- Avoid fusing for larger Falcon models · e3936a44
  Casper Hansen authored Sep 20, 2023
  
  e3936a44
- Support kv_heads · 3256ffec
  Casper Hansen authored Sep 20, 2023
  
  3256ffec
15 Sep, 2023 2 commits
- Default to empty string for model file · 435b3b4b
  Casper Hansen authored Sep 15, 2023
  
  435b3b4b
- Actually pass args to calib function · a9cef34b
  Casper authored Sep 15, 2023
  
  a9cef34b
14 Sep, 2023 1 commit
- Pass split and text_column arguments to calib_data function · 84e82744
  Casper authored Sep 14, 2023
  
  84e82744
13 Sep, 2023 5 commits
- Unify using variable safetensors · 219ccb33
  Casper Hansen authored Sep 13, 2023
  
  219ccb33
- Fix ignore patterns · 7ba31254
  Casper Hansen authored Sep 13, 2023
  
  7ba31254
- Add safetensors support · db8ba322
  Casper Hansen authored Sep 13, 2023
  
  db8ba322
- Implement saving sharded weights + safetensors · 97d38e29
  Casper Hansen authored Sep 13, 2023
  
  97d38e29
- Set AWQ_BATCH_SIZE environment variable · 6e0bde15
  Casper Hansen authored Sep 13, 2023
  
  6e0bde15
12 Sep, 2023 2 commits
- Falcon: Enable fused attention · f03f72de
  Casper Hansen authored Sep 12, 2023
  
  f03f72de
- Create Falcon block and model for fusing · 4517b3f2
  Casper Hansen authored Sep 12, 2023
  
  4517b3f2
11 Sep, 2023 5 commits
- Remove xformers · 1aa8aebd
  Casper Hansen authored Sep 11, 2023
  
  1aa8aebd
- Update MPTBlock, fuse with MPTModel · dd41a223
  Casper Hansen authored Sep 11, 2023
  
  dd41a223
- Initialize with device · e80663bb
  Casper Hansen authored Sep 11, 2023
  
  e80663bb
- Remove fusing attention, only blocks · ac3e86df
  Casper Hansen authored Sep 11, 2023
  
  ac3e86df
- Fuse MPT block · 950851b3
  Casper Hansen authored Sep 11, 2023
  
  950851b3
09 Sep, 2023 4 commits
- Falcon fused layers · 54f02854
  Casper Hansen authored Sep 09, 2023
  
  54f02854
- Fuse MPT · f3695d60
  Casper Hansen authored Sep 09, 2023
  
  f3695d60
- Update module name · 5bd6fbc7
  Casper Hansen authored Sep 09, 2023
  
  5bd6fbc7
- Remove warnings about GEMM · c58ec73b
  Casper Hansen authored Sep 09, 2023
  
  c58ec73b
08 Sep, 2023 6 commits
- GEMM + GEMV compatibility · 890b6aa7
  Casper Hansen authored Sep 08, 2023
  
  890b6aa7
- Update kernel, remove unused code · a11c313a
  Casper Hansen authored Sep 08, 2023
  
  a11c313a
- Attention works · fbfa9d82
  Casper Hansen authored Sep 08, 2023
  
  fbfa9d82
- Fix variables and no contiguous memory for GEMV · e197a733
  Casper Hansen authored Sep 08, 2023
  
  e197a733
- Implement GEMM/GEMV in quantize function and fused modules · 5db43a7f
  Casper Hansen authored Sep 08, 2023
  
  5db43a7f
- Add deprecation warning · 9b2946b6
  Casper Hansen authored Sep 08, 2023
  
  9b2946b6