Commits · 8eb26eb2f48370cb13e80604fd1c58d4e92f6f59 · OpenDAS / AutoAWQ

24 Sep, 2023 1 commit
- Fix typing classes · 4abfefc9
  Vik Paruchuri authored Sep 23, 2023
  
  4abfefc9
11 Sep, 2023 4 commits
- Update MPTBlock, fuse with MPTModel · dd41a223
  Casper Hansen authored Sep 11, 2023
  
  dd41a223
- Initialize with device · e80663bb
  Casper Hansen authored Sep 11, 2023
  
  e80663bb
- Remove fusing attention, only blocks · ac3e86df
  Casper Hansen authored Sep 11, 2023
  
  ac3e86df
- Fuse MPT block · 950851b3
  Casper Hansen authored Sep 11, 2023
  
  950851b3
09 Sep, 2023 1 commit
- Fuse MPT · f3695d60
  Casper Hansen authored Sep 09, 2023
  
  f3695d60
08 Sep, 2023 2 commits
- Implement GEMM/GEMV in quantize function and fused modules · 5db43a7f
  Casper Hansen authored Sep 08, 2023
  
  5db43a7f
- Refactor modules, create separate GEMM and GEMV · fe314160
  Casper Hansen authored Sep 08, 2023
  
  fe314160
02 Sep, 2023 1 commit
- Refactor MPT Quant MLP · 1df0136e
  Casper Hansen authored Sep 02, 2023
  
  1df0136e
24 Aug, 2023 1 commit
- Integrate fused modules into AWQ model loading · 63346c34
  Casper Hansen authored Aug 24, 2023
  
  63346c34
22 Aug, 2023 1 commit
- Implement loading correct sequence length based on config + custom max_new_tokens · d9bab50c
  Casper Hansen authored Aug 22, 2023
  
  d9bab50c
18 Aug, 2023 1 commit
- Refactor model class. Add LLaMa support (LLaMa-2, Vicuna, etc). · e2858cef
  Casper Hansen authored Aug 18, 2023
  
  e2858cef
17 Aug, 2023 5 commits
- Implement from_pretrained. Fix static methods and classmethods · 14d198c6
  Casper Hansen authored Aug 17, 2023
  
  14d198c6
- Create AutoAWQForCausalLM and load quantized models with from_quantized · e09dc751
  Casper Hansen authored Aug 17, 2023
  
  e09dc751
- Refactored pre_quant into base · 290f45e7
  Casper Hansen authored Aug 17, 2023
  
  290f45e7
- Fix typo + use kwargs · d5be2115
  Casper Hansen authored Aug 17, 2023
  
  d5be2115
- Initial refactor [WIP]. · 7e091fb1
  Casper authored Aug 17, 2023
  
  7e091fb1