Commits · 5db43a7f65972d8bb64d39bb534c3a9cad26b72d · OpenDAS / AutoAWQ · GitLab

08 Sep, 2023 2 commits
- Implement GEMM/GEMV in quantize function and fused modules · 5db43a7f
  Casper Hansen authored Sep 08, 2023
  
  5db43a7f
- Refactor modules, create separate GEMM and GEMV · fe314160
  Casper Hansen authored Sep 08, 2023
  
  fe314160
02 Sep, 2023 1 commit
- Refactor MPT Quant MLP · 1df0136e
  Casper Hansen authored Sep 02, 2023
  
  1df0136e
24 Aug, 2023 1 commit
- Integrate fused modules into AWQ model loading · 63346c34
  Casper Hansen authored Aug 24, 2023
  
  63346c34
22 Aug, 2023 1 commit
- Implement loading correct sequence length based on config + custom max_new_tokens · d9bab50c
  Casper Hansen authored Aug 22, 2023
  
  d9bab50c
18 Aug, 2023 1 commit
- Refactor model class. Add LLaMa support (LLaMa-2, Vicuna, etc). · e2858cef
  Casper Hansen authored Aug 18, 2023
  
  e2858cef
17 Aug, 2023 5 commits
- Implement from_pretrained. Fix static methods and classmethods · 14d198c6
  Casper Hansen authored Aug 17, 2023
  
  14d198c6
- Create AutoAWQForCausalLM and load quantized models with from_quantized · e09dc751
  Casper Hansen authored Aug 17, 2023
  
  e09dc751
- Refactored pre_quant into base · 290f45e7
  Casper Hansen authored Aug 17, 2023
  
  290f45e7
- Fix typo + use kwargs · d5be2115
  Casper Hansen authored Aug 17, 2023
  
  d5be2115
- Initial refactor [WIP]. · 7e091fb1
  Casper authored Aug 17, 2023
  
  7e091fb1