Commits · 1df0136ec5a2df7d45fa473beffd8f6590e99ea9 · OpenDAS / AutoAWQ

02 Sep, 2023 3 commits
- Refactor Llama Quant MLP · ded3ea71
  Casper Hansen authored Sep 02, 2023
  
  ded3ea71
- Refactor Llama Quant RMSNorm · 620966e8
  Casper Hansen authored Sep 02, 2023
  
  620966e8
- Refactor Llama quant attention · 2082197d
  Casper Hansen authored Sep 02, 2023
  
  2082197d
24 Aug, 2023 1 commit
- Integrate fused modules into AWQ model loading · 63346c34
  Casper Hansen authored Aug 24, 2023
  
  63346c34
22 Aug, 2023 1 commit
- Implement loading correct sequence length based on config + custom max_new_tokens · d9bab50c
  Casper Hansen authored Aug 22, 2023
  
  d9bab50c
18 Aug, 2023 2 commits
- Fix comment · 916fdf97
  Casper Hansen authored Aug 18, 2023
  
  916fdf97
- Refactor model class. Add LLaMa support (LLaMa-2, Vicuna, etc). · e2858cef
  Casper Hansen authored Aug 18, 2023
  
  e2858cef