Commits · 435b3b4b57e1430bd4885ac98bbd72bf4583020e · OpenDAS / AutoAWQ

15 Sep, 2023 1 commit
- Default to empty string for model file · 435b3b4b
  Casper Hansen authored Sep 15, 2023
  
  435b3b4b
13 Sep, 2023 3 commits
- Unify using variable safetensors · 219ccb33
  Casper Hansen authored Sep 13, 2023
  
  219ccb33
- Add safetensors support · db8ba322
  Casper Hansen authored Sep 13, 2023
  
  db8ba322
- Set AWQ_BATCH_SIZE environment variable · 6e0bde15
  Casper Hansen authored Sep 13, 2023
  
  6e0bde15
07 Sep, 2023 1 commit
- Support Falcon 180B · 475481b4
  Casper authored Sep 07, 2023
  
  475481b4
25 Aug, 2023 1 commit
- added gptj · 86fcf708
  EC2 Default User authored Aug 25, 2023
  
  86fcf708
24 Aug, 2023 1 commit
- Integrate fused modules into AWQ model loading · 63346c34
  Casper Hansen authored Aug 24, 2023
  
  63346c34
22 Aug, 2023 1 commit
- Implement loading correct sequence length based on config + custom max_new_tokens · d9bab50c
  Casper Hansen authored Aug 22, 2023
  
  d9bab50c
19 Aug, 2023 5 commits
- Support Bloom models · 5c2c85fe
  Casper Hansen authored Aug 19, 2023
  
  5c2c85fe
- Support safetensors · 04e177ad
  Casper Hansen authored Aug 19, 2023
  
  04e177ad
- Support Falcon 7B+40B · d73d13b2
  Casper Hansen authored Aug 19, 2023
  
  d73d13b2
- Load quantized model with saved quant_config · d68441d0
  Casper Hansen authored Aug 19, 2023
  
  d68441d0
- Rename q_config -> quant_config. Include w_bit in quant_config. Save quant_config.json. · d35ade75
  Casper Hansen authored Aug 19, 2023
  
  d35ade75
18 Aug, 2023 4 commits
- Add OPT support · 6f30f051
  Casper Hansen authored Aug 18, 2023
  
  6f30f051
- Refactor model class. Add LLaMa support (LLaMa-2, Vicuna, etc). · e2858cef
  Casper Hansen authored Aug 18, 2023
  
  e2858cef
- save_quantized working in all cases, from_quantized adapted. · d430694b
  Casper Hansen authored Aug 18, 2023
  
  d430694b
- Implemented save_quantized. Generalize from_quantized.Add comments. · ed347704
  Casper Hansen authored Aug 18, 2023
  
  ed347704
17 Aug, 2023 2 commits
- Implement from_pretrained. Fix static methods and classmethods · 14d198c6
  Casper Hansen authored Aug 17, 2023
  
  14d198c6
- Create AutoAWQForCausalLM and load quantized models with from_quantized · e09dc751
  Casper Hansen authored Aug 17, 2023
  
  e09dc751