Commits · fcd9637c06034ae5ba9769b09f2e422729f7ce56 · OpenDAS / AutoAWQ

02 May, 2024 1 commit
- support max_memory to specify mem usage for each GPU (#460) · 12581fbd
  laoda513 authored May 03, 2024
  
  12581fbd
06 Apr, 2024 3 commits
- Add StableLM support (#410) · e9f62694
  Isotr0py authored Apr 06, 2024
```
Co-authored-by: Casper <casperbh.96@gmail.com>
```
  e9f62694
- add starcoder2 support (#406) · 33dfb048
  少年 authored Apr 06, 2024
```
Co-authored-by: charrli <charrli@tencent.com>
```
  33dfb048
- Add download_kwargs for load model (#302) (#399) · eb85f67d
  Roshiago authored Apr 06, 2024
  
  eb85f67d
11 Mar, 2024 1 commit
- Add Gemma Support (#393) · 94e73f0b
  TechxGenus authored Mar 11, 2024
  
  94e73f0b
15 Feb, 2024 1 commit

Casper authored Feb 15, 2024


Co-authored-by: jinz2014 <7799920+jinz2014@users.noreply.github.com>
Co-authored-by: Jin Z <5zj@cousteau.ftpn.ornl.gov>

bcaa8a36

03 Feb, 2024 1 commit
- Add qwen2 (#321) · cc75d0e8
  Junyang Lin authored Feb 03, 2024
  
  cc75d0e8
21 Jan, 2024 1 commit
- Exllama kernels support (#313) · 2fcbf268
  Ilyas Moutawwakil authored Jan 21, 2024
```
Co-authored-by: Casper <casperbh.96@gmail.com>
```
  2fcbf268
23 Dec, 2023 2 commits
- Add Baichuan2 Support (#247) · cef9f113
  Aoyu authored Dec 23, 2023
```
Co-authored-by: Casper <casperbh.96@gmail.com>
```
  cef9f113
- FEAT: add llava to autoawq (#250) · 9e8e28b2
  Younes Belkada authored Dec 23, 2023
```
Co-authored-by: Casper <casperbh.96@gmail.com>
```
  9e8e28b2
22 Dec, 2023 1 commit
- Mixtral: Mixture of Experts quantization (#251) · 5b9f3c47
  Casper authored Dec 22, 2023
  
  5b9f3c47
03 Dec, 2023 1 commit
- Pass `model_init_kwargs` to `check_and_get_model_type` function (#232) · 5a673bf8
  정한 Rycont authored Dec 03, 2023
  
  5a673bf8
20 Nov, 2023 1 commit
- Add Qwen model (#182) · e440c7ac
  Qing authored Nov 20, 2023
```
Co-authored-by: Casper Hansen <casperbh.96@gmail.com>
```
  e440c7ac
14 Nov, 2023 1 commit
- Fix multi-GPU loading and inference (#190) · 09c73fb2
  Casper authored Nov 14, 2023
  
  09c73fb2
11 Nov, 2023 1 commit
- Pass arguments to AutoConfig (#97) · 7c976752
  Andrey Glushenkov authored Nov 11, 2023
```
Co-authored-by: Casper <casperbh.96@gmail.com>
```
  7c976752
06 Nov, 2023 1 commit
- Yi support (#167) · 37c63440
  Casper authored Nov 06, 2023
  
  37c63440
04 Nov, 2023 1 commit
- Default to safetensors for quantized models (#151) · 84a26861
  Casper authored Nov 04, 2023
  
  84a26861
28 Oct, 2023 1 commit

Support Aquila models. (#123) · dc13f0b8

ldwang authored Oct 28, 2023


Signed-off-by: ldwang <ftgreat@gmail.com>
Co-authored-by: ldwang <ftgreat@gmail.com>
Co-authored-by: Casper Hansen <casperbh.96@gmail.com>

dc13f0b8

17 Oct, 2023 1 commit
- gpt_neox · ad45716f
  twaka authored Oct 17, 2023
  
  ad45716f
27 Sep, 2023 1 commit
- Mistral support · bd56c301
  Casper Hansen authored Sep 27, 2023
  
  bd56c301
26 Sep, 2023 1 commit
- Offload to cpu · 4f76ecb2
  s4rduk4r authored Sep 27, 2023
  
  4f76ecb2
21 Sep, 2023 1 commit
- Improve model loading · 2dada8f8
  Casper Hansen authored Sep 21, 2023
  
  2dada8f8
20 Sep, 2023 1 commit
- Add GPT BigCode support (StarCoder) · 984fd2f8
  Casper Hansen authored Sep 20, 2023
  
  984fd2f8
15 Sep, 2023 1 commit
- Default to empty string for model file · 435b3b4b
  Casper Hansen authored Sep 15, 2023
  
  435b3b4b
13 Sep, 2023 3 commits
- Unify using variable safetensors · 219ccb33
  Casper Hansen authored Sep 13, 2023
  
  219ccb33
- Add safetensors support · db8ba322
  Casper Hansen authored Sep 13, 2023
  
  db8ba322
- Set AWQ_BATCH_SIZE environment variable · 6e0bde15
  Casper Hansen authored Sep 13, 2023
  
  6e0bde15
07 Sep, 2023 1 commit
- Support Falcon 180B · 475481b4
  Casper authored Sep 07, 2023
  
  475481b4
25 Aug, 2023 1 commit
- added gptj · 86fcf708
  EC2 Default User authored Aug 25, 2023
  
  86fcf708
24 Aug, 2023 1 commit
- Integrate fused modules into AWQ model loading · 63346c34
  Casper Hansen authored Aug 24, 2023
  
  63346c34
22 Aug, 2023 1 commit
- Implement loading correct sequence length based on config + custom max_new_tokens · d9bab50c
  Casper Hansen authored Aug 22, 2023
  
  d9bab50c
19 Aug, 2023 5 commits
- Support Bloom models · 5c2c85fe
  Casper Hansen authored Aug 19, 2023
  
  5c2c85fe
- Support safetensors · 04e177ad
  Casper Hansen authored Aug 19, 2023
  
  04e177ad
- Support Falcon 7B+40B · d73d13b2
  Casper Hansen authored Aug 19, 2023
  
  d73d13b2
- Load quantized model with saved quant_config · d68441d0
  Casper Hansen authored Aug 19, 2023
  
  d68441d0
- Rename q_config -> quant_config. Include w_bit in quant_config. Save quant_config.json. · d35ade75
  Casper Hansen authored Aug 19, 2023
  
  d35ade75
18 Aug, 2023 4 commits
- Add OPT support · 6f30f051
  Casper Hansen authored Aug 18, 2023
  
  6f30f051
- Refactor model class. Add LLaMa support (LLaMa-2, Vicuna, etc). · e2858cef
  Casper Hansen authored Aug 18, 2023
  
  e2858cef
- save_quantized working in all cases, from_quantized adapted. · d430694b
  Casper Hansen authored Aug 18, 2023
  
  d430694b
- Implemented save_quantized. Generalize from_quantized.Add comments. · ed347704
  Casper Hansen authored Aug 18, 2023
  
  ed347704