Commits · a3db8099a234a46a21bf5e46340da60da6992e0c · OpenDAS / AutoAWQ

07 Jan, 2024 1 commit
- GGUF compatible quantization (2, 3, 4 bit / any bit) (#285) · a3db8099
  Casper authored Jan 07, 2024
  
  a3db8099
23 Dec, 2023 2 commits
- Add Baichuan2 Support (#247) · cef9f113
  Aoyu authored Dec 23, 2023
```
Co-authored-by: Casper <casperbh.96@gmail.com>
```
  cef9f113
- FEAT: add llava to autoawq (#250) · 9e8e28b2
  Younes Belkada authored Dec 23, 2023
```
Co-authored-by: Casper <casperbh.96@gmail.com>
```
  9e8e28b2
22 Dec, 2023 1 commit
- Mixtral: Mixture of Experts quantization (#251) · 5b9f3c47
  Casper authored Dec 22, 2023
  
  5b9f3c47
11 Dec, 2023 1 commit
- FEAT: Add possibility of skipping modules when quantizing (#248) · 9c3dfa07
  Younes Belkada authored Dec 11, 2023
  
  9c3dfa07
08 Dec, 2023 1 commit
- Load on CPU to avoid OOM (#236) · 6b5dc29f
  Casper authored Dec 08, 2023
  
  6b5dc29f
28 Nov, 2023 1 commit
- New scaling to improve perplexity (#216) · d1112e1c
  Casper authored Nov 28, 2023
  
  d1112e1c
18 Nov, 2023 1 commit
- Add config to Base model (#207) · 84c87877
  Casper authored Nov 18, 2023
  
  84c87877
14 Nov, 2023 1 commit
- Fix multi-GPU loading and inference (#190) · 09c73fb2
  Casper authored Nov 14, 2023
  
  09c73fb2
11 Nov, 2023 1 commit
- Pass arguments to AutoConfig (#97) · 7c976752
  Andrey Glushenkov authored Nov 11, 2023
```
Co-authored-by: Casper <casperbh.96@gmail.com>
```
  7c976752
10 Nov, 2023 1 commit
- Make sure to delete dummy model (#180) · 1f6f5155
  Casper authored Nov 10, 2023
  
  1f6f5155
04 Nov, 2023 1 commit
- Default to safetensors for quantized models (#151) · 84a26861
  Casper authored Nov 04, 2023
  
  84a26861
31 Oct, 2023 1 commit
- AwqConfig class (#132) · eea08aa6
  Casper authored Oct 31, 2023
  
  eea08aa6
27 Sep, 2023 1 commit
- Rely on accelerate.dispatch_model() only · ffaaa259
  s4rduk4r authored Sep 27, 2023
  
  ffaaa259
26 Sep, 2023 2 commits
- Clean · 91de3bfa
  s4rduk4r authored Sep 27, 2023
  
  91de3bfa
- Offload to cpu · 4f76ecb2
  s4rduk4r authored Sep 27, 2023
  
  4f76ecb2
24 Sep, 2023 1 commit
- Fix typing classes · 4abfefc9
  Vik Paruchuri authored Sep 23, 2023
  
  4abfefc9
21 Sep, 2023 2 commits
- Fix argument · 7c48033a
  Casper Hansen authored Sep 21, 2023
  
  7c48033a
- Improve model loading · 2dada8f8
  Casper Hansen authored Sep 21, 2023
  
  2dada8f8
20 Sep, 2023 6 commits
- Remove cosine loss · 90bf52c7
  Casper Hansen authored Sep 20, 2023
  
  90bf52c7
- Better comments. Implement cosine similarity · c9d01ac3
  Casper Hansen authored Sep 20, 2023
  
  c9d01ac3
- Move import up · e205548d
  Casper Hansen authored Sep 20, 2023
  
  e205548d
- Simplify saving model · ed618bb0
  Casper Hansen authored Sep 20, 2023
  
  ed618bb0
- Remove old quantization code · d3550fec
  Casper Hansen authored Sep 20, 2023
  
  d3550fec
- Working for OPT · 724bda58
  Casper Hansen authored Sep 20, 2023
  
  724bda58
15 Sep, 2023 2 commits
- Default to empty string for model file · 435b3b4b
  Casper Hansen authored Sep 15, 2023
  
  435b3b4b
- Actually pass args to calib function · a9cef34b
  Casper authored Sep 15, 2023
  
  a9cef34b
14 Sep, 2023 1 commit
- Pass split and text_column arguments to calib_data function · 84e82744
  Casper authored Sep 14, 2023
  
  84e82744
13 Sep, 2023 4 commits
- Unify using variable safetensors · 219ccb33
  Casper Hansen authored Sep 13, 2023
  
  219ccb33
- Fix ignore patterns · 7ba31254
  Casper Hansen authored Sep 13, 2023
  
  7ba31254
- Add safetensors support · db8ba322
  Casper Hansen authored Sep 13, 2023
  
  db8ba322
- Implement saving sharded weights + safetensors · 97d38e29
  Casper Hansen authored Sep 13, 2023
  
  97d38e29
09 Sep, 2023 1 commit
- Remove warnings about GEMM · c58ec73b
  Casper Hansen authored Sep 09, 2023
  
  c58ec73b
08 Sep, 2023 4 commits
- Fix variables and no contiguous memory for GEMV · e197a733
  Casper Hansen authored Sep 08, 2023
  
  e197a733
- Implement GEMM/GEMV in quantize function and fused modules · 5db43a7f
  Casper Hansen authored Sep 08, 2023
  
  5db43a7f
- Add deprecation warning · 9b2946b6
  Casper Hansen authored Sep 08, 2023
  
  9b2946b6
- Refactor modules, create separate GEMM and GEMV · fe314160
  Casper Hansen authored Sep 08, 2023
  
  fe314160
06 Sep, 2023 2 commits
- Remove simple dispatch · 562c0d52
  Casper authored Sep 06, 2023
  
  562c0d52
- Multi-GPU support for quantized models · f8273a0c
  Casper Hansen authored Sep 06, 2023
  
  f8273a0c
05 Sep, 2023 1 commit
- allow user to use custom calibration data for quantization · 1712ce21
  Erwan BOEHM authored Sep 05, 2023
  
  1712ce21