Commits · 3b362c0d1ceeaaff3459c5e46862676c8b2c706f · OpenDAS / AutoAWQ

15 Nov, 2023 1 commit
- [`core`] Replace `QuantLlamaMLP` with `QuantFusedMLP` (#188) · 3b362c0d
  Younes Belkada authored Nov 15, 2023
  
  3b362c0d
14 Nov, 2023 1 commit
- Fix multi-GPU loading and inference (#190) · 09c73fb2
  Casper authored Nov 14, 2023
  
  09c73fb2
11 Nov, 2023 1 commit
- Pass arguments to AutoConfig (#97) · 7c976752
  Andrey Glushenkov authored Nov 11, 2023
```
Co-authored-by: Casper <casperbh.96@gmail.com>
```
  7c976752
10 Nov, 2023 1 commit
- Make sure to delete dummy model (#180) · 1f6f5155
  Casper authored Nov 10, 2023
  
  1f6f5155
06 Nov, 2023 1 commit
- Yi support (#167) · 37c63440
  Casper authored Nov 06, 2023
  
  37c63440
04 Nov, 2023 2 commits
- Create fused LlamaLikeModel (#152) · 8110e028
  Casper authored Nov 04, 2023
  
  8110e028
- Default to safetensors for quantized models (#151) · 84a26861
  Casper authored Nov 04, 2023
  
  84a26861
31 Oct, 2023 1 commit
- AwqConfig class (#132) · eea08aa6
  Casper authored Oct 31, 2023
  
  eea08aa6
28 Oct, 2023 2 commits
- Support Aquila models. (#123) · dc13f0b8
  ldwang authored Oct 28, 2023
```
Signed-off-by: ldwang <ftgreat@gmail.com>
Co-authored-by: ldwang <ftgreat@gmail.com>
Co-authored-by: Casper Hansen <casperbh.96@gmail.com>
```
  dc13f0b8
- Fixing starcoder based models with 15B (#118) · 6c05f669
  Sebastian Bodza authored Oct 28, 2023
  
  6c05f669
19 Oct, 2023 1 commit
- add comments · bcfdeb38
  twaka authored Oct 17, 2023
  
  bcfdeb38
17 Oct, 2023 1 commit
- gpt_neox · ad45716f
  twaka authored Oct 17, 2023
  
  ad45716f
05 Oct, 2023 1 commit
- Remove warning · 661047f1
  Casper authored Oct 05, 2023
  
  661047f1
02 Oct, 2023 1 commit
- Mistral fused modules · d5bb4ec8
  Casper Hansen authored Oct 02, 2023
  
  d5bb4ec8
27 Sep, 2023 3 commits
- Add exception handling · 1ac3f976
  Casper Hansen authored Sep 27, 2023
  
  1ac3f976
- Mistral support · bd56c301
  Casper Hansen authored Sep 27, 2023
  
  bd56c301
- Rely on accelerate.dispatch_model() only · ffaaa259
  s4rduk4r authored Sep 27, 2023
  
  ffaaa259
26 Sep, 2023 2 commits
- Clean · 91de3bfa
  s4rduk4r authored Sep 27, 2023
  
  91de3bfa
- Offload to cpu · 4f76ecb2
  s4rduk4r authored Sep 27, 2023
  
  4f76ecb2
24 Sep, 2023 1 commit
- Fix typing classes · 4abfefc9
  Vik Paruchuri authored Sep 23, 2023
  
  4abfefc9
21 Sep, 2023 3 commits
- Remove fused modules (later) · 37db5759
  Casper Hansen authored Sep 21, 2023
  
  37db5759
- Fix argument · 7c48033a
  Casper Hansen authored Sep 21, 2023
  
  7c48033a
- Improve model loading · 2dada8f8
  Casper Hansen authored Sep 21, 2023
  
  2dada8f8
20 Sep, 2023 11 commits
- Add bigcode fused modules (WIP) · b49168f8
  Casper Hansen authored Sep 20, 2023
  
  b49168f8
- Remove cosine loss · 90bf52c7
  Casper Hansen authored Sep 20, 2023
  
  90bf52c7
- Better comments. Implement cosine similarity · c9d01ac3
  Casper Hansen authored Sep 20, 2023
  
  c9d01ac3
- Move import up · e205548d
  Casper Hansen authored Sep 20, 2023
  
  e205548d
- Simplify saving model · ed618bb0
  Casper Hansen authored Sep 20, 2023
  
  ed618bb0
- Remove old quantization code · d3550fec
  Casper Hansen authored Sep 20, 2023
  
  d3550fec
- Working for OPT · 724bda58
  Casper Hansen authored Sep 20, 2023
  
  724bda58
- Remove comment · 19568c52
  Casper Hansen authored Sep 20, 2023
  
  19568c52
- Add GPT BigCode support (StarCoder) · 984fd2f8
  Casper Hansen authored Sep 20, 2023
  
  984fd2f8
- Avoid fusing for larger Falcon models · e3936a44
  Casper Hansen authored Sep 20, 2023
  
  e3936a44
- Support kv_heads · 3256ffec
  Casper Hansen authored Sep 20, 2023
  
  3256ffec
15 Sep, 2023 2 commits
- Default to empty string for model file · 435b3b4b
  Casper Hansen authored Sep 15, 2023
  
  435b3b4b
- Actually pass args to calib function · a9cef34b
  Casper authored Sep 15, 2023
  
  a9cef34b
14 Sep, 2023 1 commit
- Pass split and text_column arguments to calib_data function · 84e82744
  Casper authored Sep 14, 2023
  
  84e82744
13 Sep, 2023 3 commits
- Unify using variable safetensors · 219ccb33
  Casper Hansen authored Sep 13, 2023
  
  219ccb33
- Fix ignore patterns · 7ba31254
  Casper Hansen authored Sep 13, 2023
  
  7ba31254
- Add safetensors support · db8ba322
  Casper Hansen authored Sep 13, 2023
  
  db8ba322