Commits · e440c7ac531c93f1b851a9a4eed8feacde5cd982 · OpenDAS / AutoAWQ

20 Nov, 2023 1 commit
- Add Qwen model (#182) · e440c7ac
  Qing authored Nov 20, 2023
```
Co-authored-by: Casper Hansen <casperbh.96@gmail.com>
```
  e440c7ac
18 Nov, 2023 2 commits
- Add config to Base model (#207) · 84c87877
  Casper authored Nov 18, 2023
  
  84c87877
- Fix MPT (#206) · 0e77dbc1
  Casper authored Nov 18, 2023
  
  0e77dbc1
16 Nov, 2023 2 commits
- Bump to 0.1.7 · 87350fef
  Casper authored Nov 16, 2023
  
  87350fef
- Fixed multi-GPU quantization (#196) · 6f516b8d
  Casper authored Nov 16, 2023
  
  6f516b8d
15 Nov, 2023 2 commits
- [`core`] Add `is_hf_transformers` flag (#195) · 74d0fe44
  Younes Belkada authored Nov 15, 2023
  
  74d0fe44
- [`core`] Replace `QuantLlamaMLP` with `QuantFusedMLP` (#188) · 3b362c0d
  Younes Belkada authored Nov 15, 2023
  
  3b362c0d
14 Nov, 2023 1 commit
- Fix multi-GPU loading and inference (#190) · 09c73fb2
  Casper authored Nov 14, 2023
  
  09c73fb2
11 Nov, 2023 4 commits
- Fix cache util logic (#186) · 299c460b
  Casper authored Nov 11, 2023
  
  299c460b
- Pass arguments to AutoConfig (#97) · 7c976752
  Andrey Glushenkov authored Nov 11, 2023
```
Co-authored-by: Casper <casperbh.96@gmail.com>
```
  7c976752
- Adaptive batch sizing (#181) · c5581b27
  Casper authored Nov 11, 2023
  
  c5581b27
- Reset cache on new generation (#178) · df909e83
  Casper authored Nov 11, 2023
  
  df909e83
10 Nov, 2023 3 commits
- New logic for passing past_key_value (#177) · 5db86ec5
  Younes Belkada authored Nov 10, 2023
  
  5db86ec5
- Fix CUDA error: invalid argument (#179) · 63e3fd83
  Casper authored Nov 10, 2023
  
  63e3fd83
- Make sure to delete dummy model (#180) · 1f6f5155
  Casper authored Nov 10, 2023
  
  1f6f5155
06 Nov, 2023 1 commit
- Yi support (#167) · 37c63440
  Casper authored Nov 06, 2023
  
  37c63440
05 Nov, 2023 4 commits
- Fix typo in benchmark command (#161) · 781dc944
  Casper authored Nov 05, 2023
  
  781dc944
- New benchmarks in README (#160) · 5c7e3682
  Casper authored Nov 05, 2023
  
  5c7e3682
- Exclude download of CUDA wheels (#159) · 9f2c383f
  Casper authored Nov 05, 2023
  
  9f2c383f
- Build older cuda wheels (#158) · 9f9ce41f
  Casper authored Nov 05, 2023
  
  9f9ce41f
04 Nov, 2023 2 commits
- Create fused LlamaLikeModel (#152) · 8110e028
  Casper authored Nov 04, 2023
  
  8110e028
- Default to safetensors for quantized models (#151) · 84a26861
  Casper authored Nov 04, 2023
  
  84a26861
03 Nov, 2023 3 commits
- Fix condition when rolling cache (#150) · 958678df
  Casper authored Nov 04, 2023
  
  958678df
- [`core` / `attention`] Fix fused attention generation with newest transformers version (#146) · 92a403b2
  Younes Belkada authored Nov 04, 2023
```
Co-authored-by: Casper <casperbh.96@gmail.com>
```
  92a403b2
- Fix performance regression (#148) · 3eda6562
  Casper authored Nov 03, 2023
  
  3eda6562
02 Nov, 2023 6 commits
- Revert to previous version (#141) · bf64abd8
  Casper authored Nov 02, 2023
  
  bf64abd8
- CUDA 12 release (#140) · f3f05c75
  Casper authored Nov 02, 2023
  
  f3f05c75
- Bump to v0.1.6 (#139) · abf44cce
  Casper authored Nov 02, 2023
  
  abf44cce
- Benchmark info (#138) · 2bfa234f
  Casper authored Nov 02, 2023
  
  2bfa234f
- Update readme (#137) · 0f3214b1
  Casper authored Nov 02, 2023
  
  0f3214b1
- Fix init quant (#136) · 89f3feae
  Casper authored Nov 02, 2023
  
  89f3feae
31 Oct, 2023 1 commit
- AwqConfig class (#132) · eea08aa6
  Casper authored Oct 31, 2023
  
  eea08aa6
30 Oct, 2023 1 commit
- CUDA 11.8.0 and 12.1.1 build (#128) · a7d87540
  Casper authored Oct 30, 2023
  
  a7d87540
29 Oct, 2023 1 commit
- Pseudo dequantize function (#127) · f1a2e56e
  Casper authored Oct 29, 2023
  
  f1a2e56e
28 Oct, 2023 6 commits
- Bump to v0.1.5 · b9ed6641
  Casper authored Oct 28, 2023
  
  b9ed6641
- Add benchmark of Aquila2 34B AWQ in README.md. (#126) · d6ac3be3
  ldwang authored Oct 29, 2023
```
Signed-off-by: ldwang <ftgreat@gmail.com>
Co-authored-by: ldwang <ftgreat@gmail.com>
```
  d6ac3be3
- Support Aquila models. (#123) · dc13f0b8
  ldwang authored Oct 28, 2023
```
Signed-off-by: ldwang <ftgreat@gmail.com>
Co-authored-by: ldwang <ftgreat@gmail.com>
Co-authored-by: Casper Hansen <casperbh.96@gmail.com>
```
  dc13f0b8
- Fixing starcoder based models with 15B (#118) · 6c05f669
  Sebastian Bodza authored Oct 28, 2023
  
  6c05f669
- Fix potential overflow (#102) · 0cadd65f
  Casper authored Oct 28, 2023
  
  0cadd65f
- [`core`] Support fp32 / bf16 inference (#121) · 18712d00
  Younes Belkada authored Oct 28, 2023
  
  18712d00