Commits · eb85f67d36ccd72e7cdf5cdc29954a265603e062 · OpenDAS / AutoAWQ

06 Apr, 2024 6 commits
- Add download_kwargs for load model (#302) (#399) · eb85f67d
  Roshiago authored Apr 06, 2024
  
  eb85f67d
- Workaround: illegal memory access (#421) · f8353793
  Casper authored Apr 06, 2024
  
  f8353793
- Implement `apply_clip` argument to `quantize()` (#427) · b5db7fcd
  Casper authored Apr 06, 2024
  
  b5db7fcd
- Pin: lm_eval==0.4.1 (#426) · c780d650
  Casper authored Apr 06, 2024
  
  c780d650
- FIX: Add safe guards for static cache + llama on transformers latest (#401) · 1f07200a
  Younes Belkada authored Apr 06, 2024
  
  1f07200a
- Fix fused models for tf >= 4.39 (#418) · 5d7b0502
  TechxGenus authored Apr 06, 2024
  
  5d7b0502
24 Mar, 2024 2 commits
- Bump to v0.2.4 (#409) · 0fa9a2c1
  Casper authored Mar 24, 2024
  
  0fa9a2c1
- Pin transformers>=4.35.0,<=4.38.2 (#408) · 0f942181
  Casper authored Mar 24, 2024
  
  0f942181
11 Mar, 2024 1 commit
- Add Gemma Support (#393) · 94e73f0b
  TechxGenus authored Mar 11, 2024
  
  94e73f0b
02 Mar, 2024 3 commits
- Bump to 0.2.3 · d8ca1e2f
  Casper authored Mar 02, 2024
  
  d8ca1e2f
- x_max -> x_mean and w_max -> w_mean name changes and some comments (#378) · f713b888
  Oscar Savolainen authored Mar 02, 2024
  
  f713b888
- Fix double bias (#383) · d9dc8e56
  Casper authored Mar 02, 2024
  
  d9dc8e56
24 Feb, 2024 1 commit
- New optimized kernels (#365) · 68c727a1
  Casper authored Feb 25, 2024
  
  68c727a1
17 Feb, 2024 2 commits
- Bump to 0.2.2 (#356) · 6b7992aa
  Casper authored Feb 17, 2024
  
  6b7992aa
- Remove MoE Triton kernels (#355) · a40515f4
  Casper authored Feb 17, 2024
  
  a40515f4
16 Feb, 2024 5 commits
- Add multi-GPU benchmark of Mixtral (#353) · d54bf0ef
  Casper authored Feb 16, 2024
  
  d54bf0ef
- Support Fused Mixtral on multi-GPU (#352) · 79b6fbd8
  Casper authored Feb 16, 2024
  
  79b6fbd8
- Bump to 0.2.1 (#351) · 74053104
  Casper authored Feb 16, 2024
  
  74053104
- Fix triton dependency (#350) · 8849043a
  Casper authored Feb 16, 2024
  
  8849043a
- ENH / FIX: Few enhancements and fix for mixed-precision training (#348) · 969b290e
  Younes Belkada authored Feb 16, 2024
  
  969b290e
15 Feb, 2024 7 commits
- Avoid downloading ROCm (#347) · 2de6092a
  Casper authored Feb 15, 2024
  
  2de6092a
- Fix typo in setup.py (#346) · d8311027
  Casper authored Feb 15, 2024
  
  d8311027
- Fix workflow (#345) · be0f9e01
  Casper authored Feb 15, 2024
  
  be0f9e01
- Fix importlib (#344) · 171c7aff
  Casper authored Feb 15, 2024
  
  171c7aff
- Fix dependency (#343) · 890127fa
  Casper authored Feb 15, 2024
  
  890127fa
- Fix ROCm build (#342) · 9477ea5c
  Casper authored Feb 15, 2024
  
  9477ea5c
- v0.2.0 (#330) · bcaa8a36
  Casper authored Feb 15, 2024
```
Co-authored-by: jinz2014 <7799920+jinz2014@users.noreply.github.com>
Co-authored-by: Jin Z <5zj@cousteau.ftpn.ornl.gov>
```
  bcaa8a36
14 Feb, 2024 1 commit
- [`PEFT`] Fix PEFT batch size > 1 (#338) · c69d3b65
  Younes Belkada authored Feb 14, 2024
  
  c69d3b65
03 Feb, 2024 5 commits
- PEFT compatible GEMM (#324) · 29ee66d9
  Casper authored Feb 03, 2024
  
  29ee66d9
- Fix n_samples (#326) · ebe8fc3f
  Casper authored Feb 03, 2024
  
  ebe8fc3f
- Add qwen2 (#321) · cc75d0e8
  Junyang Lin authored Feb 03, 2024
  
  cc75d0e8
- Marlin symmetric quantization and inference (#320) · 34085edc
  Ilyas Moutawwakil authored Feb 03, 2024
```
Co-authored-by: Casper <casperbh.96@gmail.com>
```
  34085edc
- AMD ROCM Support (#315) · f018d2b7
  Ilyas Moutawwakil authored Feb 03, 2024
  
  f018d2b7
26 Jan, 2024 1 commit
- Fixes a breaking change in autoawq (#325) · 8c78db4d
  Younes Belkada authored Jan 26, 2024
  
  8c78db4d
24 Jan, 2024 3 commits
- Evaluation: Add more evals (#283) · 7133575a
  Casper authored Jan 24, 2024
  
  7133575a
- Up to 60% faster context processing (#316) · 149236e4
  Casper authored Jan 24, 2024
  
  149236e4
- Torch only inference + any-device quantization (#319) · c6c7b065
  Casper authored Jan 24, 2024
  
  c6c7b065
21 Jan, 2024 2 commits
- Cleanup requirements (#295) · 8117845b
  Casper authored Jan 21, 2024
  
  8117845b
- Exllama kernels support (#313) · 2fcbf268
  Ilyas Moutawwakil authored Jan 21, 2024
```
Co-authored-by: Casper <casperbh.96@gmail.com>
```
  2fcbf268
07 Jan, 2024 1 commit
- GGUF compatible quantization (2, 3, 4 bit / any bit) (#285) · a3db8099
  Casper authored Jan 07, 2024
  
  a3db8099