Commits · 34085edc92c30be141fa10defc0e3eb43eaa9d4f · OpenDAS / AutoAWQ

03 Feb, 2024 1 commit
- Marlin symmetric quantization and inference (#320) · 34085edc
  Ilyas Moutawwakil authored Feb 03, 2024
```
Co-authored-by: Casper <casperbh.96@gmail.com>
```
  34085edc
24 Jan, 2024 1 commit
- Torch only inference + any-device quantization (#319) · c6c7b065
  Casper authored Jan 24, 2024
  
  c6c7b065
21 Jan, 2024 1 commit
- Exllama kernels support (#313) · 2fcbf268
  Ilyas Moutawwakil authored Jan 21, 2024
```
Co-authored-by: Casper <casperbh.96@gmail.com>
```
  2fcbf268
03 Dec, 2023 1 commit
- Fix position ids (#215) · 4d49ae1f
  Casper authored Dec 03, 2023
  
  4d49ae1f
14 Nov, 2023 1 commit
- Fix multi-GPU loading and inference (#190) · 09c73fb2
  Casper authored Nov 14, 2023
  
  09c73fb2
11 Nov, 2023 2 commits
- Fix cache util logic (#186) · 299c460b
  Casper authored Nov 11, 2023
  
  299c460b
- Reset cache on new generation (#178) · df909e83
  Casper authored Nov 11, 2023
  
  df909e83
04 Nov, 2023 1 commit
- Create fused LlamaLikeModel (#152) · 8110e028
  Casper authored Nov 04, 2023
  
  8110e028
06 Oct, 2023 1 commit
- Move attention shapes to fused_utils · 306de683
  Casper Hansen authored Oct 06, 2023
  
  306de683