Commits · 2fcbf268c8449ed42cdeb77a87d184c5673286b7 · OpenDAS / AutoAWQ

21 Jan, 2024 1 commit
- Exllama kernels support (#313) · 2fcbf268
  Ilyas Moutawwakil authored Jan 21, 2024
```
Co-authored-by: Casper <casperbh.96@gmail.com>
```
  2fcbf268
03 Dec, 2023 1 commit
- Fix position ids (#215) · 4d49ae1f
  Casper authored Dec 03, 2023
  
  4d49ae1f
14 Nov, 2023 1 commit
- Fix multi-GPU loading and inference (#190) · 09c73fb2
  Casper authored Nov 14, 2023
  
  09c73fb2
11 Nov, 2023 2 commits
- Fix cache util logic (#186) · 299c460b
  Casper authored Nov 11, 2023
  
  299c460b
- Reset cache on new generation (#178) · df909e83
  Casper authored Nov 11, 2023
  
  df909e83
04 Nov, 2023 1 commit
- Create fused LlamaLikeModel (#152) · 8110e028
  Casper authored Nov 04, 2023
  
  8110e028
06 Oct, 2023 1 commit
- Move attention shapes to fused_utils · 306de683
  Casper Hansen authored Oct 06, 2023
  
  306de683