Commits · 34085edc92c30be141fa10defc0e3eb43eaa9d4f · OpenDAS / AutoAWQ

03 Feb, 2024 1 commit
- Marlin symmetric quantization and inference (#320) · 34085edc
  Ilyas Moutawwakil authored Feb 03, 2024
```
Co-authored-by: Casper <casperbh.96@gmail.com>
```
  34085edc
24 Jan, 2024 1 commit
- Torch only inference + any-device quantization (#319) · c6c7b065
  Casper authored Jan 24, 2024
  
  c6c7b065
04 Nov, 2023 2 commits
- Create fused LlamaLikeModel (#152) · 8110e028
  Casper authored Nov 04, 2023
  
  8110e028
- Default to safetensors for quantized models (#151) · 84a26861
  Casper authored Nov 04, 2023
  
  84a26861
06 Oct, 2023 1 commit
- Update Mistral example · 204a3a12
  Casper Hansen authored Oct 06, 2023
  
  204a3a12
02 Oct, 2023 1 commit
- Mistral fused modules · d5bb4ec8
  Casper Hansen authored Oct 02, 2023
  
  d5bb4ec8
27 Aug, 2023 1 commit
- Add basic generation example · 9ba3afac
  Casper Hansen authored Aug 27, 2023
  
  9ba3afac