Commits · 84a2686110b42454b2a3bc7d9f13f608bdecc7c0 · OpenDAS / AutoAWQ

04 Nov, 2023 1 commit
- Default to safetensors for quantized models (#151) · 84a26861
  Casper authored Nov 04, 2023
  
  84a26861
03 Nov, 2023 1 commit
- Fix performance regression (#148) · 3eda6562
  Casper authored Nov 03, 2023
  
  3eda6562
02 Nov, 2023 1 commit
- Update readme (#137) · 0f3214b1
  Casper authored Nov 02, 2023
  
  0f3214b1
31 Oct, 2023 1 commit
- AwqConfig class (#132) · eea08aa6
  Casper authored Oct 31, 2023
  
  eea08aa6
02 Oct, 2023 1 commit
- Support safetensors in benchmark · 92579e9b
  Casper Hansen authored Oct 02, 2023
  
  92579e9b
13 Sep, 2023 4 commits
- More consistent benchmark · 86ea8df1
  Casper Hansen authored Sep 13, 2023
  
  86ea8df1
- Set the batch_size · fdff74d6
  Casper Hansen authored Sep 13, 2023
  
  fdff74d6
- Catch out of memory exception · a2aa804c
  Casper Hansen authored Sep 13, 2023
  
  a2aa804c
- Support batch size benchmark, stop if OOM · 0091f1e2
  Casper Hansen authored Sep 13, 2023
  
  0091f1e2
08 Sep, 2023 2 commits
- More detailed benchmark · 5297eccc
  Casper Hansen authored Sep 08, 2023
  
  5297eccc
- New benchmark script. · 341c8868
  Casper Hansen authored Sep 08, 2023
  
  341c8868