Commits · fcd9637c06034ae5ba9769b09f2e422729f7ce56 · OpenDAS / AutoAWQ

24 Feb, 2024 1 commit
- New optimized kernels (#365) · 68c727a1
  Casper authored Feb 25, 2024
  
  68c727a1
16 Feb, 2024 1 commit
- Add multi-GPU benchmark of Mixtral (#353) · d54bf0ef
  Casper authored Feb 16, 2024
  
  d54bf0ef
15 Feb, 2024 1 commit

Casper authored Feb 15, 2024


Co-authored-by: jinz2014 <7799920+jinz2014@users.noreply.github.com>
Co-authored-by: Jin Z <5zj@cousteau.ftpn.ornl.gov>

bcaa8a36

23 Dec, 2023 1 commit
- Add Baichuan2 Support (#247) · cef9f113
  Aoyu authored Dec 23, 2023
```
Co-authored-by: Casper <casperbh.96@gmail.com>
```
  cef9f113
03 Dec, 2023 1 commit
- Benchmark hf generate (#237) · 8dbf009b
  Casper authored Dec 03, 2023
  
  8dbf009b
05 Nov, 2023 1 commit
- New benchmarks in README (#160) · 5c7e3682
  Casper authored Nov 05, 2023
  
  5c7e3682
04 Nov, 2023 1 commit
- Default to safetensors for quantized models (#151) · 84a26861
  Casper authored Nov 04, 2023
  
  84a26861
03 Nov, 2023 1 commit
- Fix performance regression (#148) · 3eda6562
  Casper authored Nov 03, 2023
  
  3eda6562
02 Nov, 2023 1 commit
- Update readme (#137) · 0f3214b1
  Casper authored Nov 02, 2023
  
  0f3214b1
31 Oct, 2023 1 commit
- AwqConfig class (#132) · eea08aa6
  Casper authored Oct 31, 2023
  
  eea08aa6
02 Oct, 2023 1 commit
- Support safetensors in benchmark · 92579e9b
  Casper Hansen authored Oct 02, 2023
  
  92579e9b
13 Sep, 2023 4 commits
- More consistent benchmark · 86ea8df1
  Casper Hansen authored Sep 13, 2023
  
  86ea8df1
- Set the batch_size · fdff74d6
  Casper Hansen authored Sep 13, 2023
  
  fdff74d6
- Catch out of memory exception · a2aa804c
  Casper Hansen authored Sep 13, 2023
  
  a2aa804c
- Support batch size benchmark, stop if OOM · 0091f1e2
  Casper Hansen authored Sep 13, 2023
  
  0091f1e2
08 Sep, 2023 2 commits
- More detailed benchmark · 5297eccc
  Casper Hansen authored Sep 08, 2023
  
  5297eccc
- New benchmark script. · 341c8868
  Casper Hansen authored Sep 08, 2023
  
  341c8868