Commits · 11efba09bfb520152fee4e3404b386b52f50d59d · OpenDAS / AutoAWQ

02 Oct, 2023 2 commits
- Support safetensors in benchmark · 92579e9b
  Casper Hansen authored Oct 02, 2023
  
  92579e9b
- Mistral fused modules · d5bb4ec8
  Casper Hansen authored Oct 02, 2023
  
  d5bb4ec8
27 Sep, 2023 1 commit
- Add low_cpu_mem_usage=True in example · aa6497cd
  Casper Hansen authored Sep 27, 2023
  
  aa6497cd
20 Sep, 2023 2 commits
- Disable fused layers · d6cf1442
  Casper Hansen authored Sep 20, 2023
  
  d6cf1442
- Retire entry.py and create examples/eval.py · 80996d1d
  Casper Hansen authored Sep 20, 2023
  
  80996d1d
15 Sep, 2023 2 commits
- Rename safetensors generation example · 4ecd8594
  Casper Hansen authored Sep 15, 2023
  
  4ecd8594
- Add wikitext example · b9ab9a64
  Casper authored Sep 15, 2023
  
  b9ab9a64
14 Sep, 2023 1 commit
- Custom data example · 69d31edc
  Casper authored Sep 14, 2023
  
  69d31edc
13 Sep, 2023 7 commits
- Add notes to example · 720a1fce
  Casper Hansen authored Sep 13, 2023
  
  720a1fce
- Correct example · affd1906
  Casper Hansen authored Sep 13, 2023
  
  affd1906
- Add generation example for safetensors · bb455d7c
  Casper Hansen authored Sep 13, 2023
  
  bb455d7c
- More consistent benchmark · 86ea8df1
  Casper Hansen authored Sep 13, 2023
  
  86ea8df1
- Set the batch_size · fdff74d6
  Casper Hansen authored Sep 13, 2023
  
  fdff74d6
- Catch out of memory exception · a2aa804c
  Casper Hansen authored Sep 13, 2023
  
  a2aa804c
- Support batch size benchmark, stop if OOM · 0091f1e2
  Casper Hansen authored Sep 13, 2023
  
  0091f1e2
09 Sep, 2023 1 commit
- Default to GEMM · 48be2ee2
  Casper Hansen authored Sep 09, 2023
  
  48be2ee2
08 Sep, 2023 3 commits
- More detailed benchmark · 5297eccc
  Casper Hansen authored Sep 08, 2023
  
  5297eccc
- New benchmark script. · 341c8868
  Casper Hansen authored Sep 08, 2023
  
  341c8868
- Default to GEMV · 331ff953
  Casper Hansen authored Sep 08, 2023
  
  331ff953
27 Aug, 2023 2 commits
- Add basic generation example · 9ba3afac
  Casper Hansen authored Aug 27, 2023
  
  9ba3afac
- Add basic quant example · 60296077
  Casper authored Aug 27, 2023
  
  60296077
25 Aug, 2023 1 commit
- Remove examples · 6924d106
  Casper authored Aug 25, 2023
  
  6924d106
19 Aug, 2023 1 commit
- Modify README and examples · 2a243105
  Casper Hansen authored Aug 19, 2023
  
  2a243105
24 Jul, 2023 1 commit
- [Major] Add TinyChat and demo. · 4f3e977c
  Haotian Tang authored Jul 23, 2023
  
  4f3e977c
02 Jun, 2023 1 commit
- update README & demo · 42c8f57d
  Sakits authored Jun 02, 2023
  
  42c8f57d
01 Jun, 2023 1 commit
- first commit · 460d6d45
  Ji Lin authored May 31, 2023
  
  460d6d45