Commits · 727172e91ddfd3f5f50efd7cf38a141168186335 · OpenDAS / AutoAWQ

22 Dec, 2023 2 commits
- Fused rope theta (#270) · 727172e9
  Casper authored Dec 23, 2023
```
Co-authored-by: Casper Hansen <casperbh96@gmail.com>
```
  727172e9
- Mixtral: Mixture of Experts quantization (#251) · 5b9f3c47
  Casper authored Dec 22, 2023
  
  5b9f3c47
03 Dec, 2023 1 commit
- Benchmark hf generate (#237) · 8dbf009b
  Casper authored Dec 03, 2023
  
  8dbf009b
28 Nov, 2023 1 commit
- New scaling to improve perplexity (#216) · d1112e1c
  Casper authored Nov 28, 2023
  
  d1112e1c
05 Nov, 2023 1 commit
- New benchmarks in README (#160) · 5c7e3682
  Casper authored Nov 05, 2023
  
  5c7e3682
04 Nov, 2023 2 commits
- Create fused LlamaLikeModel (#152) · 8110e028
  Casper authored Nov 04, 2023
  
  8110e028
- Default to safetensors for quantized models (#151) · 84a26861
  Casper authored Nov 04, 2023
  
  84a26861
03 Nov, 2023 1 commit
- Fix performance regression (#148) · 3eda6562
  Casper authored Nov 03, 2023
  
  3eda6562
02 Nov, 2023 1 commit
- Update readme (#137) · 0f3214b1
  Casper authored Nov 02, 2023
  
  0f3214b1
31 Oct, 2023 1 commit
- AwqConfig class (#132) · eea08aa6
  Casper authored Oct 31, 2023
  
  eea08aa6
06 Oct, 2023 1 commit
- Update Mistral example · 204a3a12
  Casper Hansen authored Oct 06, 2023
  
  204a3a12
02 Oct, 2023 2 commits
- Support safetensors in benchmark · 92579e9b
  Casper Hansen authored Oct 02, 2023
  
  92579e9b
- Mistral fused modules · d5bb4ec8
  Casper Hansen authored Oct 02, 2023
  
  d5bb4ec8
27 Sep, 2023 1 commit
- Add low_cpu_mem_usage=True in example · aa6497cd
  Casper Hansen authored Sep 27, 2023
  
  aa6497cd
20 Sep, 2023 2 commits
- Disable fused layers · d6cf1442
  Casper Hansen authored Sep 20, 2023
  
  d6cf1442
- Retire entry.py and create examples/eval.py · 80996d1d
  Casper Hansen authored Sep 20, 2023
  
  80996d1d
15 Sep, 2023 2 commits
- Rename safetensors generation example · 4ecd8594
  Casper Hansen authored Sep 15, 2023
  
  4ecd8594
- Add wikitext example · b9ab9a64
  Casper authored Sep 15, 2023
  
  b9ab9a64
14 Sep, 2023 1 commit
- Custom data example · 69d31edc
  Casper authored Sep 14, 2023
  
  69d31edc
13 Sep, 2023 7 commits
- Add notes to example · 720a1fce
  Casper Hansen authored Sep 13, 2023
  
  720a1fce
- Correct example · affd1906
  Casper Hansen authored Sep 13, 2023
  
  affd1906
- Add generation example for safetensors · bb455d7c
  Casper Hansen authored Sep 13, 2023
  
  bb455d7c
- More consistent benchmark · 86ea8df1
  Casper Hansen authored Sep 13, 2023
  
  86ea8df1
- Set the batch_size · fdff74d6
  Casper Hansen authored Sep 13, 2023
  
  fdff74d6
- Catch out of memory exception · a2aa804c
  Casper Hansen authored Sep 13, 2023
  
  a2aa804c
- Support batch size benchmark, stop if OOM · 0091f1e2
  Casper Hansen authored Sep 13, 2023
  
  0091f1e2
09 Sep, 2023 1 commit
- Default to GEMM · 48be2ee2
  Casper Hansen authored Sep 09, 2023
  
  48be2ee2
08 Sep, 2023 3 commits
- More detailed benchmark · 5297eccc
  Casper Hansen authored Sep 08, 2023
  
  5297eccc
- New benchmark script. · 341c8868
  Casper Hansen authored Sep 08, 2023
  
  341c8868
- Default to GEMV · 331ff953
  Casper Hansen authored Sep 08, 2023
  
  331ff953
27 Aug, 2023 2 commits
- Add basic generation example · 9ba3afac
  Casper Hansen authored Aug 27, 2023
  
  9ba3afac
- Add basic quant example · 60296077
  Casper authored Aug 27, 2023
  
  60296077
25 Aug, 2023 1 commit
- Remove examples · 6924d106
  Casper authored Aug 25, 2023
  
  6924d106
19 Aug, 2023 1 commit
- Modify README and examples · 2a243105
  Casper Hansen authored Aug 19, 2023
  
  2a243105
24 Jul, 2023 1 commit
- [Major] Add TinyChat and demo. · 4f3e977c
  Haotian Tang authored Jul 23, 2023
  
  4f3e977c
02 Jun, 2023 1 commit
- update README & demo · 42c8f57d
  Sakits authored Jun 02, 2023
  
  42c8f57d
01 Jun, 2023 1 commit
- first commit · 460d6d45
  Ji Lin authored May 31, 2023
  
  460d6d45