Commits · 7cd461ffd6406589c6d007a0f8d025255a8961ab · OpenDAS / AutoAWQ

19 Sep, 2023 1 commit
- Add GEMM v2 kernel · 7cd461ff
  Casper Hansen authored Sep 19, 2023
  
  7cd461ff
15 Sep, 2023 7 commits
- Merge pull request #47 from casper-hansen/safetensors · 8788fe10
  Casper authored Sep 15, 2023
```
Safetensors and model sharding
```
  8788fe10
- Rename safetensors generation example · 4ecd8594
  Casper Hansen authored Sep 15, 2023
  
  4ecd8594
- Default to empty string for model file · 435b3b4b
  Casper Hansen authored Sep 15, 2023
  
  435b3b4b
- Merge pull request #27 from boehm-e/main · 2a3e0fa1
  Casper authored Sep 15, 2023
```
Allow user to use custom calibration data for quantization
```
  2a3e0fa1
- Add wikitext example · b9ab9a64
  Casper authored Sep 15, 2023
  
  b9ab9a64
- Move shuffling up for datasets loaded with load_dataset · d832a218
  Casper authored Sep 15, 2023
  
  d832a218
- Actually pass args to calib function · a9cef34b
  Casper authored Sep 15, 2023
  
  a9cef34b
14 Sep, 2023 4 commits
- Custom data example · 69d31edc
  Casper authored Sep 14, 2023
  
  69d31edc
- Pass split and text_column arguments to calib_data function · 84e82744
  Casper authored Sep 14, 2023
  
  84e82744
- Merge branch 'main' into pr/27 · 077f39a0
  Casper authored Sep 14, 2023
  
  077f39a0
- Allow huggingface datasets · faedf517
  Casper authored Sep 14, 2023
  
  faedf517
13 Sep, 2023 21 commits
- Add notes to example · 720a1fce
  Casper Hansen authored Sep 13, 2023
  
  720a1fce
- Correct example · affd1906
  Casper Hansen authored Sep 13, 2023
  
  affd1906
- Unify using variable safetensors · 219ccb33
  Casper Hansen authored Sep 13, 2023
  
  219ccb33
- Add generation example for safetensors · bb455d7c
  Casper Hansen authored Sep 13, 2023
  
  bb455d7c
- Fix ignore patterns · 7ba31254
  Casper Hansen authored Sep 13, 2023
  
  7ba31254
- Add safetensors support · db8ba322
  Casper Hansen authored Sep 13, 2023
  
  db8ba322
- Implement saving sharded weights + safetensors · 97d38e29
  Casper Hansen authored Sep 13, 2023
  
  97d38e29
- Update README.md · d76125bf
  Casper authored Sep 13, 2023
  
  d76125bf
- Merge pull request #40 from casper-hansen/new_kernel · 1b0af2d3
  Casper authored Sep 13, 2023
```
[NEW] GEMV kernel implementation
```
  1b0af2d3
- Update README · f264ebb3
  Casper Hansen authored Sep 13, 2023
  
  f264ebb3
- Fix Falcon benchmark format · dc99d2fc
  Casper Hansen authored Sep 13, 2023
  
  dc99d2fc
- Update benchmarks · 7cf3c790
  Casper Hansen authored Sep 13, 2023
  
  7cf3c790
- More consistent benchmark · 86ea8df1
  Casper Hansen authored Sep 13, 2023
  
  86ea8df1
- Guide on quantized vs non-quantized · 98f6d7b9
  Casper Hansen authored Sep 13, 2023
  
  98f6d7b9
- Add explanation of from_quantized variables · c88b2e25
  Casper Hansen authored Sep 13, 2023
  
  c88b2e25
- Update README.md · 196119b4
  Casper authored Sep 13, 2023
  
  196119b4
- Set batch size for attention shapes · d3625d1c
  Casper Hansen authored Sep 13, 2023
  
  d3625d1c
- Set the batch_size · fdff74d6
  Casper Hansen authored Sep 13, 2023
  
  fdff74d6
- Set AWQ_BATCH_SIZE environment variable · 6e0bde15
  Casper Hansen authored Sep 13, 2023
  
  6e0bde15
- Catch out of memory exception · a2aa804c
  Casper Hansen authored Sep 13, 2023
  
  a2aa804c
- Support batch size benchmark, stop if OOM · 0091f1e2
  Casper Hansen authored Sep 13, 2023
  
  0091f1e2
12 Sep, 2023 7 commits
- Falcon 40B attention shapes [WIP] · 28d52d81
  Casper Hansen authored Sep 12, 2023
  
  28d52d81
- xq view key · bc4f93c2
  Casper Hansen authored Sep 12, 2023
  
  bc4f93c2
- Fix Falcon inputs ids · ba4da393
  Casper Hansen authored Sep 12, 2023
  
  ba4da393
- Falcon: Enable fused attention · f03f72de
  Casper Hansen authored Sep 12, 2023
  
  f03f72de
- Create custom attention shape for Falcon 7B · ac770875
  Casper Hansen authored Sep 12, 2023
  
  ac770875
- xk_reshape key · 7f8f9f16
  Casper Hansen authored Sep 12, 2023
  
  7f8f9f16
- Refactor view/reshaping into a predefined dict · a8c9afd5
  Casper Hansen authored Sep 12, 2023
  
  a8c9afd5