Commits · a024e893367a1924f579bce40f8b6a2a3d59b24a · OpenDAS / AutoAWQ

"vscode:/vscode.git/clone" did not exist on "96b57a9ad6447b95921b91e5f52fb3684f73514f"

20 Sep, 2023 5 commits
- Removed unused module · bf76e108
  Casper Hansen authored Sep 20, 2023
  
  bf76e108
- Use default attention shapes · d973a0e0
  Casper Hansen authored Sep 20, 2023
  
  d973a0e0
- Fix attention shapes. Add repeat interleave. · 2d593b84
  Casper Hansen authored Sep 20, 2023
  
  2d593b84
- Avoid fusing for larger Falcon models · e3936a44
  Casper Hansen authored Sep 20, 2023
  
  e3936a44
- Support kv_heads · 3256ffec
  Casper Hansen authored Sep 20, 2023
  
  3256ffec
19 Sep, 2023 1 commit
- Use GEMM v2 kernel for context processing · f3a71d1d
  Casper Hansen authored Sep 19, 2023
  
  f3a71d1d
15 Sep, 2023 3 commits
- Default to empty string for model file · 435b3b4b
  Casper Hansen authored Sep 15, 2023
  
  435b3b4b
- Move shuffling up for datasets loaded with load_dataset · d832a218
  Casper authored Sep 15, 2023
  
  d832a218
- Actually pass args to calib function · a9cef34b
  Casper authored Sep 15, 2023
  
  a9cef34b
14 Sep, 2023 2 commits
- Pass split and text_column arguments to calib_data function · 84e82744
  Casper authored Sep 14, 2023
  
  84e82744
- Allow huggingface datasets · faedf517
  Casper authored Sep 14, 2023
  
  faedf517
13 Sep, 2023 6 commits
- Unify using variable safetensors · 219ccb33
  Casper Hansen authored Sep 13, 2023
  
  219ccb33
- Fix ignore patterns · 7ba31254
  Casper Hansen authored Sep 13, 2023
  
  7ba31254
- Add safetensors support · db8ba322
  Casper Hansen authored Sep 13, 2023
  
  db8ba322
- Implement saving sharded weights + safetensors · 97d38e29
  Casper Hansen authored Sep 13, 2023
  
  97d38e29
- Set batch size for attention shapes · d3625d1c
  Casper Hansen authored Sep 13, 2023
  
  d3625d1c
- Set AWQ_BATCH_SIZE environment variable · 6e0bde15
  Casper Hansen authored Sep 13, 2023
  
  6e0bde15
12 Sep, 2023 8 commits
- Falcon 40B attention shapes [WIP] · 28d52d81
  Casper Hansen authored Sep 12, 2023
  
  28d52d81
- xq view key · bc4f93c2
  Casper Hansen authored Sep 12, 2023
  
  bc4f93c2
- Fix Falcon inputs ids · ba4da393
  Casper Hansen authored Sep 12, 2023
  
  ba4da393
- Falcon: Enable fused attention · f03f72de
  Casper Hansen authored Sep 12, 2023
  
  f03f72de
- Create custom attention shape for Falcon 7B · ac770875
  Casper Hansen authored Sep 12, 2023
  
  ac770875
- xk_reshape key · 7f8f9f16
  Casper Hansen authored Sep 12, 2023
  
  7f8f9f16
- Refactor view/reshaping into a predefined dict · a8c9afd5
  Casper Hansen authored Sep 12, 2023
  
  a8c9afd5
- Create Falcon block and model for fusing · 4517b3f2
  Casper Hansen authored Sep 12, 2023
  
  4517b3f2
11 Sep, 2023 8 commits
- Remove xformers · 1aa8aebd
  Casper Hansen authored Sep 11, 2023
  
  1aa8aebd
- Update MPTBlock, fuse with MPTModel · dd41a223
  Casper Hansen authored Sep 11, 2023
  
  dd41a223
- Fix attention, support alibi · 7631add1
  Casper Hansen authored Sep 11, 2023
  
  7631add1
- Create MPTModel class · 90f54dbb
  Casper Hansen authored Sep 11, 2023
  
  90f54dbb
- Initialize with device · e80663bb
  Casper Hansen authored Sep 11, 2023
  
  e80663bb
- Remove fusing attention, only blocks · ac3e86df
  Casper Hansen authored Sep 11, 2023
  
  ac3e86df
- Fuse MPT block · 950851b3
  Casper Hansen authored Sep 11, 2023
  
  950851b3
- Switch to torch SDPA · d7badefc
  Casper Hansen authored Sep 11, 2023
  
  d7badefc
09 Sep, 2023 7 commits
- Falcon fused layers · 54f02854
  Casper Hansen authored Sep 09, 2023
  
  54f02854
- Fix alibi, rotary arg, neox, arg · 73c5e2bf
  Casper Hansen authored Sep 09, 2023
  
  73c5e2bf
- Fuse MPT · f3695d60
  Casper Hansen authored Sep 09, 2023
  
  f3695d60
- Update module name · 5bd6fbc7
  Casper Hansen authored Sep 09, 2023
  
  5bd6fbc7
- Implement ALiBi. · adc5304b
  Casper Hansen authored Sep 09, 2023
  
  adc5304b
- Remove warnings about GEMM · c58ec73b
  Casper Hansen authored Sep 09, 2023
  
  c58ec73b
- Create torch SDPA implementation · ebbbc3a5
  Casper Hansen authored Sep 09, 2023
  
  ebbbc3a5