Commits · 7e361d16b5dd4102a03933255c02dd8411b4a8b4 · OpenDAS / AutoAWQ

"vscode:/vscode.git/clone" did not exist on "5303c1ed2274a0aa8b970545745c4bd7b54a487a"

29 Aug, 2023 1 commit
- Add cuda_runtime in include_dirs · 7e361d16
  Casper authored Aug 29, 2023
  
  7e361d16
28 Aug, 2023 5 commits
- Separate PyTorch install · 5bc0916b
  Casper authored Aug 28, 2023
  
  5bc0916b
- Add Python checkout · 6aa94f54
  Casper Hansen authored Aug 28, 2023
  
  6aa94f54
- Remove windows build · a20d30dd
  Casper Hansen authored Aug 28, 2023
  
  a20d30dd
- NVCC: Use asm volatile · 4c39a76a
  Casper Hansen authored Aug 28, 2023
  
  4c39a76a
- Define HALF_FLT_MAX · acdf7d9a
  Casper authored Aug 28, 2023
  
  acdf7d9a
27 Aug, 2023 15 commits
- Standardize ASM calls. Add Windows support. · d6bd9db7
  Casper Hansen authored Aug 27, 2023
  
  d6bd9db7
- Add basic generation example · 9ba3afac
  Casper Hansen authored Aug 27, 2023
  
  9ba3afac
- Replace print with logging, Remove uncommented code · b491c2d6
  Casper authored Aug 27, 2023
  
  b491c2d6
- Quote on python versions (fix: 3.10 was interpreted as 3.1) · f741f406
  Casper authored Aug 27, 2023
  
  f741f406
- Remove python from build · 98d874d1
  Casper authored Aug 27, 2023
  
  98d874d1
- run jobs on new release starting with "v" · 80ccf31a
  Casper authored Aug 27, 2023
  
  80ccf31a
- Initial workflow, needs testing · 5abd53a2
  Casper authored Aug 27, 2023
  
  5abd53a2
- Fix capability flags · 98ae978a
  Casper authored Aug 27, 2023
  
  98ae978a
- Add compute capability flags and n_threads as str · 7fee854f
  Casper authored Aug 27, 2023
  
  7fee854f
- Update install instructions · 77ca8337
  Casper authored Aug 27, 2023
  
  77ca8337
- Create more detailed setup.py · ff556eb0
  Casper authored Aug 27, 2023
  
  ff556eb0
- Add basic quant example · 60296077
  Casper authored Aug 27, 2023
  
  60296077
- Import from awq · c39ac59b
  Casper authored Aug 27, 2023
  
  c39ac59b
- Merge pull request #1 from jamesdborin/new_model/gptj · 7fbe9bbc
  Casper authored Aug 27, 2023
```
Add GPTJ Support
```
  7fbe9bbc
- Rename to hijacked_inputs · 50d1025f
  Casper authored Aug 27, 2023
  
  50d1025f
25 Aug, 2023 10 commits
- fixed catcher input name · 6b1c96c7
  EC2 Default User authored Aug 25, 2023
  
  6b1c96c7
- updated max_new_tokens_key · fac1af55
  EC2 Default User authored Aug 25, 2023
  
  fac1af55
- added gptj · 86fcf708
  EC2 Default User authored Aug 25, 2023
  
  86fcf708
- Update GPU requirements · 3a8072a1
  Casper authored Aug 25, 2023
  
  3a8072a1
- Update install instruction · 6ba0db15
  Casper authored Aug 25, 2023
  
  6ba0db15
- Update README · 59e662d5
  Casper authored Aug 25, 2023
  
  59e662d5
- Remove tinychat · 93799c9d
  Casper authored Aug 25, 2023
  
  93799c9d
- Remove examples · 6924d106
  Casper authored Aug 25, 2023
  
  6924d106
- Move kernels to base directory · b85ee5c1
  Casper authored Aug 25, 2023
  
  b85ee5c1
- Merge remote-tracking branch 'origin/refactor-models' · 1e82667b
  Casper authored Aug 25, 2023
  
  1e82667b
24 Aug, 2023 3 commits
- Add speed benchmark · 46750ff9
  Casper Hansen authored Aug 24, 2023
  
  46750ff9
- Integrate fused modules into AWQ model loading · 63346c34
  Casper Hansen authored Aug 24, 2023
  
  63346c34
- Refactor into one setup.py · 870a9dc9
  Casper Hansen authored Aug 24, 2023
  
  870a9dc9
22 Aug, 2023 6 commits
- Implement loading correct sequence length based on config + custom max_new_tokens · d9bab50c
  Casper Hansen authored Aug 22, 2023
  
  d9bab50c
- Implemented fp16 and fp32 sanitization. · b53a9be2
  Casper Hansen authored Aug 22, 2023
  
  b53a9be2
- Fix #69 - sanitize NaN and infs. · 6708bbcb
  Casper Hansen authored Aug 22, 2023
  
  6708bbcb
- Set full quant as default. Always load unquantized with AutoModel instead of accelerate. · 321d74ff
  Casper Hansen authored Aug 22, 2023
  
  321d74ff
- Change entry_type to 'eval' for running tasks. Add better support for tasks... · bd899094
  Casper authored Aug 22, 2023
```
Change entry_type to 'eval' for running tasks. Add better support for tasks (use quant+unquant, multiple tasks, n_shot, batch_size.
```
  bd899094
- Merge remote-tracking branch 'upstream/main' into refactor-models · a1aa84cc
  Casper authored Aug 22, 2023
  
  a1aa84cc