Commits · 77ca8337650af4e12963f7478a64a82fc236fa6d · OpenDAS / AutoAWQ

27 Aug, 2023 6 commits
- Update install instructions · 77ca8337
  Casper authored Aug 27, 2023
  
  77ca8337
- Create more detailed setup.py · ff556eb0
  Casper authored Aug 27, 2023
  
  ff556eb0
- Add basic quant example · 60296077
  Casper authored Aug 27, 2023
  
  60296077
- Import from awq · c39ac59b
  Casper authored Aug 27, 2023
  
  c39ac59b
- Merge pull request #1 from jamesdborin/new_model/gptj · 7fbe9bbc
  Casper authored Aug 27, 2023
```
Add GPTJ Support
```
  7fbe9bbc
- Rename to hijacked_inputs · 50d1025f
  Casper authored Aug 27, 2023
  
  50d1025f
25 Aug, 2023 10 commits
- fixed catcher input name · 6b1c96c7
  EC2 Default User authored Aug 25, 2023
  
  6b1c96c7
- updated max_new_tokens_key · fac1af55
  EC2 Default User authored Aug 25, 2023
  
  fac1af55
- added gptj · 86fcf708
  EC2 Default User authored Aug 25, 2023
  
  86fcf708
- Update GPU requirements · 3a8072a1
  Casper authored Aug 25, 2023
  
  3a8072a1
- Update install instruction · 6ba0db15
  Casper authored Aug 25, 2023
  
  6ba0db15
- Update README · 59e662d5
  Casper authored Aug 25, 2023
  
  59e662d5
- Remove tinychat · 93799c9d
  Casper authored Aug 25, 2023
  
  93799c9d
- Remove examples · 6924d106
  Casper authored Aug 25, 2023
  
  6924d106
- Move kernels to base directory · b85ee5c1
  Casper authored Aug 25, 2023
  
  b85ee5c1
- Merge remote-tracking branch 'origin/refactor-models' · 1e82667b
  Casper authored Aug 25, 2023
  
  1e82667b
24 Aug, 2023 3 commits
- Add speed benchmark · 46750ff9
  Casper Hansen authored Aug 24, 2023
  
  46750ff9
- Integrate fused modules into AWQ model loading · 63346c34
  Casper Hansen authored Aug 24, 2023
  
  63346c34
- Refactor into one setup.py · 870a9dc9
  Casper Hansen authored Aug 24, 2023
  
  870a9dc9
22 Aug, 2023 6 commits
- Implement loading correct sequence length based on config + custom max_new_tokens · d9bab50c
  Casper Hansen authored Aug 22, 2023
  
  d9bab50c
- Implemented fp16 and fp32 sanitization. · b53a9be2
  Casper Hansen authored Aug 22, 2023
  
  b53a9be2
- Fix #69 - sanitize NaN and infs. · 6708bbcb
  Casper Hansen authored Aug 22, 2023
  
  6708bbcb
- Set full quant as default. Always load unquantized with AutoModel instead of accelerate. · 321d74ff
  Casper Hansen authored Aug 22, 2023
  
  321d74ff
- Change entry_type to 'eval' for running tasks. Add better support for tasks... · bd899094
  Casper authored Aug 22, 2023
```
Change entry_type to 'eval' for running tasks. Add better support for tasks (use quant+unquant, multiple tasks, n_shot, batch_size.
```
  bd899094
- Merge remote-tracking branch 'upstream/main' into refactor-models · a1aa84cc
  Casper authored Aug 22, 2023
  
  a1aa84cc
21 Aug, 2023 2 commits
- Merge pull request #77 from Sakits/main · f3a90b77
  Jiaming Tang authored Aug 21, 2023
  
  f3a90b77
- [Minor] Temporarily change calibration dataset URL · 9c1ab9ba
  Jiaming Tang authored Aug 21, 2023
  
  9c1ab9ba
19 Aug, 2023 13 commits
- Modify README and examples · 2a243105
  Casper Hansen authored Aug 19, 2023
  
  2a243105
- FP16 weights example works · fd5b8c88
  Casper Hansen authored Aug 19, 2023
  
  fd5b8c88
- Revert · 0834fb46
  Casper Hansen authored Aug 19, 2023
  
  0834fb46
- Initial commit · d13bd43e
  Casper Hansen authored Aug 19, 2023
  
  d13bd43e
- TinyChat working with new framework · 8c8498e8
  Casper Hansen authored Aug 19, 2023
  
  8c8498e8
- Support Bloom models · 5c2c85fe
  Casper Hansen authored Aug 19, 2023
  
  5c2c85fe
- Fix logic for saving model · dd3010fb
  Casper Hansen authored Aug 19, 2023
  
  dd3010fb
- Support safetensors · 04e177ad
  Casper Hansen authored Aug 19, 2023
  
  04e177ad
- Support Falcon 7B+40B · d73d13b2
  Casper Hansen authored Aug 19, 2023
  
  d73d13b2
- Fix dict access · 06073073
  Casper Hansen authored Aug 19, 2023
  
  06073073
- Save model file with filename from quant_config · dcd58818
  Casper Hansen authored Aug 19, 2023
  
  dcd58818
- Create generate method · cc779bed
  Casper Hansen authored Aug 19, 2023
  
  cc779bed
- Load quantized model with saved quant_config · d68441d0
  Casper Hansen authored Aug 19, 2023
  
  d68441d0