Commits · a1aa84cc478cf082d11f07c56a271bda71cdebee · OpenDAS / AutoAWQ

22 Aug, 2023 1 commit
- Merge remote-tracking branch 'upstream/main' into refactor-models · a1aa84cc
  Casper authored Aug 22, 2023
  
  a1aa84cc
21 Aug, 2023 2 commits
- Merge pull request #77 from Sakits/main · f3a90b77
  Jiaming Tang authored Aug 21, 2023
  
  f3a90b77
- [Minor] Temporarily change calibration dataset URL · 9c1ab9ba
  Jiaming Tang authored Aug 21, 2023
  
  9c1ab9ba
19 Aug, 2023 15 commits
- Modify README and examples · 2a243105
  Casper Hansen authored Aug 19, 2023
  
  2a243105
- FP16 weights example works · fd5b8c88
  Casper Hansen authored Aug 19, 2023
  
  fd5b8c88
- Revert · 0834fb46
  Casper Hansen authored Aug 19, 2023
  
  0834fb46
- Initial commit · d13bd43e
  Casper Hansen authored Aug 19, 2023
  
  d13bd43e
- TinyChat working with new framework · 8c8498e8
  Casper Hansen authored Aug 19, 2023
  
  8c8498e8
- Support Bloom models · 5c2c85fe
  Casper Hansen authored Aug 19, 2023
  
  5c2c85fe
- Fix logic for saving model · dd3010fb
  Casper Hansen authored Aug 19, 2023
  
  dd3010fb
- Support safetensors · 04e177ad
  Casper Hansen authored Aug 19, 2023
  
  04e177ad
- Support Falcon 7B+40B · d73d13b2
  Casper Hansen authored Aug 19, 2023
  
  d73d13b2
- Fix dict access · 06073073
  Casper Hansen authored Aug 19, 2023
  
  06073073
- Save model file with filename from quant_config · dcd58818
  Casper Hansen authored Aug 19, 2023
  
  dcd58818
- Create generate method · cc779bed
  Casper Hansen authored Aug 19, 2023
  
  cc779bed
- Load quantized model with saved quant_config · d68441d0
  Casper Hansen authored Aug 19, 2023
  
  d68441d0
- Make BaseAWQForCausalLM a torch.nn.Module · 84d23089
  Casper Hansen authored Aug 19, 2023
  
  84d23089
- Rename q_config -> quant_config. Include w_bit in quant_config. Save quant_config.json. · d35ade75
  Casper Hansen authored Aug 19, 2023
  
  d35ade75
18 Aug, 2023 7 commits
- Add OPT support · 6f30f051
  Casper Hansen authored Aug 18, 2023
  
  6f30f051
- Increase robustness of model loading · 471f811b
  Casper Hansen authored Aug 18, 2023
  
  471f811b
- Fix comment · 916fdf97
  Casper Hansen authored Aug 18, 2023
  
  916fdf97
- Refactor model class. Add LLaMa support (LLaMa-2, Vicuna, etc). · e2858cef
  Casper Hansen authored Aug 18, 2023
  
  e2858cef
- save_quantized working in all cases, from_quantized adapted. · d430694b
  Casper Hansen authored Aug 18, 2023
  
  d430694b
- Implement fallback calibration dataset (wikitext). · af4e0622
  Casper Hansen authored Aug 18, 2023
  
  af4e0622
- Implemented save_quantized. Generalize from_quantized.Add comments. · ed347704
  Casper Hansen authored Aug 18, 2023
  
  ed347704
17 Aug, 2023 8 commits
- Implement from_pretrained. Fix static methods and classmethods · 14d198c6
  Casper Hansen authored Aug 17, 2023
  
  14d198c6
- Cleanup code · 35ac58c7
  Casper Hansen authored Aug 17, 2023
  
  35ac58c7
- Create AutoAWQForCausalLM and load quantized models with from_quantized · e09dc751
  Casper Hansen authored Aug 17, 2023
  
  e09dc751
- Implement argparse and perplexity · 934ad336
  Casper Hansen authored Aug 17, 2023
  
  934ad336
- Refactor entry.py [WIP] · 5d4ab5dc
  Casper Hansen authored Aug 17, 2023
  
  5d4ab5dc
- Refactored pre_quant into base · 290f45e7
  Casper Hansen authored Aug 17, 2023
  
  290f45e7
- Fix typo + use kwargs · d5be2115
  Casper Hansen authored Aug 17, 2023
  
  d5be2115
- Initial refactor [WIP]. · 7e091fb1
  Casper authored Aug 17, 2023
  
  7e091fb1
15 Aug, 2023 1 commit
- Merge pull request #67 from Sakits/main · efea69e1
  Ji Lin authored Aug 14, 2023
```
Add compatibility with GQA & optimize multi-GPU memory allocation
```
  efea69e1
14 Aug, 2023 2 commits
- [Minor] add a comment · b190df35
  Jiaming Tang authored Aug 14, 2023
  
  b190df35
- Add compatibility with GQA & optimize multi-GPU memory allocation · 9b427ebc
  Jiaming Tang authored Aug 14, 2023
  
  9b427ebc
05 Aug, 2023 1 commit
- Merge pull request #45 from casperbh96/main · dc139757
  Ji Lin authored Aug 04, 2023
```
TinyChat: Fix logic for selecting MPT prompt templates (support for 8k variant).
```
  dc139757
02 Aug, 2023 2 commits
- Merge pull request #55 from mit-han-lab/dev/readme_update_0731 · e28cc4d0
  Ji Lin authored Aug 02, 2023
```
[Tinychat] Update README.
```
  e28cc4d0
- Merge branch 'main' into dev/readme_update_0731 · 3ca15edb
  Ji Lin authored Aug 02, 2023
  
  3ca15edb
01 Aug, 2023 1 commit
- Update README.md · d5f7a605
  Song authored Aug 01, 2023
  
  d5f7a605