lmdeploy/lite/apis/auto_awq.py · d5cb0be2cd16e6c5eefd4d266a38357fde83a660 · guobj / Qwen_lmdeploy · GitLab

Find file Blame History Permalink

[Fix] Fix llama2 70b & qwen quantization error (#273) · d5cb0be2
pppppM authored Aug 24, 2023
```
* fix llama2 70b

* fix qwen quantization

* remove pdb

* add faq
```
d5cb0be2

auto_awq.py 2.83 KB