Skip to content

GitLab

"docs/git@developer.sourcefind.cn:OpenDAS/nni.git" did not exist on "7953911039f3a478c168668df68b52962d4f821f"
Commit aea0c29f authored by lvzhen's avatar lvzhen
Browse files

Update README.md

parent 0b6a3659
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
README.md
View file @ aea0c29f
...@@ -108,7 +108,7 @@ bash infer.sh ...@@ -108,7 +108,7 @@ bash infer.sh
## 量化 ## 量化
### GPTQ量化 ### GPTQ量化
/usr/local/lib/python3.10/site-packages/optimum/gptq/quantizer.py 找到这个文件，676行，把safe_serialization=False
``` ```
HIP_VISIBLE_DEVICES=0 swift export --model_type telechat-7b \ HIP_VISIBLE_DEVICES=0 swift export --model_type telechat-7b \
--quant_bits 8 --quant_method gptq --model_id_or_path /path/to/telechat-7b \ --quant_bits 8 --quant_method gptq --model_id_or_path /path/to/telechat-7b \
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment