Skip to content

GitLab

"...git@developer.sourcefind.cn:chenpangpang/open-webui.git" did not exist on "2f0ed3becbc34b6526665954b4927100b2d688b0"
Commit aea0c29f authored by lvzhen's avatar lvzhen
Browse files

Update README.md

parent 0b6a3659
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
README.md
View file @ aea0c29f
......@@ -108,7 +108,7 @@ bash infer.sh
## 量化
### GPTQ量化
/usr/local/lib/python3.10/site-packages/optimum/gptq/quantizer.py 找到这个文件，676行，把safe_serialization=False
```
HIP_VISIBLE_DEVICES=0 swift export --model_type telechat-7b \
--quant_bits 8 --quant_method gptq --model_id_or_path /path/to/telechat-7b \
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment