Skip to content

GitLab

"...git@developer.sourcefind.cn:chenpangpang/open-webui.git" did not exist on "42dcf1b08c973b6bf11f96c5d6bdf5be63e94b7f"
Commit 0ea19e60 authored by dcuai's avatar dcuai
Browse files

Update README.md

parent 582d7180
Show whitespace changes
Inline Side-by-side
Showing with 2 additions and 1 deletion
README.md
View file @ 0ea19e60
...@@ -136,9 +136,10 @@ bash infer.sh ...@@ -136,9 +136,10 @@ bash infer.sh
## result ## result
![推理1](推理1.png) ![推理1](推理1.png)
### 精度
## 量化
## 量化
### GPTQ量化 ### GPTQ量化
/usr/local/lib/python3.10/site-packages/optimum/gptq/quantizer.py 找到这个文件，676行，把safe_serialization=False /usr/local/lib/python3.10/site-packages/optimum/gptq/quantizer.py 找到这个文件，676行，把safe_serialization=False
``` ```
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment