Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
GLM-OCR_vllm
Commits
ea3cd106
"vscode:/vscode.git/clone" did not exist on "e6f7e946666db8311bcf5131e81319b78f0419e8"
Commit
ea3cd106
authored
Mar 23, 2026
by
dengjb
Browse files
update
parent
8faca65b
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
4 additions
and
3 deletions
+4
-3
README.md
README.md
+4
-3
No files found.
README.md
View file @
ea3cd106
...
...
@@ -52,6 +52,7 @@ docker run -it \
需要单独安装:
```
pip uninstall vllm
pip install vllm-0.15.1+das.opt1.alpha.dtk2604-cp310-cp310-linux_x86_64.whl
pip install -r requirements.txt
```
...
...
@@ -63,9 +64,9 @@ pip install -r requirements.txt
## 推理
### vllm
#### 单机
单卡
推理
#### 单机推理
vllm
推理脚本
推理脚本
参考
```
export HIP_VISIBLE_DEVICES=0
vllm serve ZhipuAI/GLM-OCR/ \
...
...
@@ -109,7 +110,7 @@ DCU与GPU精度一致,推理框架:vllm。
## 预训练权重
| 模型名称 | 权重大小 | DCU型号 | 最低卡数需求 | 下载地址 |
|:------:|:----:|:----------:|:------:|:---------------------:|
| GLM-OCR | 1.33B | BW1000 | 1 |
[
Hugging Face
](
https://huggingfac
e.c
o
/mo
onshotai/Kimi-K2.5
)
|
| GLM-OCR | 1.33B | BW1000 | 1 |
[
Model Scope
](
https://www.modelscop
e.c
n
/mo
dels/ZhipuAI/GLM-OCR/summary
)
|
## 源码仓库及问题反馈
-
https://developer.sourcefind.cn/codes/modelzoo/glm-ocr_vllm
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment