Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
Qwen2.5-VL_pytorch
Commits
5c6c5987
Commit
5c6c5987
authored
Feb 09, 2026
by
raojy
Browse files
updata
parent
986dd49f
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
9 additions
and
15 deletions
+9
-15
README.md
README.md
+9
-15
No files found.
README.md
View file @
5c6c5987
...
...
@@ -16,8 +16,7 @@
<div
align=
center
>
<img
src=
"./images/arch.png"
/>
</div>
### 环境依赖
## 环境依赖
| 软件 | 版本 |
| :----------: | :--------------------------------------------: |
...
...
@@ -212,22 +211,19 @@ torchrun ./LLaMA-Factory/src/train.py \
### transformers
### 单机
单卡
### 单机
推理
```
#单卡推理
python inference.py
```
### 单机多卡
```
#多卡推理
CUDA_VISIBLE_DEVICES=0,1,2,3 python inference.py
```
##
#
vllm
## vllm
#### 单
卡
推理
#### 单
机
推理
```
vllm推理需要确认qwen_vl_utils库,若不存在,请执行
...
...
@@ -297,16 +293,14 @@ curl http://localhost:8000/v1/chat/completions \
}'
```
##
#
效果展示
## 效果展示
<div
align=
center
>
<img
src=
"./images/result1.png"
/>
</div>
## 精度
### 精度
DCU与GPU精度一致,推理框架:transformers、vllm。
`DCU与GPU精度一致,推理框架:transformers、vllm。`
## 预训练权重
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment