Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
Qwen2.5-VL_pytorch
Commits
37759753
Commit
37759753
authored
Feb 04, 2026
by
raojy
Browse files
updata
parent
01b0f097
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
19 deletions
+1
-19
README.md
README.md
+1
-19
No files found.
README.md
View file @
37759753
...
...
@@ -35,23 +35,6 @@
-
挂载地址
`-v`
根据实际模型情况修改
```
bash
docker run
-it
\
--shm-size
60g
\
--network
=
host
\
--name
{
docker_name
}
\
--privileged
\
--device
=
/dev/kfd
\
--device
=
/dev/dri
\
--device
=
/dev/mkfd
\
--group-add
video
\
--cap-add
=
SYS_PTRACE
\
--security-opt
seccomp
=
unconfined
\
-u
root
\
-v
/opt/hyhal/:/opt/hyhal/:ro
\
-v
/path/your_code_data/:/path/your_code_data/
\
{
docker_image_name
}
bash
示例如下:
docker run
-it
\
--shm-size
60g
\
--network
=
host
\
...
...
@@ -271,8 +254,7 @@ curl http://localhost:8000/v1/chat/completions \
# 适用于72B模型
# 启动命令
vllm serve "/home/project/weight_cache/models--Qwen--Qwen2.5-VL-72B-Instruct/models--Qwen--Qwen2.5-VL-72B-Instruct/snapshots/89c86200743eec961a297729e7990e8f2ddbc4c5" \
vllm serve Qwen/Qwen2.5-VL-72B-Instruct \
--served-model-name "qwen-vl" \
--tensor-parallel-size 4 \
--gpu-memory-utilization 0.95 \
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment