Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
Qwen3-VL-Embedding_vllm
Commits
a905c143
Commit
a905c143
authored
Mar 10, 2026
by
weishb
Browse files
support vllm_0.15.x
parent
ed2965a5
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
5 additions
and
6 deletions
+5
-6
README.md
README.md
+5
-6
No files found.
README.md
View file @
a905c143
...
@@ -23,9 +23,9 @@ Qwen3-VL-Embedding 和 Qwen3-VL-Reranker 模型系列是通义千问(Qwen)
...
@@ -23,9 +23,9 @@ Qwen3-VL-Embedding 和 Qwen3-VL-Reranker 模型系列是通义千问(Qwen)
| DTK | 26.04 |
| DTK | 26.04 |
| python | 3.10.12 |
| python | 3.10.12 |
| transformers | 4.57.6 |
| transformers | 4.57.6 |
| vllm | 0.1
1.0
+das.opt1.
rc2
.dtk2604 |
| vllm | 0.1
5.1
+das.opt1.
alpha
.dtk2604 |
推荐使用镜像:harbor.sourcefind.cn:5443/dcu/admin/base/vllm
:
0.1
1.0
-ubuntu22.04-dtk26.04-0130-py3.10-202602
0
2
推荐使用镜像:harbor.sourcefind.cn:5443/dcu/admin/base/
custom:
vllm0.1
5.1
-ubuntu22.04-dtk26.04-0130-py3.10-2026022
0
```
bash
```
bash
docker run
-it
\
docker run
-it
\
...
@@ -42,7 +42,7 @@ docker run -it \
...
@@ -42,7 +42,7 @@ docker run -it \
-u
root
\
-u
root
\
-v
/opt/hyhal/:/opt/hyhal/:ro
\
-v
/opt/hyhal/:/opt/hyhal/:ro
\
-v
/path/your_code_data/:/path/your_code_data/
\
-v
/path/your_code_data/:/path/your_code_data/
\
harbor.sourcefind.cn:5443/dcu/admin/base/vllm
:
0.1
1.0
-ubuntu22.04-dtk26.04-0130-py3.10-202602
0
2 bash
harbor.sourcefind.cn:5443/dcu/admin/base/
custom:
vllm0.1
5.1
-ubuntu22.04-dtk26.04-0130-py3.10-2026022
0
bash
```
```
更多镜像可前往
[
光源
](
https://sourcefind.cn/#/service-list
)
下载使用。
更多镜像可前往
[
光源
](
https://sourcefind.cn/#/service-list
)
下载使用。
...
@@ -50,9 +50,7 @@ docker run -it \
...
@@ -50,9 +50,7 @@ docker run -it \
镜像内其他环境配置
镜像内其他环境配置
```
```
pip install pycountry
1.解压vllm.zip到/usr/local/lib/python3.10/dist-packages直接覆盖需要修改的文件
unzip -o vllm.zip -d /usr/local/lib/python3.10/dist-packages
```
```
...
@@ -66,6 +64,7 @@ docker run -it \
...
@@ -66,6 +64,7 @@ docker run -it \
### vllm
### vllm
#### 单机推理
#### 单机推理
```
bash
```
bash
export
VLLM_USE_FUSED_RMS_ROPE
=
0
## serve启动
## serve启动
vllm serve Qwen/Qwen3-VL-Embedding-8B
\
vllm serve Qwen/Qwen3-VL-Embedding-8B
\
--runner
pooling
\
--runner
pooling
\
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment