Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
Qwen3-Omni_vllm
Commits
c41052c7
"vscode:/vscode.git/clone" did not exist on "6202251f0963187a7781f181365cf8c19bf343d5"
Commit
c41052c7
authored
Apr 02, 2026
by
chenych
Browse files
Modify some mistakes in README.md
parent
ed58b0f4
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
7 additions
and
7 deletions
+7
-7
README.md
README.md
+7
-7
No files found.
README.md
View file @
c41052c7
...
@@ -15,12 +15,11 @@ Qwen3-Omni 是一款原生的端到端全模态基座模型,具备对文本、
...
@@ -15,12 +15,11 @@ Qwen3-Omni 是一款原生的端到端全模态基座模型,具备对文本、
## 环境依赖
## 环境依赖
| 软件 | 版本 |
| 软件 | 版本 |
| :------: |:-----------------------------------------:|
| :------: |:-----------------------------------------:|
| DTK | 26.04 |
| DTK | 26.04 |
| python | 3.10.12 |
| python | 3.10.12 |
| transformers | 5.2.0.dev0 |
| transformers | 4.57.6 |
| vllm | 0.15.1+das.opt1.alpha.dtk2604 |
| vllm | 0.15.1+das.opt1.alpha.dtk2604.20260220.g2799735a |
| triton | 3.3.0+das.opt2.dtk2604 |
| torch | 2.9.0+das.opt1.dtk2604.20260206.g275d08c2 |
| torch | 2.9.0+das.opt1.dtk2604 |
推荐使用镜像: harbor.sourcefind.cn:5443/dcu/admin/base/custom:vllm0.15.1-ubuntu22.04-dtk26.04-0130-py3.10-20260220
推荐使用镜像: harbor.sourcefind.cn:5443/dcu/admin/base/custom:vllm0.15.1-ubuntu22.04-dtk26.04-0130-py3.10-20260220
...
@@ -48,6 +47,7 @@ docker run -it \
...
@@ -48,6 +47,7 @@ docker run -it \
```
```
pip uninstall vllm numpy
pip uninstall vllm numpy
pip install vllm-0.15.1+das.opt1.alpha.dtk2604-cp310-cp310-linux_x86_64.whl
pip install vllm-0.15.1+das.opt1.alpha.dtk2604-cp310-cp310-linux_x86_64.whl
pip install pycountry
pip install numpy==1.26.1
pip install numpy==1.26.1
```
```
...
@@ -66,7 +66,7 @@ pip install numpy==1.26.1
...
@@ -66,7 +66,7 @@ pip install numpy==1.26.1
vllm serve Qwen/Qwen3-Omni-30B-A3B-Instruct
\
vllm serve Qwen/Qwen3-Omni-30B-A3B-Instruct
\
--trust-remote-code
\
--trust-remote-code
\
--tensor-parallel-size
4
\
--tensor-parallel-size
2
\
--dtype
bfloat16
--dtype
bfloat16
## client访问
## client访问
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment