Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
Qwen3.6
Commits
ed315608
Commit
ed315608
authored
May 09, 2026
by
raojy
💬
Browse files
Update README.md
parent
313413b4
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
8 additions
and
8 deletions
+8
-8
README.md
README.md
+8
-8
No files found.
README.md
View file @
ed315608
...
...
@@ -13,11 +13,11 @@ Qwen3.6是一款采用混合专家 (MoE) 架构并包含视觉编码器的多模
| 软件 | 版本 |
| :------: |:-----------------------------------------:|
| DTK | 26.04 |
|
p
ython | 3.10.12 |
|
t
ransformers | 5.5.0 |
| v
ll
m | 0.18.1+das.fa71803.dtk2604 |
|
t
riton | 3.6.0+gitc73250c4.staging |
|
t
orch | 2.10.0+das.opt1.dtk2604.20260325.g6b060a |
|
P
ython | 3.10.12 |
|
T
ransformers | 5.5.0 |
| v
LL
m | 0.18.1+das.fa71803.dtk2604 |
|
T
riton | 3.6.0+gitc73250c4.staging |
|
T
orch | 2.10.0+das.opt1.dtk2604.20260325.g6b060a |
当前推荐使用镜像: harbor.sourcefind.cn:5443/dcu/admin/base/custom:vllm018-ubuntu22.04-dtk26.04-qwen3.6-20260423
...
...
@@ -56,7 +56,7 @@ docker run -it \
暂无
## 推理
### v
ll
m
### v
LL
m
#### 单机推理
```
bash
## serve启动
...
...
@@ -65,7 +65,7 @@ vllm serve Qwen/Qwen3.6-27B \
--trust-remote-code
\
--dtype
bfloat16
\
--tensor-parallel-size
2
\
--gpu-memory-utilization
0.9
25
\
--gpu-memory-utilization
0.9
\
--enable-auto-tool-choice
\
--tool-call-parser
qwen3_coder
...
...
@@ -103,7 +103,7 @@ curl http://localhost:8001/v1/chat/completions \
</div>
### 精度
-
推理框架:v
ll
m
-
推理框架:v
LL
m
-
测试数据:humaneval、gsm8k
-
使用的加速卡:bw1000
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment