Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
gpt-oss_vllm
Commits
53261a65
Commit
53261a65
authored
Apr 24, 2026
by
dengjb
Browse files
update
parent
e8a143ef
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
9 additions
and
4 deletions
+9
-4
README.md
README.md
+9
-4
No files found.
README.md
View file @
53261a65
#
GPT-OSS
#
gpt-oss
## 论文
[
GPT-OSS
](
https://arxiv.org/pdf/2508.10925
)
[
gpt-oss
](
https://arxiv.org/pdf/2508.10925
)
## 模型简介
...
...
@@ -75,9 +75,14 @@ docker run -it \
#### 单机推理
vllm服务端运行
```
bash
bash
dirs
/run_vllm_server.sh
```
vllm客户端调用
```
bash
bash
dirs
/test_inference.sh
```
## 效果展示
...
...
@@ -93,8 +98,8 @@ bash dirs/run_vllm_server.sh
| 模型名称 | 权重大小 | DCU型号 | 最低卡数需求 |下载地址|
|:-----:|:----------:|:----------:|:---------------------:|:----------:|
| gpt-oss-20b | 20B | BW1000 | 1 |
[
Modelscope
](
https://www.modelscope.cn/models/unsloth/gpt-oss-20b-BF16
)
|
| gpt-oss-120b | 120B | BW1000 | 4 |
[
Modelscope
](
https://www.modelscope.cn/models/unsloth/gpt-oss-120b-BF16
)
|
| gpt-oss-20b
-BF16
| 20B | BW1000 | 1 |
[
Modelscope
](
https://www.modelscope.cn/models/unsloth/gpt-oss-20b-BF16
)
|
| gpt-oss-120b
-BF16
| 120B | BW1000 | 4 |
[
Modelscope
](
https://www.modelscope.cn/models/unsloth/gpt-oss-120b-BF16
)
|
## 源码仓库及问题反馈
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment