Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
TeleAI_T1_vllm
Commits
f3eb3ea9
Commit
f3eb3ea9
authored
Dec 09, 2025
by
dengjb
Browse files
update
parent
68b83cdf
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
2 deletions
+2
-2
README.md
README.md
+2
-2
No files found.
README.md
View file @
f3eb3ea9
...
...
@@ -58,7 +58,7 @@ vllm serve /path/of/TeleAI/T1-35B/ \
--max-model-len
32768
\
--served-model-name
teleai_t1
\
--dtype
bfloat16
\
-tp
1
-tp
4
## client访问
可参考vllm_cilent.sh
...
...
@@ -87,7 +87,7 @@ DCU与GPU精度一致,推理框架:vllm。
## 预训练权重
| 模型名称 | 权重大小 | DCU型号 | 最低卡数需求 |下载地址|
|:-----:|:----------:|:----------:|:---------------------:|:----------:|
| TeleAI_T1 | 35B | BW1000 |
1
|
[
modelscope
](
https://modelscope.cn/models/TeleAI/T1-35B
)
|
| TeleAI_T1 | 35B | BW1000 |
4
|
[
modelscope
](
https://modelscope.cn/models/TeleAI/T1-35B
)
|
## 源码仓库及问题反馈
-
https://developer.sourcefind.cn/codes/modelzoo/teleai_t1_vllm
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment