Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
ERNIE-4.5_vllm
Commits
62a4af9d
Commit
62a4af9d
authored
Jul 09, 2025
by
chenych
Browse files
modify readme
parent
0c72f2a1
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
4 additions
and
1 deletion
+4
-1
README.md
README.md
+4
-1
No files found.
README.md
View file @
62a4af9d
...
@@ -16,7 +16,7 @@ ERNIE 4.5 的架构支持图像、视频和文本输入,并能输出文本。
...
@@ -16,7 +16,7 @@ ERNIE 4.5 的架构支持图像、视频和文本输入,并能输出文本。
## 环境配置
## 环境配置
### 硬件需求
### 硬件需求
模型
[
ERNIE-4.5-0.3B-PT
](
https://huggingface.co/baidu/ERNIE-4.5-0.3B-PT
)
需要
DCU型号:K100_AI,节点数量:1台,卡数:1 张。
DCU型号:K100_AI,节点数量:1台,卡数:1 张。
`-v 路径`
、
`docker_name`
和
`imageID`
根据实际情况修改
`-v 路径`
、
`docker_name`
和
`imageID`
根据实际情况修改
...
@@ -78,6 +78,9 @@ cp vllm/ernie45* /usr/local/lib/python3.10/dist-packages/vllm/model_executor/mod
...
@@ -78,6 +78,9 @@ cp vllm/ernie45* /usr/local/lib/python3.10/dist-packages/vllm/model_executor/mod
样例模型:
[
ERNIE-4.5-0.3B-PT
](
https://huggingface.co/baidu/ERNIE-4.5-0.3B-PT
)
样例模型:
[
ERNIE-4.5-0.3B-PT
](
https://huggingface.co/baidu/ERNIE-4.5-0.3B-PT
)
server启动
server启动
以模型
[
ERNIE-4.5-0.3B-PT
](
https://huggingface.co/baidu/ERNIE-4.5-0.3B-PT
)
为例
```
bash
```
bash
vllm serve baidu/ERNIE-4.5-0.3B-PT
--trust-remote-code
--port
8001
--served-model-name
ERNIE-4.5-0.3B-PT
vllm serve baidu/ERNIE-4.5-0.3B-PT
--trust-remote-code
--port
8001
--served-model-name
ERNIE-4.5-0.3B-PT
```
```
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment