Commit 62a4af9d authored by chenych's avatar chenych
Browse files

modify readme

parent 0c72f2a1
......@@ -16,7 +16,7 @@ ERNIE 4.5 的架构支持图像、视频和文本输入,并能输出文本。
## 环境配置
### 硬件需求
模型[ERNIE-4.5-0.3B-PT](https://huggingface.co/baidu/ERNIE-4.5-0.3B-PT)需要DCU型号:K100_AI,节点数量:1台,卡数:1 张。
DCU型号:K100_AI,节点数量:1台,卡数:1 张。
`-v 路径``docker_name``imageID`根据实际情况修改
......@@ -78,6 +78,9 @@ cp vllm/ernie45* /usr/local/lib/python3.10/dist-packages/vllm/model_executor/mod
样例模型:[ERNIE-4.5-0.3B-PT](https://huggingface.co/baidu/ERNIE-4.5-0.3B-PT)
server启动
以模型[ERNIE-4.5-0.3B-PT](https://huggingface.co/baidu/ERNIE-4.5-0.3B-PT)为例
```bash
vllm serve baidu/ERNIE-4.5-0.3B-PT --trust-remote-code --port 8001 --served-model-name ERNIE-4.5-0.3B-PT
```
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment