Skip to content

GitLab

"examples/vscode:/vscode.git/clone" did not exist on "927d2b319bc7a6c31c63ad64e6124477c2a5b583"
Commit 085561c0 authored by chenych's avatar chenych
Browse files

Update README

parent 1a7a091b
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 2 deletions
README.md
View file @ 085561c0
...@@ -98,7 +98,7 @@ curl http://x.x.x.x:8000/v1/chat/completions \ ...@@ -98,7 +98,7 @@ curl http://x.x.x.x:8000/v1/chat/completions \
1. 加入环境变量 1. 加入环境变量
> 请注意： > 请注意：
> 每个节点上的环境变量都写到.sh文件中，保存后各个计算节点分别source .sh文件 > 每个节点上的环境变量都写到.sh文件中，保存后各个计算节点分别source`.sh`文件
> >
> VLLM_HOST_IP：节点本地通信口ip，尽量选择IB网卡的IP，**避免出现rccl超时问题** > VLLM_HOST_IP：节点本地通信口ip，尽量选择IB网卡的IP，**避免出现rccl超时问题**
> >
...@@ -172,7 +172,7 @@ curl http://x.x.x.x:8000/v1/chat/completions \ ...@@ -172,7 +172,7 @@ curl http://x.x.x.x:8000/v1/chat/completions \
<div align=center> <div align=center>
<img src="./doc/results-dcu.png"/> <img src="./doc/results-dcu.png"/>
</div> </div>
![alt text](image.png)
### 精度 ### 精度
DCU与GPU精度一致，推理框架：vllm。 DCU与GPU精度一致，推理框架：vllm。
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment