Skip to content

GitLab

Commit 27514e5c authored by zzg_666's avatar zzg_666
Browse files

修改

parent dd6120df
Show whitespace changes
Inline Side-by-side
Showing with 2 additions and 2 deletions
README.md
View file @ 27514e5c
...@@ -45,10 +45,10 @@ docker run -it --shm-size 60g --network=host --name EuroLLM --privileged --devic ...@@ -45,10 +45,10 @@ docker run -it --shm-size 60g --network=host --name EuroLLM --privileged --devic
### vllm ### vllm
#### 单机推理 #### 单机推理
可参考vllm_serve.sh脚本
```bash ```bash
## serve启动 ## serve启动
可参考vllm_serve.sh脚本
vllm serve utter-project/EuroLLM-22B-Instruct-2512 --trust-remote-code --dtype bfloat16 --max-seq-len-to-capture 32768 -tp 1 --max-model-len 32768 vllm serve utter-project/EuroLLM-22B-Instruct-2512 --trust-remote-code --dtype bfloat16 --max-seq-len-to-capture 32768 -tp 1 --max-model-len 32768
## client访问 ## client访问
可参考vllm_cilent.sh 可参考vllm_cilent.sh
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment