Update README.md

08d4c954 · laibao · 6cedbed7 · 08d4c954
Commit 08d4c954 authored Jan 03, 2025 by laibao
Show whitespace changes
Inline Side-by-side

Showing with 1 addition and 1 deletion

README.md README.md +1 -1

No files found.
--- a/README.md
+++ b/README.md
@@ -214,7 +214,7 @@ ssh -L 8000:计算节点IP:8000 -L 8001:计算节点IP:8001 用户名@登录节
 3.启动OpenAI兼容服务

 ```
-vllm serve mixtral/Mixtral-8x7B-Instruct-v0.1  --enforce-eager --dtype float16 --trust-remote-code  --port 8000
+vllm serve mixtral/Mixtral-8x7B-Instruct-v0.1  --enforce-eager --dtype float16 --trust-remote-code  --port 8000 -tp4
 ```

 4.启动gradio服务