Commit 3409b209 authored by laibao's avatar laibao
Browse files

Update README.md

parent 76dad2f6
......@@ -219,7 +219,7 @@ vllm serve mixtral/Mixtral-8x7B-Instruct-v0.1 --enforce-eager -tp 4 --dtype flo
4.启动gradio服务
```
python gradio_openai_chatbot_webserver.py --model "mixtral/Mixtral-8x7B-Instruct-v0.1" --model-url http://localhost:8000/v1 --temp 0.8 --stop-token-ids --host "0.0.0.0" --port 8001"
python gradio_openai_chatbot_webserver.py --model "mixtral/Mixtral-8x7B-Instruct-v0.1" --model-url http://localhost:8000/v1 --temp 0.8 --stop-token-ids "" --host "0.0.0.0" --port 8001"
```
5.使用对话服务
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment