Skip to content

GitLab

"src/vscode:/vscode.git/clone" did not exist on "a16957159e24e53df0a40bfadbcd0a61b4b3ea8c"
Commit 3409b209 authored by laibao's avatar laibao
Browse files

Update README.md

parent 76dad2f6
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
README.md
View file @ 3409b209
...@@ -219,7 +219,7 @@ vllm serve mixtral/Mixtral-8x7B-Instruct-v0.1 --enforce-eager -tp 4 --dtype flo ...@@ -219,7 +219,7 @@ vllm serve mixtral/Mixtral-8x7B-Instruct-v0.1 --enforce-eager -tp 4 --dtype flo
4.启动gradio服务 4.启动gradio服务
``` ```
python gradio_openai_chatbot_webserver.py --model "mixtral/Mixtral-8x7B-Instruct-v0.1" --model-url http://localhost:8000/v1 --temp 0.8 --stop-token-ids --host "0.0.0.0" --port 8001" python gradio_openai_chatbot_webserver.py --model "mixtral/Mixtral-8x7B-Instruct-v0.1" --model-url http://localhost:8000/v1 --temp 0.8 --stop-token-ids "" --host "0.0.0.0" --port 8001"
``` ```
5.使用对话服务 5.使用对话服务
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment