Skip to content

GitLab

Commit 85b99456 authored by dengjb's avatar dengjb
Browse files

Update README.md

parent 2d993779
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
README.md
View file @ 85b99456
...@@ -55,7 +55,7 @@ vllm serve /path/of/ByteDance/Seed-Coder-8B-Instruct/ \ ...@@ -55,7 +55,7 @@ vllm serve /path/of/ByteDance/Seed-Coder-8B-Instruct/ \
--max-model-len 32768 \ --max-model-len 32768 \
--served-model-name seedcoder \ --served-model-name seedcoder \
--dtype bfloat16 \ --dtype bfloat16 \
-tp 8 -tp 1
## client访问 ## client访问
curl http://localhost:8000/v1/chat/completions \ curl http://localhost:8000/v1/chat/completions \
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment