Skip to content

GitLab

Commit 7afe5f64 authored by raojy's avatar raojy 💬
Browse files

Update README.md

parent a8307ee2
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
README.md
View file @ 7afe5f64
...@@ -64,7 +64,7 @@ vllm serve Qwen/Qwen3.6-27B \ ...@@ -64,7 +64,7 @@ vllm serve Qwen/Qwen3.6-27B \
--port 8001 \ --port 8001 \
--trust-remote-code \ --trust-remote-code \
--dtype bfloat16 \ --dtype bfloat16 \
--tensor-parallel-size 4 \ --tensor-parallel-size 2 \
--gpu-memory-utilization 0.925 \ --gpu-memory-utilization 0.925 \
--enable-auto-tool-choice \ --enable-auto-tool-choice \
--tool-call-parser qwen3_coder --tool-call-parser qwen3_coder
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment