Skip to content

GitLab

Commit a979e105 authored by weishb's avatar weishb
Browse files

update README.md

parent 5fdae242
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
README.md
View file @ a979e105
...@@ -70,7 +70,7 @@ docker run -it \ ...@@ -70,7 +70,7 @@ docker run -it \
## serve启动 ## serve启动
export HF_HUB_OFFLINE=1 export HF_HUB_OFFLINE=1
export TRANSFORMERS_OFFLINE=1 export TRANSFORMERS_OFFLINE=1
vllm serve /public/home/weishb/Qwen3-Next-80B-A3B-Thinking/Qwen3-Next-80B-A3B-Thinking \ vllm serve Qwen/Qwen3-Next-80B-A3B-Thinking \
--served-model-name "Qwen3-Next-80B-A3B-Thinking" \ --served-model-name "Qwen3-Next-80B-A3B-Thinking" \
--dtype bfloat16 \ --dtype bfloat16 \
--trust-remote-code \ --trust-remote-code \
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment