Skip to content

GitLab

Commit d44ba1a0 authored by luopl's avatar luopl
Browse files

Update README.md

parent b305aca6
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 0 deletions
README.md
View file @ d44ba1a0
...@@ -65,6 +65,8 @@ vLLM Deployment(vllm官方暂不支持AFD，只支持非分离模式部署): ...@@ -65,6 +65,8 @@ vLLM Deployment(vllm官方暂不支持AFD，只支持非分离模式部署):
``` ```
#head节点执行 #head节点执行
#Tensor Parallelism
#暂不支持attention data parallelism
VLLM_USE_NN=0 VLLM_USE_FLASH_ATTN_PA=0 vllm serve /path/to/step3 \ VLLM_USE_NN=0 VLLM_USE_FLASH_ATTN_PA=0 vllm serve /path/to/step3 \
--reasoning-parser step3 \ --reasoning-parser step3 \
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment