Unverified Commit 71950af7 authored by youkaichao's avatar youkaichao Committed by GitHub
Browse files

[doc][distributed] fix doc argument order (#6691)

parent cb1362a8
...@@ -66,8 +66,8 @@ Pick a node as the head node, and run the following command: ...@@ -66,8 +66,8 @@ Pick a node as the head node, and run the following command:
$ bash run_cluster.sh \ $ bash run_cluster.sh \
$ vllm/vllm-openai \ $ vllm/vllm-openai \
$ ip_of_head_node \ $ ip_of_head_node \
$ /path/to/the/huggingface/home/in/this/node \ $ --head \
$ --head $ /path/to/the/huggingface/home/in/this/node
On the rest of the worker nodes, run the following command: On the rest of the worker nodes, run the following command:
...@@ -76,8 +76,8 @@ On the rest of the worker nodes, run the following command: ...@@ -76,8 +76,8 @@ On the rest of the worker nodes, run the following command:
$ bash run_cluster.sh \ $ bash run_cluster.sh \
$ vllm/vllm-openai \ $ vllm/vllm-openai \
$ ip_of_head_node \ $ ip_of_head_node \
$ /path/to/the/huggingface/home/in/this/node \ $ --worker \
$ --worker $ /path/to/the/huggingface/home/in/this/node
Then you get a ray cluster of containers. Note that you need to keep the shells running these commands alive to hold the cluster. Any shell disconnect will terminate the cluster. Then you get a ray cluster of containers. Note that you need to keep the shells running these commands alive to hold the cluster. Any shell disconnect will terminate the cluster.
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment