Skip to content

GitLab

Unverified Commit 736502d4 authored by fzyzcjy's avatar fzyzcjy Committed by GitHub
Browse files

Tiny fix doc error (#4795)

parent 8690c40b
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 3 deletions
docs/references/multi_node.md
View file @ 736502d4
...@@ -9,9 +9,7 @@ ...@@ -9,9 +9,7 @@
python3 -m sglang.launch_server --model-path meta-llama/Meta-Llama-3.1-405B-Instruct --tp 16 --dist-init-addr 172.16.4.52:20000 --nnodes 2 --node-rank 0 python3 -m sglang.launch_server --model-path meta-llama/Meta-Llama-3.1-405B-Instruct --tp 16 --dist-init-addr 172.16.4.52:20000 --nnodes 2 --node-rank 0
# replace 172.18.45.52:20000 with your own node ip address and port of the second node python3 -m sglang.launch_server --model-path meta-llama/Meta-Llama-3.1-405B-Instruct --tp 16 --dist-init-addr 172.16.4.52:20000 --nnodes 2 --node-rank 1
python3 -m sglang.launch_server --model-path meta-llama/Meta-Llama-3.1-405B-Instruct --tp 16 --dist-init-addr 172.18.45.52:20000 --nnodes 2 --node-rank 1
``` ```
Note that LLama 405B (fp8) can also be launched on a single node. Note that LLama 405B (fp8) can also be launched on a single node.
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment