Skip to content

GitLab

Unverified Commit 01fbb11b authored by Yineng Zhang's avatar Yineng Zhang Committed by GitHub
Browse files

docs: fix typo (#742)

parent 05d216da
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
README.md
View file @ 01fbb11b
...@@ -160,7 +160,7 @@ python -m sglang.launch_server --model-path meta-llama/Meta-Llama-3-8B-Instruct ...@@ -160,7 +160,7 @@ python -m sglang.launch_server --model-path meta-llama/Meta-Llama-3-8B-Instruct
```bash ```bash
# 2 nodes run 405B fp16 # 2 nodes run 405B fp16
# replace the `172.16.4.52:20000` with your own first node ip address and port, disable CUDA Grpah temporarily # replace the `172.16.4.52:20000` with your own first node ip address and port, disable CUDA Graph temporarily
# on the first node # on the first node
GLOO_SOCKET_IFNAME=eth0 python3 -m sglang.launch_server --model-path meta-llama/Meta-Llama-3.1-405B-Instruct --tp 16 --nccl-init-addr 172.16.4.52:20000 --nnodes 2 --node-rank 0 --disable-cuda-graph --mem-frac 0.75 GLOO_SOCKET_IFNAME=eth0 python3 -m sglang.launch_server --model-path meta-llama/Meta-Llama-3.1-405B-Instruct --tp 16 --nccl-init-addr 172.16.4.52:20000 --nnodes 2 --node-rank 0 --disable-cuda-graph --mem-frac 0.75
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment