"src/libtorchaudio/sox/pybind/pybind.cpp" did not exist on "41c76a17c7a191752eada5346dc88ecfe690dcae"
Unverified Commit 92bb64bc authored by Michael Yao's avatar Michael Yao Committed by GitHub
Browse files

[Doc] Fix a 404 link to llama-405b (#5615)


Signed-off-by: default avatarwindsonsea <haifeng.yao@daocloud.io>
parent 11b23ae9
...@@ -127,7 +127,7 @@ Please consult the documentation below to learn more about the parameters you ma ...@@ -127,7 +127,7 @@ Please consult the documentation below to learn more about the parameters you ma
## Multi-node distributed serving ## Multi-node distributed serving
* `dist_init_addr`: The TCP address used for initializing PyTorch's distributed backend (e.g. `192.168.0.2:25000`). * `dist_init_addr`: The TCP address used for initializing PyTorch's distributed backend (e.g. `192.168.0.2:25000`).
* `nnodes`: Total number of nodes in the cluster. Refer to how to run the [Llama 405B model](https://docs.sglang.ai/references/llama_405B.html#run-405b-fp16-on-two-nodes). * `nnodes`: Total number of nodes in the cluster. Refer to how to run the [Llama 405B model](https://docs.sglang.ai/references/multi_node.html#llama-3-1-405b).
* `node_rank`: Rank (ID) of this node among the `nnodes` in the distributed setup. * `node_rank`: Rank (ID) of this node among the `nnodes` in the distributed setup.
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment