"vllm/vscode:/vscode.git/clone" did not exist on "685c99ee77b4818dcdd15b30fe0e0eff0d5d22ec"
Unverified Commit a7272c23 authored by Ricardo Decal's avatar Ricardo Decal Committed by GitHub
Browse files

[Docs][minor] Fix broken gh-file link in distributed serving docs (#21543)


Signed-off-by: default avatarRicardo Decal <rdecal@anyscale.com>
parent 60662849
...@@ -62,7 +62,7 @@ If a single node lacks sufficient GPUs to hold the model, deploy vLLM across mul ...@@ -62,7 +62,7 @@ If a single node lacks sufficient GPUs to hold the model, deploy vLLM across mul
### Ray cluster setup with containers ### Ray cluster setup with containers
The helper script `<gh-file:examples/online_serving/run_cluster.sh>` starts containers across nodes and initializes Ray. By default, the script runs Docker without administrative privileges, which prevents access to the GPU performance counters when profiling or tracing. To enable admin privileges, add the `--cap-add=CAP_SYS_ADMIN` flag to the Docker command. The helper script <gh-file:examples/online_serving/run_cluster.sh> starts containers across nodes and initializes Ray. By default, the script runs Docker without administrative privileges, which prevents access to the GPU performance counters when profiling or tracing. To enable admin privileges, add the `--cap-add=CAP_SYS_ADMIN` flag to the Docker command.
Choose one node as the head node and run: Choose one node as the head node and run:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment