Unverified Commit df40d2ca authored by ZichengMa's avatar ZichengMa Committed by GitHub
Browse files

docs: fix typo and add mount-workspace to vllm doc (#1931)


Signed-off-by: default avatarZichengMa <zichengma1225@gmail.com>
Co-authored-by: default avatarAlec <35311602+alec-flowers@users.noreply.github.com>
parent 901715b5
...@@ -40,7 +40,7 @@ docker compose -f deploy/metrics/docker-compose.yml up -d ...@@ -40,7 +40,7 @@ docker compose -f deploy/metrics/docker-compose.yml up -d
``` ```
```bash ```bash
./container/run.sh -it --framework VLLM_V1 ./container/run.sh -it --framework VLLM_V1 [--mount-workspace]
``` ```
This includes the specific commit [vllm-project/vllm#19790](https://github.com/vllm-project/vllm/pull/19790) which enables support for external control of the DP ranks. This includes the specific commit [vllm-project/vllm#19790](https://github.com/vllm-project/vllm/pull/19790) which enables support for external control of the DP ranks.
...@@ -74,7 +74,7 @@ Note: The above architecture illustrates all the components. The final component ...@@ -74,7 +74,7 @@ Note: The above architecture illustrates all the components. The final component
```bash ```bash
# requires one gpu # requires one gpu
cd examples/vllm_v1 cd examples/vllm
bash launch/agg.sh bash launch/agg.sh
``` ```
...@@ -82,7 +82,7 @@ bash launch/agg.sh ...@@ -82,7 +82,7 @@ bash launch/agg.sh
```bash ```bash
# requires two gpus # requires two gpus
cd examples/vllm_v1 cd examples/vllm
bash launch/agg_router.sh bash launch/agg_router.sh
``` ```
...@@ -90,7 +90,7 @@ bash launch/agg_router.sh ...@@ -90,7 +90,7 @@ bash launch/agg_router.sh
```bash ```bash
# requires two gpus # requires two gpus
cd examples/vllm_v1 cd examples/vllm
bash launch/disagg.sh bash launch/disagg.sh
``` ```
...@@ -98,7 +98,7 @@ bash launch/disagg.sh ...@@ -98,7 +98,7 @@ bash launch/disagg.sh
```bash ```bash
# requires three gpus # requires three gpus
cd examples/vllm_v1 cd examples/vllm
bash launch/disagg_router.sh bash launch/disagg_router.sh
``` ```
...@@ -108,7 +108,7 @@ This example is not meant to be performant but showcases dynamo routing to data ...@@ -108,7 +108,7 @@ This example is not meant to be performant but showcases dynamo routing to data
```bash ```bash
# requires four gpus # requires four gpus
cd examples/vllm_v1 cd examples/vllm
bash launch/dep.sh bash launch/dep.sh
``` ```
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment