Unverified Commit df40d2ca authored by ZichengMa's avatar ZichengMa Committed by GitHub
Browse files

docs: fix typo and add mount-workspace to vllm doc (#1931)


Signed-off-by: default avatarZichengMa <zichengma1225@gmail.com>
Co-authored-by: default avatarAlec <35311602+alec-flowers@users.noreply.github.com>
parent 901715b5
......@@ -40,7 +40,7 @@ docker compose -f deploy/metrics/docker-compose.yml up -d
```
```bash
./container/run.sh -it --framework VLLM_V1
./container/run.sh -it --framework VLLM_V1 [--mount-workspace]
```
This includes the specific commit [vllm-project/vllm#19790](https://github.com/vllm-project/vllm/pull/19790) which enables support for external control of the DP ranks.
......@@ -74,7 +74,7 @@ Note: The above architecture illustrates all the components. The final component
```bash
# requires one gpu
cd examples/vllm_v1
cd examples/vllm
bash launch/agg.sh
```
......@@ -82,7 +82,7 @@ bash launch/agg.sh
```bash
# requires two gpus
cd examples/vllm_v1
cd examples/vllm
bash launch/agg_router.sh
```
......@@ -90,7 +90,7 @@ bash launch/agg_router.sh
```bash
# requires two gpus
cd examples/vllm_v1
cd examples/vllm
bash launch/disagg.sh
```
......@@ -98,7 +98,7 @@ bash launch/disagg.sh
```bash
# requires three gpus
cd examples/vllm_v1
cd examples/vllm
bash launch/disagg_router.sh
```
......@@ -108,7 +108,7 @@ This example is not meant to be performant but showcases dynamo routing to data
```bash
# requires four gpus
cd examples/vllm_v1
cd examples/vllm
bash launch/dep.sh
```
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment