Skip to content

GitLab

Unverified Commit 9b7152d7 authored by Kris Hung's avatar Kris Hung Committed by GitHub
Browse files

fix: Fix CUDA_VISIBLE_DEVICES for agg_multimodal_epd.sh (#4888)

parent c6b440e4
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
examples/backends/vllm/launch/agg_multimodal_epd.sh
View file @ 9b7152d7
...@@ -80,7 +80,7 @@ python -m dynamo.vllm --multimodal-processor --enable-multimodal --model $MODEL_ ...@@ -80,7 +80,7 @@ python -m dynamo.vllm --multimodal-processor --enable-multimodal --model $MODEL_
# run E/P/D workers # run E/P/D workers
CUDA_VISIBLE_DEVICES=0 python -m dynamo.vllm --multimodal-encode-worker --enable-multimodal --model $MODEL_NAME & CUDA_VISIBLE_DEVICES=0 python -m dynamo.vllm --multimodal-encode-worker --enable-multimodal --model $MODEL_NAME &
CUDA_VISIBLE_DEVICES=0 python -m dynamo.vllm --multimodal-worker --enable-multimodal --enable-mm-embeds --model $MODEL_NAME $EXTRA_ARGS & CUDA_VISIBLE_DEVICES=1 python -m dynamo.vllm --multimodal-worker --enable-multimodal --enable-mm-embeds --model $MODEL_NAME $EXTRA_ARGS &
# Wait for all background processes to complete # Wait for all background processes to complete
wait wait
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment