Skip to content

GitLab

"csrc/vscode:/vscode.git/clone" did not exist on "70506d98a3e1df3ded5db7f99ae11896cebc622d"
Unverified Commit 9b7152d7 authored by Kris Hung's avatar Kris Hung Committed by GitHub
Browse files

fix: Fix CUDA_VISIBLE_DEVICES for agg_multimodal_epd.sh (#4888)

parent c6b440e4
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
examples/backends/vllm/launch/agg_multimodal_epd.sh
View file @ 9b7152d7
......@@ -80,7 +80,7 @@ python -m dynamo.vllm --multimodal-processor --enable-multimodal --model $MODEL_
# run E/P/D workers
CUDA_VISIBLE_DEVICES=0 python -m dynamo.vllm --multimodal-encode-worker --enable-multimodal --model $MODEL_NAME &
CUDA_VISIBLE_DEVICES=0 python -m dynamo.vllm --multimodal-worker --enable-multimodal --enable-mm-embeds --model $MODEL_NAME $EXTRA_ARGS &
CUDA_VISIBLE_DEVICES=1 python -m dynamo.vllm --multimodal-worker --enable-multimodal --enable-mm-embeds --model $MODEL_NAME $EXTRA_ARGS &
# Wait for all background processes to complete
wait
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment