Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
dynamo
Commits
bd3554ef
Unverified
Commit
bd3554ef
authored
Mar 19, 2026
by
jh-nv
Committed by
GitHub
Mar 19, 2026
Browse files
fix: update vllm script to install otel packages (#7531)
parent
2712426f
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
3 additions
and
3 deletions
+3
-3
container/deps/vllm/install_vllm.sh
container/deps/vllm/install_vllm.sh
+3
-3
No files found.
container/deps/vllm/install_vllm.sh
View file @
bd3554ef
...
...
@@ -172,19 +172,19 @@ if [ "$DEVICE" = "cuda" ]; then
# does not prevent uv from resolving the cu12 variant)
echo
"Installing vLLM
$VLLM_VER
(torch backend:
$TORCH_BACKEND
)..."
if
[[
"
$CUDA_VERSION_MAJOR
"
==
"12"
]]
;
then
if
uv pip
install
"vllm[flashinfer,runai]==
${
VLLM_VER
}
"
${
EXTRA_PIP_ARGS
}
--torch-backend
=
${
TORCH_BACKEND
}
2>&1
;
then
if
uv pip
install
"vllm[flashinfer,runai
,otel
]==
${
VLLM_VER
}
"
${
EXTRA_PIP_ARGS
}
--torch-backend
=
${
TORCH_BACKEND
}
2>&1
;
then
echo
"✓ vLLM
${
VLLM_VER
}
installed from PyPI"
else
echo
"⚠ PyPI install failed, installing from GitHub release..."
uv pip
install
${
EXTRA_PIP_ARGS
}
\
"
${
VLLM_GITHUB_URL
}
[flashinfer,runai]"
\
"
${
VLLM_GITHUB_URL
}
[flashinfer,runai
,otel
]"
\
--torch-backend
=
${
TORCH_BACKEND
}
echo
"✓ vLLM
${
VLLM_VER
}
installed from GitHub"
fi
else
echo
"Installing vLLM from GitHub release (cu130 wheel not available on PyPI)..."
uv pip
install
${
EXTRA_PIP_ARGS
}
\
"
${
VLLM_GITHUB_URL
}
[flashinfer,runai]"
\
"
${
VLLM_GITHUB_URL
}
[flashinfer,runai
,otel
]"
\
--torch-backend
=
${
TORCH_BACKEND
}
echo
"✓ vLLM
${
VLLM_VER
}
installed from GitHub"
fi
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment