Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
dynamo
Commits
243d7f07
Unverified
Commit
243d7f07
authored
Apr 15, 2026
by
Keiven C
Committed by
GitHub
Apr 15, 2026
Browse files
fix(container): align sglang nixl_ref with PyPI nixl-cu12 1.0.x (#8205)
Signed-off-by:
Keiven Chang
<
keivenc@nvidia.com
>
parent
2541b97f
Changes
3
Hide whitespace changes
Inline
Side-by-side
Showing
3 changed files
with
16 additions
and
4 deletions
+16
-4
container/context.yaml
container/context.yaml
+1
-1
container/templates/wheel_builder.Dockerfile
container/templates/wheel_builder.Dockerfile
+14
-2
pyproject.toml
pyproject.toml
+1
-1
No files found.
container/context.yaml
View file @
243d7f07
...
@@ -85,7 +85,7 @@ sglang:
...
@@ -85,7 +85,7 @@ sglang:
runtime_image
:
lmsysorg/sglang
runtime_image
:
lmsysorg/sglang
base_image_tag
:
25.11-cuda13.0-devel-ubuntu24.04
base_image_tag
:
25.11-cuda13.0-devel-ubuntu24.04
runtime_image_tag
:
v0.5.10.post1-cu130-runtime
runtime_image_tag
:
v0.5.10.post1-cu130-runtime
nixl_ref
:
0.1
0.0
nixl_ref
:
v1.
0.1
enable_media_ffmpeg
:
"
true"
enable_media_ffmpeg
:
"
true"
enable_gpu_memory_service
:
"
true"
enable_gpu_memory_service
:
"
true"
enable_kvbm
:
"
false"
enable_kvbm
:
"
false"
...
...
container/templates/wheel_builder.Dockerfile
View file @
243d7f07
...
@@ -152,13 +152,25 @@ RUN --mount=type=cache,target=/var/cache/dnf,sharing=locked \
...
@@ -152,13 +152,25 @@ RUN --mount=type=cache,target=/var/cache/dnf,sharing=locked \
librdmacm-devel \
librdmacm-devel \
numactl-devel \
numactl-devel \
# Libfabric support
# Libfabric support
hwloc \
hwloc-devel \
libcurl-devel \
libcurl-devel \
openssl-devel \
openssl-devel \
libuuid-devel \
libuuid-devel \
zlib-devel
zlib-devel
# Build hwloc >= 2.3 from source (RHEL8 ships 2.2 which lacks hwloc_location API
# required by nixl v1.0.x libfabric topology code)
ARG
HWLOC_VERSION=2.12.0
RUN
HWLOC_SERIES
=
"
$(
echo
"
${
HWLOC_VERSION
}
"
|
cut
-d
.
-f1-2
)
"
&&
\
cd
/tmp
&&
\
curl
--retry
3
-LO
"https://download.open-mpi.org/release/hwloc/v
${
HWLOC_SERIES
}
/hwloc-
${
HWLOC_VERSION
}
.tar.gz"
&&
\
tar
xf hwloc-
${
HWLOC_VERSION
}
.tar.gz
&&
\
cd
hwloc-
${
HWLOC_VERSION
}
&&
\
./configure
--prefix
=
/usr/local
&&
\
make
-j
$(
nproc
)
&&
\
make
install
&&
\
ldconfig
&&
\
rm
-rf
/tmp/hwloc-
*
# Set GCC toolset 14 as the default compiler (CUDA requires GCC <= 14)
# Set GCC toolset 14 as the default compiler (CUDA requires GCC <= 14)
ENV
PATH="/opt/rh/gcc-toolset-14/root/usr/bin:${PATH}" \
ENV
PATH="/opt/rh/gcc-toolset-14/root/usr/bin:${PATH}" \
LD_LIBRARY_PATH="/opt/rh/gcc-toolset-14/root/usr/lib64:${LD_LIBRARY_PATH}" \
LD_LIBRARY_PATH="/opt/rh/gcc-toolset-14/root/usr/lib64:${LD_LIBRARY_PATH}" \
...
...
pyproject.toml
View file @
243d7f07
...
@@ -63,7 +63,7 @@ vllm = [
...
@@ -63,7 +63,7 @@ vllm = [
sglang
=
[
sglang
=
[
"uvloop"
,
"uvloop"
,
"sglang[diffusion]==0.5.10.post1"
,
"sglang[diffusion]==0.5.10.post1"
,
"nixl[cu12]
<=0.10.1
"
,
"nixl[cu12]
>=1.0.0,<1.1.0
"
,
"cupy-cuda12x>=13.0.0"
,
"cupy-cuda12x>=13.0.0"
,
]
]
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment