Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
change
sglang
Commits
d9eb5efc
Unverified
Commit
d9eb5efc
authored
Jul 16, 2025
by
Simo Lin
Committed by
GitHub
Jul 16, 2025
Browse files
[misc] update nvshmem and pin deepEP commit hash (#8098)
parent
6dc4af49
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
6 additions
and
6 deletions
+6
-6
docker/Dockerfile
docker/Dockerfile
+6
-6
No files found.
docker/Dockerfile
View file @
d9eb5efc
...
...
@@ -2,6 +2,7 @@ ARG CUDA_VERSION=12.6.1
FROM
nvidia/cuda:${CUDA_VERSION}-cudnn-devel-ubuntu22.04
ARG
BUILD_TYPE=all
ARG
DEEPEP_COMMIT=b6ce310bb0b75079682d09bc2ebc063a074fbd58
ENV
DEBIAN_FRONTEND=noninteractive \
CUDA_HOME=/usr/local/cuda \
GDRCOPY_HOME=/usr/src/gdrdrv-2.4.4/ \
...
...
@@ -14,7 +15,7 @@ RUN echo 'tzdata tzdata/Areas select America' | debconf-set-selections \
tzdata
\
software-properties-common netcat-openbsd kmod unzip openssh-server
\
curl wget lsof zsh ccache tmux htop git-lfs tree
\
python3 python3-pip python3-dev libpython3-dev
\
python3 python3-pip python3-dev libpython3-dev
python3-venv
\
build-essential cmake
\
libopenmpi-dev libnuma1 libnuma-dev
\
libibverbs-dev libibverbs1 libibumad3
\
...
...
@@ -62,13 +63,12 @@ RUN python3 -m pip install --no-cache-dir --upgrade pip setuptools wheel html5li
fi
# Build and install NVSHMEM + DeepEP
RUN
wget https://developer.download.nvidia.com/compute/redist/nvshmem/3.
2.5
/source/nvshmem_src_
3.2.5-1.tx
z
\
RUN
wget https://developer.download.nvidia.com/compute/redist/nvshmem/3.
3.9
/source/nvshmem_src_
cuda12-all-all-3.3.9.tar.g
z
\
&&
git clone https://github.com/deepseek-ai/DeepEP.git
\
&&
tar
-xf
nvshmem_src_3.2.5-1.txz
&&
mv
nvshmem_src nvshmem
\
&&
cd
DeepEP
&&
git checkout
${
DEEPEP_COMMIT
}
&&
cd
..
\
&&
tar
-xf
nvshmem_src_cuda12-all-all-3.3.9.tar.gz
&&
mv
nvshmem_src nvshmem
\
&&
cd
nvshmem
\
&&
git apply /sgl-workspace/DeepEP/third-party/nvshmem.patch
\
&&
sed
-i
'1i#include <unistd.h>'
examples/moe_shuffle.cu
\
&&
rm
-f
/sgl-workspace/nvshmem_src_3.2.5-1.txz
\
&&
rm
-f
/sgl-workspace/nvshmem_src_cuda12-all-all-3.3.9.tar.gz
\
&&
NVSHMEM_SHMEM_SUPPORT
=
0
\
NVSHMEM_UCX_SUPPORT
=
0
\
NVSHMEM_USE_NCCL
=
0
\
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment