Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
dynamo
Commits
b8474e54
Unverified
Commit
b8474e54
authored
Jul 17, 2025
by
ishandhanani
Committed by
GitHub
Jul 17, 2025
Browse files
chore: update cmake and gap installation and sgl in wideep container (#1991)
parent
157a3b05
Changes
2
Show whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
18 additions
and
12 deletions
+18
-12
container/Dockerfile.sglang-wideep
container/Dockerfile.sglang-wideep
+17
-11
examples/sglang/docs/dsr1-wideep-h100.md
examples/sglang/docs/dsr1-wideep-h100.md
+1
-1
No files found.
container/Dockerfile.sglang-wideep
View file @
b8474e54
...
...
@@ -71,20 +71,11 @@ RUN rm -rf /opt/hpcx/ucx && \
ENV LD_LIBRARY_PATH=/usr/lib:/usr/local/ucx/lib:$LD_LIBRARY_PATH
# Pinning to NIXL 0.2.1 right now
# There is a fix that was merged into SGLang after 0.4.8.post1
# TODO: Investigate perf hit of that change before we bump to up to date NIXL
ARG NIXL_COMMIT="5e4c179ee850d482a83cb2a211e0947e46281060"
RUN git clone https://github.com/ai-dynamo/nixl.git && cd nixl && git checkout ${NIXL_COMMIT} && pip install --break-system-packages . --config-settings=setup-args="-Ducx_path=/usr/local/ucx"
ARG NIXL_TAG=0.3.1
RUN git clone https://github.com/ai-dynamo/nixl.git && cd nixl && git checkout ${NIXL_TAG} && pip install --break-system-packages . --config-settings=setup-args="-Ducx_path=/usr/local/ucx"
WORKDIR /sgl-workspace
RUN pip uninstall --break-system-packages -y sglang
RUN rm -rf sglang
# Pinning to 0.4.8.post1 for now which solves a TBO issue
# https://github.com/sgl-project/sglang/issues/7511
RUN pip install --break-system-packages "sglang==0.4.8.post1"
# Allow forceful shutdown of inflight requests
ENV SGL_FORCE_SHUTDOWN=1
...
...
@@ -149,6 +140,21 @@ RUN wget --tries=3 --waitretry=5 https://github.com/etcd-io/etcd/releases/downlo
rm /tmp/etcd.tar.gz
ENV PATH=/usr/local/bin/etcd/:$PATH
ARG CMAKE_VERSION=3.31.8
RUN mkdir /sgl-workspace/cmake_build
WORKDIR /sgl-workspace/cmake_build
# uninstall CMake
RUN apt-get purge -y cmake
# download newer version of CMake
RUN wget https://github.com/Kitware/CMake/releases/download/v${CMAKE_VERSION}/cmake-${CMAKE_VERSION}-linux-$(uname -m).tar.gz && \
tar -xvzf cmake-${CMAKE_VERSION}-linux-$(uname -m).tar.gz && \
mv cmake-${CMAKE_VERSION}-linux-$(uname -m) custom_cmake
ENV PATH=/sgl-workspace/cmake_build/custom_cmake/bin:$PATH
# should be 3.31.8
RUN cmake --version
# Install perf_analyzer and genai-perf
RUN apt-get update -y && \
apt-get install -y --no-install-recommends \
...
...
examples/sglang/docs/dsr1-wideep-h100.md
View file @
b8474e54
...
...
@@ -24,7 +24,7 @@ Dynamo supports SGLang's implementation of wide expert parallelism and large sca
1.
Build the SGLang DeepEP container.
```
bash
git clone
-b
v0.4.
8
.post
1
https://github.com/sgl-project/sglang.git
git clone
-b
v0.4.
9
.post
2
https://github.com/sgl-project/sglang.git
cd
sglang/docker
docker build
-f
Dockerfile
-t
sgl-widepep .
```
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment