Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
dynamo
Commits
b8474e54
"vscode:/vscode.git/clone" did not exist on "4e6493aefbd787d358ddba4ca83277348f2fb139"
Unverified
Commit
b8474e54
authored
Jul 17, 2025
by
ishandhanani
Committed by
GitHub
Jul 17, 2025
Browse files
chore: update cmake and gap installation and sgl in wideep container (#1991)
parent
157a3b05
Changes
2
Show whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
18 additions
and
12 deletions
+18
-12
container/Dockerfile.sglang-wideep
container/Dockerfile.sglang-wideep
+17
-11
examples/sglang/docs/dsr1-wideep-h100.md
examples/sglang/docs/dsr1-wideep-h100.md
+1
-1
No files found.
container/Dockerfile.sglang-wideep
View file @
b8474e54
...
...
@@ -71,20 +71,11 @@ RUN rm -rf /opt/hpcx/ucx && \
ENV LD_LIBRARY_PATH=/usr/lib:/usr/local/ucx/lib:$LD_LIBRARY_PATH
# Pinning to NIXL 0.2.1 right now
# There is a fix that was merged into SGLang after 0.4.8.post1
# TODO: Investigate perf hit of that change before we bump to up to date NIXL
ARG NIXL_COMMIT="5e4c179ee850d482a83cb2a211e0947e46281060"
RUN git clone https://github.com/ai-dynamo/nixl.git && cd nixl && git checkout ${NIXL_COMMIT} && pip install --break-system-packages . --config-settings=setup-args="-Ducx_path=/usr/local/ucx"
ARG NIXL_TAG=0.3.1
RUN git clone https://github.com/ai-dynamo/nixl.git && cd nixl && git checkout ${NIXL_TAG} && pip install --break-system-packages . --config-settings=setup-args="-Ducx_path=/usr/local/ucx"
WORKDIR /sgl-workspace
RUN pip uninstall --break-system-packages -y sglang
RUN rm -rf sglang
# Pinning to 0.4.8.post1 for now which solves a TBO issue
# https://github.com/sgl-project/sglang/issues/7511
RUN pip install --break-system-packages "sglang==0.4.8.post1"
# Allow forceful shutdown of inflight requests
ENV SGL_FORCE_SHUTDOWN=1
...
...
@@ -149,6 +140,21 @@ RUN wget --tries=3 --waitretry=5 https://github.com/etcd-io/etcd/releases/downlo
rm /tmp/etcd.tar.gz
ENV PATH=/usr/local/bin/etcd/:$PATH
ARG CMAKE_VERSION=3.31.8
RUN mkdir /sgl-workspace/cmake_build
WORKDIR /sgl-workspace/cmake_build
# uninstall CMake
RUN apt-get purge -y cmake
# download newer version of CMake
RUN wget https://github.com/Kitware/CMake/releases/download/v${CMAKE_VERSION}/cmake-${CMAKE_VERSION}-linux-$(uname -m).tar.gz && \
tar -xvzf cmake-${CMAKE_VERSION}-linux-$(uname -m).tar.gz && \
mv cmake-${CMAKE_VERSION}-linux-$(uname -m) custom_cmake
ENV PATH=/sgl-workspace/cmake_build/custom_cmake/bin:$PATH
# should be 3.31.8
RUN cmake --version
# Install perf_analyzer and genai-perf
RUN apt-get update -y && \
apt-get install -y --no-install-recommends \
...
...
examples/sglang/docs/dsr1-wideep-h100.md
View file @
b8474e54
...
...
@@ -24,7 +24,7 @@ Dynamo supports SGLang's implementation of wide expert parallelism and large sca
1.
Build the SGLang DeepEP container.
```
bash
git clone
-b
v0.4.
8
.post
1
https://github.com/sgl-project/sglang.git
git clone
-b
v0.4.
9
.post
2
https://github.com/sgl-project/sglang.git
cd
sglang/docker
docker build
-f
Dockerfile
-t
sgl-widepep .
```
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment