Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
dynamo
Commits
47c3dad7
Unverified
Commit
47c3dad7
authored
Jun 09, 2025
by
ishandhanani
Committed by
GitHub
Jun 09, 2025
Browse files
chore(sglang): support dp attention routing (#1415)
parent
d83633b5
Changes
2
Show whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
3 additions
and
3 deletions
+3
-3
container/Dockerfile.sglang
container/Dockerfile.sglang
+2
-3
examples/sglang/utils/protocol.py
examples/sglang/utils/protocol.py
+1
-0
No files found.
container/Dockerfile.sglang
View file @
47c3dad7
...
...
@@ -135,9 +135,8 @@ RUN if [ "$ARCH" = "arm64" ]; then \
# Install sglang
# Once either 0.4.6post6 or 0.4.7 is released, we can switch back to using the published version
# This commit references multiple perf fixes for DP attention and NIXL https://github.com/sgl-project/sglang/pull/6780
# 6/2(ishan) - moving to ToT for performance purposes
ARG SGLANG_COMMIT="6376b632eb4daef306b89ede0eabdcb89ddff728"
# This commit references a fix to add DP attention based routing along with other perf fixes https://github.com/sgl-project/sglang/pull/6884
ARG SGLANG_COMMIT="f1569876d54dd3b6601f5280f12652e9fbb1375c"
RUN --mount=type=cache,target=/root/.cache/uv \
git clone https://github.com/sgl-project/sglang.git && \
cd sglang && \
...
...
examples/sglang/utils/protocol.py
View file @
47c3dad7
...
...
@@ -60,3 +60,4 @@ class DisaggPreprocessedRequest(BaseModel):
bootstrap_host
:
str
bootstrap_port
:
int
bootstrap_room
:
int
data_parallel_rank
:
Optional
[
int
]
=
None
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment