Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
dynamo
Commits
4c4130e3
Unverified
Commit
4c4130e3
authored
Oct 14, 2025
by
ishandhanani
Committed by
GitHub
Oct 14, 2025
Browse files
chore: typo and new commands (#3617)
parent
5744548b
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
3 additions
and
7 deletions
+3
-7
components/backends/sglang/deploy/disagg.yaml
components/backends/sglang/deploy/disagg.yaml
+1
-1
components/backends/sglang/launch/disagg_dp_attn.sh
components/backends/sglang/launch/disagg_dp_attn.sh
+2
-6
No files found.
components/backends/sglang/deploy/disagg.yaml
View file @
4c4130e3
...
@@ -61,7 +61,7 @@ spec:
...
@@ -61,7 +61,7 @@ spec:
image
:
my-registry/sglang-runtime:my-tag
image
:
my-registry/sglang-runtime:my-tag
workingDir
:
/workspace/components/backends/sglang
workingDir
:
/workspace/components/backends/sglang
command
:
command
:
-
python3
E
-
python3
-
-m
-
-m
-
dynamo.sglang
-
dynamo.sglang
args
:
args
:
...
...
components/backends/sglang/launch/disagg_dp_attn.sh
View file @
4c4130e3
...
@@ -16,10 +16,6 @@ trap cleanup EXIT INT TERM
...
@@ -16,10 +16,6 @@ trap cleanup EXIT INT TERM
python3
-m
dynamo.frontend
--http-port
=
8000 &
python3
-m
dynamo.frontend
--http-port
=
8000 &
DYNAMO_PID
=
$!
DYNAMO_PID
=
$!
# Set the expert distribution recording directory
mkdir
-p
/tmp/sglang_expert_distribution_record
export
SGLANG_EXPERT_DISTRIBUTION_RECORDER_DIR
=
/tmp/sglang_expert_distribution_record
# run prefill worker
# run prefill worker
python3
-m
dynamo.sglang
\
python3
-m
dynamo.sglang
\
--model-path
silence09/DeepSeek-R1-Small-2layers
\
--model-path
silence09/DeepSeek-R1-Small-2layers
\
...
@@ -31,7 +27,7 @@ python3 -m dynamo.sglang \
...
@@ -31,7 +27,7 @@ python3 -m dynamo.sglang \
--trust-remote-code
\
--trust-remote-code
\
--disaggregation-mode
prefill
\
--disaggregation-mode
prefill
\
--disaggregation-transfer-backend
nixl
\
--disaggregation-transfer-backend
nixl
\
--
expert-distribution-recorder-mode
stat
\
--
load-balance-method
round_robin
\
--port
30000 &
--port
30000 &
PREFILL_PID
=
$!
PREFILL_PID
=
$!
...
@@ -46,5 +42,5 @@ CUDA_VISIBLE_DEVICES=2,3 python3 -m dynamo.sglang \
...
@@ -46,5 +42,5 @@ CUDA_VISIBLE_DEVICES=2,3 python3 -m dynamo.sglang \
--trust-remote-code
\
--trust-remote-code
\
--disaggregation-mode
decode
\
--disaggregation-mode
decode
\
--disaggregation-transfer-backend
nixl
\
--disaggregation-transfer-backend
nixl
\
--
expert-distribution-recorder-mode
stat
\
--
prefill-round-robin-balance
\
--port
31000
--port
31000
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment