Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
dynamo
Commits
4c4130e3
"tests/vscode:/vscode.git/clone" did not exist on "e7f3361ec6e445ffd4aaceea5140b41d08dc3384"
Unverified
Commit
4c4130e3
authored
Oct 14, 2025
by
ishandhanani
Committed by
GitHub
Oct 14, 2025
Browse files
chore: typo and new commands (#3617)
parent
5744548b
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
3 additions
and
7 deletions
+3
-7
components/backends/sglang/deploy/disagg.yaml
components/backends/sglang/deploy/disagg.yaml
+1
-1
components/backends/sglang/launch/disagg_dp_attn.sh
components/backends/sglang/launch/disagg_dp_attn.sh
+2
-6
No files found.
components/backends/sglang/deploy/disagg.yaml
View file @
4c4130e3
...
...
@@ -61,7 +61,7 @@ spec:
image
:
my-registry/sglang-runtime:my-tag
workingDir
:
/workspace/components/backends/sglang
command
:
-
python3
E
-
python3
-
-m
-
dynamo.sglang
args
:
...
...
components/backends/sglang/launch/disagg_dp_attn.sh
View file @
4c4130e3
...
...
@@ -16,10 +16,6 @@ trap cleanup EXIT INT TERM
python3
-m
dynamo.frontend
--http-port
=
8000 &
DYNAMO_PID
=
$!
# Set the expert distribution recording directory
mkdir
-p
/tmp/sglang_expert_distribution_record
export
SGLANG_EXPERT_DISTRIBUTION_RECORDER_DIR
=
/tmp/sglang_expert_distribution_record
# run prefill worker
python3
-m
dynamo.sglang
\
--model-path
silence09/DeepSeek-R1-Small-2layers
\
...
...
@@ -31,7 +27,7 @@ python3 -m dynamo.sglang \
--trust-remote-code
\
--disaggregation-mode
prefill
\
--disaggregation-transfer-backend
nixl
\
--
expert-distribution-recorder-mode
stat
\
--
load-balance-method
round_robin
\
--port
30000 &
PREFILL_PID
=
$!
...
...
@@ -46,5 +42,5 @@ CUDA_VISIBLE_DEVICES=2,3 python3 -m dynamo.sglang \
--trust-remote-code
\
--disaggregation-mode
decode
\
--disaggregation-transfer-backend
nixl
\
--
expert-distribution-recorder-mode
stat
\
--
prefill-round-robin-balance
\
--port
31000
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment