Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
change
sglang
Commits
fe386aca
Unverified
Commit
fe386aca
authored
May 26, 2025
by
fzyzcjy
Committed by
GitHub
May 26, 2025
Browse files
Automatically configure for EPLB-related args (#6628)
parent
14d1075f
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
21 additions
and
5 deletions
+21
-5
python/sglang/srt/server_args.py
python/sglang/srt/server_args.py
+21
-5
No files found.
python/sglang/srt/server_args.py
View file @
fe386aca
...
...
@@ -366,12 +366,28 @@ class ServerArgs:
"Pipeline parallelism is incompatible with overlap schedule."
)
if
self
.
enable_eplb
and
(
self
.
expert_distribution_recorder_mode
is
None
):
self
.
expert_distribution_recorder_mode
=
"stat"
logger
.
info
(
f
"EPLB is enabled. The expert_distribution_recorder_mode is automatically set."
)
if
(
self
.
enable_eplb
or
(
self
.
init_expert_location
is
not
None
))
and
(
self
.
ep_dispatch_algorithm
is
None
):
self
.
ep_dispatch_algorithm
=
"static"
logger
.
info
(
f
"EPLB is enabled or init_expert_location is provided. ep_dispatch_algorithm is configured."
)
if
self
.
enable_expert_distribution_metrics
and
(
self
.
expert_distribution_recorder_mode
is
None
):
self
.
expert_distribution_recorder_mode
=
"stat"
if
self
.
expert_distribution_recorder_buffer_size
is
None
:
# TODO pr-chain: enable this later
# if (x := self.eplb_rebalance_num_iterations) is not None:
# self.expert_distribution_recorder_buffer_size = x
if
False
:
pass
if
(
x
:
=
self
.
eplb_rebalance_num_iterations
)
is
not
None
:
self
.
expert_distribution_recorder_buffer_size
=
x
elif
self
.
expert_distribution_recorder_mode
is
not
None
:
self
.
expert_distribution_recorder_buffer_size
=
1000
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment