Skip to content

GitLab

Unverified Commit da0c0260 authored by fzyzcjy's avatar fzyzcjy Committed by GitHub
Browse files

Tiny assert EPLB is used together with expert parallel (#8381)

parent 3212c2ad
Hide whitespace changes
Inline Side-by-side
Showing with 3 additions and 0 deletions
python/sglang/srt/server_args.py
View file @ da0c0260
...@@ -458,6 +458,9 @@ class ServerArgs: ...@@ -458,6 +458,9 @@ class ServerArgs:
"EPLB is enabled or init_expert_location is provided. ep_dispatch_algorithm is configured." "EPLB is enabled or init_expert_location is provided. ep_dispatch_algorithm is configured."
) )
if self.enable_eplb:
assert self.enable_ep_moe or self.enable_deepep_moe
if self.enable_expert_distribution_metrics and ( if self.enable_expert_distribution_metrics and (
self.expert_distribution_recorder_mode is None self.expert_distribution_recorder_mode is None
): ):
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment