Skip to content

GitLab

Unverified Commit 561f38dc authored by Tyler Michael Smith's avatar Tyler Michael Smith Committed by GitHub
Browse files

[Bugfix] Improve EPLB config validation error message (#24524) 


Signed-off-by: default avatarTyler Michael Smith <tyler@neuralmagic.com>
parent 73e688cb
Hide whitespace changes
Inline Side-by-side
Showing with 4 additions and 2 deletions
vllm/config/parallel.py
View file @ 561f38dc
...@@ -368,8 +368,10 @@ class ParallelConfig: ...@@ -368,8 +368,10 @@ class ParallelConfig:
else: else:
if self.eplb_config.num_redundant_experts != 0: if self.eplb_config.num_redundant_experts != 0:
raise ValueError( raise ValueError(
"num_redundant_experts should be used with EPLB." "num_redundant_experts is set to "
f"{self.eplb_config.num_redundant_experts}.") f"{self.eplb_config.num_redundant_experts} but EPLB is not "
"enabled. Either enable EPLB or unset "
"num_redundant_experts.")
if self.distributed_executor_backend is None and self.world_size > 1: if self.distributed_executor_backend is None and self.world_size > 1:
# We use multiprocessing by default if world_size fits on the # We use multiprocessing by default if world_size fits on the
# current node and we aren't in a ray placement group. # current node and we aren't in a ray placement group.
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment