Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
3779eb8c
Unverified
Commit
3779eb8c
authored
Jul 22, 2025
by
rongfu.leng
Committed by
GitHub
Jul 21, 2025
Browse files
[Feature][eplb] add verify ep or tp or dp (#21102)
Signed-off-by:
rongfu.leng
<
rongfu.leng@daocloud.io
>
parent
9e23ad96
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
9 additions
and
0 deletions
+9
-0
vllm/config.py
vllm/config.py
+9
-0
No files found.
vllm/config.py
View file @
3779eb8c
...
@@ -2108,6 +2108,15 @@ class ParallelConfig:
...
@@ -2108,6 +2108,15 @@ class ParallelConfig:
raise
ValueError
(
raise
ValueError
(
"num_redundant_experts must be non-negative, but got "
"num_redundant_experts must be non-negative, but got "
f
"
{
self
.
num_redundant_experts
}
."
)
f
"
{
self
.
num_redundant_experts
}
."
)
if
not
self
.
enable_expert_parallel
:
raise
ValueError
(
"enable_expert_parallel must be True to use EPLB."
)
if
self
.
tensor_parallel_size
*
self
.
data_parallel_size
<=
1
:
raise
ValueError
(
"EPLB requires tensor_parallel_size or data_parallel_size "
f
"to be greater than 1, but got "
f
"TP=
{
self
.
tensor_parallel_size
}
,DP=
{
self
.
data_parallel_size
}
."
)
else
:
else
:
if
self
.
num_redundant_experts
!=
0
:
if
self
.
num_redundant_experts
!=
0
:
raise
ValueError
(
raise
ValueError
(
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment