Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
b2d8b422
Unverified
Commit
b2d8b422
authored
Feb 28, 2026
by
Ilya Markov
Committed by
GitHub
Feb 28, 2026
Browse files
[EPLB] Enforce sync eplb for NCCL-based all2all backend (#35212)
Signed-off-by:
ilmarkov
<
markovilya197@gmail.com
>
parent
1d5ab5d6
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
11 additions
and
0 deletions
+11
-0
vllm/config/parallel.py
vllm/config/parallel.py
+11
-0
No files found.
vllm/config/parallel.py
View file @
b2d8b422
...
@@ -774,6 +774,17 @@ class ParallelConfig:
...
@@ -774,6 +774,17 @@ class ParallelConfig:
"backend is mp, uni or external_launcher."
"backend is mp, uni or external_launcher."
)
)
if
(
self
.
all2all_backend
in
(
"allgather_reducescatter"
,
"naive"
)
and
self
.
eplb_config
.
use_async
):
logger
.
warning
(
"Async EPLB causes hangs with the '%s' all2all backend. "
"Forcing synchronous EPLB."
,
self
.
all2all_backend
,
)
self
.
eplb_config
.
use_async
=
False
@
property
@
property
def
use_ray
(
self
)
->
bool
:
def
use_ray
(
self
)
->
bool
:
return
self
.
distributed_executor_backend
==
"ray"
or
(
return
self
.
distributed_executor_backend
==
"ray"
or
(
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment