Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
0788ff0a
Unverified
Commit
0788ff0a
authored
Feb 25, 2026
by
haosdent
Committed by
GitHub
Feb 25, 2026
Browse files
[Bugfix] Gracefully disable AllReduceFusionPass on GPUs without multicast support (#35085)
Signed-off-by:
haosdent
<
haosdent@gmail.com
>
parent
d72b0be3
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
20 additions
and
8 deletions
+20
-8
vllm/compilation/passes/fusion/allreduce_rms_fusion.py
vllm/compilation/passes/fusion/allreduce_rms_fusion.py
+20
-8
No files found.
vllm/compilation/passes/fusion/allreduce_rms_fusion.py
View file @
0788ff0a
...
@@ -729,6 +729,7 @@ class AllReduceFusionPass(VllmPatternMatcherPass):
...
@@ -729,6 +729,7 @@ class AllReduceFusionPass(VllmPatternMatcherPass):
scope
=
"global"
,
scope
=
"global"
,
)
)
try
:
self
.
workspace
=
flashinfer_comm
.
create_allreduce_fusion_workspace
(
self
.
workspace
=
flashinfer_comm
.
create_allreduce_fusion_workspace
(
backend
=
"trtllm"
,
backend
=
"trtllm"
,
world_size
=
self
.
tp_size
,
world_size
=
self
.
tp_size
,
...
@@ -737,6 +738,17 @@ class AllReduceFusionPass(VllmPatternMatcherPass):
...
@@ -737,6 +738,17 @@ class AllReduceFusionPass(VllmPatternMatcherPass):
hidden_dim
=
self
.
hidden_dim
,
hidden_dim
=
self
.
hidden_dim
,
dtype
=
self
.
model_dtype
,
dtype
=
self
.
model_dtype
,
)
)
except
RuntimeError
as
e
:
if
"multicast"
not
in
str
(
e
).
lower
():
raise
logger
.
warning_once
(
"AllReduce fusion pass is disabled: flashinfer workspace "
"creation failed: %s. This is expected on GPUs without "
"NVSwitch (e.g., NVLink bridge-only or PCIe topologies). "
"Falling back to non-fused allreduce."
,
str
(
e
),
)
return
global
_FI_WORKSPACE
global
_FI_WORKSPACE
_FI_WORKSPACE
=
self
.
workspace
_FI_WORKSPACE
=
self
.
workspace
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment