Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
bf0f3a46
Unverified
Commit
bf0f3a46
authored
Jan 06, 2026
by
kzwrime
Committed by
GitHub
Jan 06, 2026
Browse files
[Bugfix] Fix torch.compile error for DP + MoE on CPU Backend (#31650)
Signed-off-by:
kunzh
<
zhikun.wu@outlook.com
>
parent
e0327c9d
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
2 deletions
+2
-2
vllm/model_executor/layers/fused_moe/layer.py
vllm/model_executor/layers/fused_moe/layer.py
+2
-2
No files found.
vllm/model_executor/layers/fused_moe/layer.py
View file @
bf0f3a46
...
...
@@ -1899,11 +1899,11 @@ class FusedMoE(CustomOp):
)
post_quant_allgather
=
(
has_flashinfer_trtllm_fused_moe
()
and
self
.
quant_method
is
not
None
self
.
quant_method
is
not
None
and
self
.
dp_size
>
1
and
self
.
use_ep
and
isinstance
(
self
.
quant_method
,
ModelOptNvFp4FusedMoE
)
and
has_flashinfer_trtllm_fused_moe
()
)
if
post_quant_allgather
:
hidden_states_to_dispatch
,
extra_tensors
=
(
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment