Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
8372be28
Unverified
Commit
8372be28
authored
Dec 18, 2025
by
Ming Yang
Committed by
GitHub
Dec 18, 2025
Browse files
[moe] Use enable_chunking func (to support disabling chunking) (#29935)
Signed-off-by:
Ming Yang
<
minos.future@gmail.com
>
parent
8da6ae49
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
2 deletions
+2
-2
vllm/model_executor/layers/fused_moe/modular_kernel.py
vllm/model_executor/layers/fused_moe/modular_kernel.py
+2
-2
No files found.
vllm/model_executor/layers/fused_moe/modular_kernel.py
View file @
8372be28
...
...
@@ -743,7 +743,7 @@ class FusedMoEModularKernel(torch.nn.Module):
1
,
(
M
if
not
self
.
fused_experts
.
supports
_chunking
()
if
not
self
.
fused_experts
.
enable
_chunking
()
else
min
(
M
,
envs
.
VLLM_FUSED_MOE_CHUNK_SIZE
)
),
)
...
...
@@ -786,7 +786,7 @@ class FusedMoEModularKernel(torch.nn.Module):
is_forward_context_available
()
and
get_forward_context
().
attn_metadata
is
None
)
if
is_profile_run
and
self
.
fused_experts
.
supports
_chunking
()
and
self
.
is_dp_ep
:
if
is_profile_run
and
self
.
fused_experts
.
enable
_chunking
()
and
self
.
is_dp_ep
:
max_workspace_13
,
max_workspace_2
,
max_fused_out_shape
=
(
self
.
fused_experts
.
workspace_shapes
(
envs
.
VLLM_FUSED_MOE_CHUNK_SIZE
,
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment