Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
change
sglang
Commits
71ab0dab
"torchvision/datapoints/_bounding_box.py" did not exist on "05b5e8c0743ac533f54aa2ca7f5ac90ab960065a"
Unverified
Commit
71ab0dab
authored
Mar 05, 2025
by
HAI
Committed by
GitHub
Mar 05, 2025
Browse files
Fix the moe padding conditional logic (#4081)
parent
d3d4d767
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
6 additions
and
1 deletion
+6
-1
python/sglang/srt/layers/moe/fused_moe_triton/fused_moe.py
python/sglang/srt/layers/moe/fused_moe_triton/fused_moe.py
+6
-1
No files found.
python/sglang/srt/layers/moe/fused_moe_triton/fused_moe.py
View file @
71ab0dab
...
...
@@ -18,6 +18,7 @@ from sglang.srt.layers.quantization.fp8_kernel import per_token_group_quant_fp8
from
sglang.srt.layers.quantization.int8_kernel
import
per_token_group_quant_int8
from
sglang.srt.utils
import
(
direct_register_custom_op
,
get_bool_env_var
,
get_device_name
,
is_cuda_available
,
is_hip
,
...
...
@@ -941,7 +942,11 @@ def fused_experts_impl(
no_combine
:
bool
=
False
,
):
padded_size
=
padding_size
if
not
use_fp8_w8a8
or
not
use_int8_w8a8
or
block_shape
is
not
None
:
if
(
not
(
use_fp8_w8a8
or
use_int8_w8a8
)
or
block_shape
is
not
None
or
(
is_hip_
and
get_bool_env_var
(
"CK_MOE"
))
):
padded_size
=
0
# Check constraints.
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment