Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
change
sglang
Commits
8ada1ab6
"docs/vscode:/vscode.git/clone" did not exist on "535f4b29e3747fa800b826813d2c708b396dfb70"
Unverified
Commit
8ada1ab6
authored
Aug 03, 2025
by
fzyzcjy
Committed by
GitHub
Aug 02, 2025
Browse files
Fix triton moe error caused by TopK refactor (#8705)
parent
e314b084
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
0 additions
and
31 deletions
+0
-31
python/sglang/srt/layers/moe/fused_moe_triton/triton_kernels_moe.py
...ang/srt/layers/moe/fused_moe_triton/triton_kernels_moe.py
+0
-31
No files found.
python/sglang/srt/layers/moe/fused_moe_triton/triton_kernels_moe.py
View file @
8ada1ab6
...
@@ -146,34 +146,3 @@ def triton_kernel_fused_experts(
...
@@ -146,34 +146,3 @@ def triton_kernel_fused_experts(
)
)
return
intermediate_cache3
return
intermediate_cache3
def
triton_kernel_moe_forward_fake
(
hidden_states
:
torch
.
Tensor
,
w1
:
torch
.
Tensor
,
w2
:
torch
.
Tensor
,
gating_output
:
torch
.
Tensor
,
topk
:
int
,
renormalize
:
bool
,
inplace
:
bool
=
False
,
activation
:
str
=
"silu"
,
apply_router_weight_on_input
:
bool
=
False
,
use_fp8_w8a8
:
bool
=
False
,
per_channel_quant
:
bool
=
False
,
global_num_experts
:
int
=
-
1
,
expert_map
:
Optional
[
torch
.
Tensor
]
=
None
,
w1_scale
:
Optional
[
torch
.
Tensor
]
=
None
,
w2_scale
:
Optional
[
torch
.
Tensor
]
=
None
,
a1_scale
:
Optional
[
torch
.
Tensor
]
=
None
,
a2_scale
:
Optional
[
torch
.
Tensor
]
=
None
,
block_shape
:
Optional
[
list
[
int
]]
=
None
,
)
->
torch
.
Tensor
:
return
torch
.
empty_like
(
hidden_states
)
direct_register_custom_op
(
op_name
=
"forward_cuda_triton"
,
op_func
=
triton_kernel_moe_forward
,
mutates_args
=
[],
fake_impl
=
triton_kernel_moe_forward_fake
,
)
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment