Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
change
sglang
Commits
5e91fed1
Unverified
Commit
5e91fed1
authored
Aug 04, 2025
by
Yineng Zhang
Committed by
GitHub
Aug 04, 2025
Browse files
Revert "[NVIDIA]Fix local_num_experts for EP (#8779)" (#8797)
parent
873f384a
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
2 additions
and
4 deletions
+2
-4
python/sglang/srt/layers/moe/fused_moe_triton/layer.py
python/sglang/srt/layers/moe/fused_moe_triton/layer.py
+1
-2
python/sglang/srt/layers/quantization/modelopt_quant.py
python/sglang/srt/layers/quantization/modelopt_quant.py
+1
-2
No files found.
python/sglang/srt/layers/moe/fused_moe_triton/layer.py
View file @
5e91fed1
...
...
@@ -200,8 +200,7 @@ class FusedMoE(torch.nn.Module):
self
.
quant_config
=
quant_config
self
.
quant_method
.
create_weights
(
layer
=
self
,
num_experts
=
self
.
num_experts
,
num_local_experts
=
self
.
num_local_experts
,
num_experts
=
self
.
num_local_experts
,
hidden_size
=
hidden_size
,
# FIXME: figure out which intermediate_size to use
intermediate_size
=
self
.
intermediate_size_per_partition
,
...
...
python/sglang/srt/layers/quantization/modelopt_quant.py
View file @
5e91fed1
...
...
@@ -752,7 +752,6 @@ class ModelOptNvFp4FusedMoEMethod(FusedMoEMethodBase):
self
,
layer
:
torch
.
nn
.
Module
,
num_experts
:
int
,
num_local_experts
:
int
,
hidden_size
:
int
,
intermediate_size_per_partition
:
int
,
params_dtype
:
torch
.
dtype
,
...
...
@@ -766,7 +765,7 @@ class ModelOptNvFp4FusedMoEMethod(FusedMoEMethodBase):
# TODO(ch-wan): check if this is needed
layer
.
num_experts
=
num_experts
layer
.
num_local_experts
=
num_
local_
experts
layer
.
num_local_experts
=
num_experts
layer
.
intermediate_size_per_partition
=
intermediate_size_per_partition
layer
.
params_dtype
=
params_dtype
layer
.
quant_config
=
self
.
quant_config
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment