Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
change
sglang
Commits
7802586c
Unverified
Commit
7802586c
authored
Sep 07, 2025
by
Rain Jiang
Committed by
GitHub
Sep 07, 2025
Browse files
fix the fp8 topk_config.correction_bias is none bug (#10040)
parent
bc5fc332
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
6 additions
and
4 deletions
+6
-4
python/sglang/srt/layers/quantization/fp8.py
python/sglang/srt/layers/quantization/fp8.py
+6
-4
No files found.
python/sglang/srt/layers/quantization/fp8.py
View file @
7802586c
...
...
@@ -1132,10 +1132,12 @@ class Fp8MoEMethod(FusedMoEMethodBase):
and
topk_config
.
topk_group
is
not
None
),
"Current trtllm_fp8_block_scale_moe kernel does not support these two arguments as None"
if
topk_config
.
correction_bias
is
None
:
correction_bias
=
topk_config
.
correction_bias
.
to
(
x
.
dtype
)
else
:
correction_bias
=
None
correction_bias
=
(
None
if
topk_config
.
correction_bias
is
None
else
topk_config
.
correction_bias
.
to
(
x
.
dtype
)
)
return
trtllm_fp8_block_scale_moe
(
routing_logits
=
router_logits
.
to
(
torch
.
float32
),
routing_bias
=
correction_bias
,
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment