Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
cfd6a543
Commit
cfd6a543
authored
Mar 05, 2026
by
SAC_fanth
Browse files
修复channel-int8 的config读取bug
parent
db85ab07
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
3 additions
and
3 deletions
+3
-3
vllm/model_executor/layers/fused_moe/config.py
vllm/model_executor/layers/fused_moe/config.py
+3
-3
No files found.
vllm/model_executor/layers/fused_moe/config.py
View file @
cfd6a543
...
...
@@ -246,8 +246,8 @@ class FusedMoEQuantConfig:
@
property
def
block_shape
(
self
)
->
list
[
int
]
|
None
:
if
self
.
use_int8_w8a8
:
return
[
256
,
256
]
#
if self.use_int8_w8a8:
#
return [256, 256]
if
(
self
.
_a1
.
shape
is
not
None
...
...
@@ -572,7 +572,7 @@ def int8_w8a8_moe_quant_config(
a2_scale
=
a2_scale
,
per_act_token_quant
=
per_act_token_quant
,
per_out_ch_quant
=
False
,
block_shape
=
[
256
,
256
]
,
block_shape
=
None
,
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment