Commit be18d0df authored by zhuwenwen's avatar zhuwenwen
Browse files

Merge branch 'v0.9.2-dev-fix-assert-bug' into 'v0.9.2-dev'

fix: 修复不开启融合图的断言错误。

See merge request dcutoolkit/deeplearing/vllm!359
parents 3f5983bf 9cf5c476
...@@ -346,7 +346,8 @@ class DeepseekV2MoE(nn.Module): ...@@ -346,7 +346,8 @@ class DeepseekV2MoE(nn.Module):
* (1. / self.routed_scaling_factor) * (1. / self.routed_scaling_factor)
else: # RQ else: # RQ
if not self.enable_expert_parallel: if not self.enable_expert_parallel:
assert iqis is not None i_q, i_s = None, None
if iqis is not None:
i_q, i_s = iqis i_q, i_s = iqis
if self.run_shared_expert_singlely: if self.run_shared_expert_singlely:
if envs.USE_FUSED_RMS_QUANT: if envs.USE_FUSED_RMS_QUANT:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment