"docs/backends/vscode:/vscode.git/clone" did not exist on "5dafe10b8e4ff2d44afddd81710c0721a2f3e136"
Commit be18d0df authored by zhuwenwen's avatar zhuwenwen
Browse files

Merge branch 'v0.9.2-dev-fix-assert-bug' into 'v0.9.2-dev'

fix: 修复不开启融合图的断言错误。

See merge request dcutoolkit/deeplearing/vllm!359
parents 3f5983bf 9cf5c476
......@@ -346,7 +346,8 @@ class DeepseekV2MoE(nn.Module):
* (1. / self.routed_scaling_factor)
else: # RQ
if not self.enable_expert_parallel:
assert iqis is not None
i_q, i_s = None, None
if iqis is not None:
i_q, i_s = iqis
if self.run_shared_expert_singlely:
if envs.USE_FUSED_RMS_QUANT:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment