"vscode:/vscode.git/clone" did not exist on "eca2c5f7c00d6c0b08051972d1e80fe822e7d1b8"
Unverified Commit 958adce4 authored by Tyler Michael Smith's avatar Tyler Michael Smith Committed by GitHub
Browse files

[Bugfix] Fix use_direct_call condition in FusedMoE layer for (#14382)


Signed-off-by: default avatarTyler Michael Smith <tyler@neuralmagic.com>
parent 99b0915d
......@@ -359,7 +359,7 @@ class FusedMoE(torch.nn.Module):
# For smuggling this layer into the fused moe custom op
self.use_direct_call = self.dp_size == 1
if self.use_direct_call:
if not self.use_direct_call:
compilation_config = vllm_config.compilation_config
if prefix in compilation_config.static_forward_context:
raise ValueError("Duplicate layer name: {}".format(prefix))
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment