Skip to content

GitLab

"tests/vscode:/vscode.git/clone" did not exist on "e0aa838971266abef1b58985bef6f092f4ab72df"
Unverified Commit 37367da6 authored by Xiaoyu Zhang's avatar Xiaoyu Zhang Committed by GitHub
Browse files

[fix CI] Fix logical condition in fused MoE layer for compressed tensor quantization (#10299)

parent ef959d7b
Show whitespace changes
Inline Side-by-side
Showing with 4 additions and 2 deletions
python/sglang/srt/layers/moe/fused_moe_triton/layer.py
View file @ 37367da6
...@@ -613,8 +613,10 @@ class FusedMoE(torch.nn.Module): ...@@ -613,8 +613,10 @@ class FusedMoE(torch.nn.Module):
loaded_weight = loaded_weight.to(param.data.device) loaded_weight = loaded_weight.to(param.data.device)
if ( if (
(
"compressed" in self.quant_method.__class__.__name__.lower() "compressed" in self.quant_method.__class__.__name__.lower()
or "w4afp8" in self.quant_config.get_name() or "w4afp8" in self.quant_config.get_name()
)
and (param.data[expert_id] != 1).any() and (param.data[expert_id] != 1).any()
and ((param.data[expert_id] - loaded_weight).abs() > 1e-5).any() and ((param.data[expert_id] - loaded_weight).abs() > 1e-5).any()
): ):
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment