Skip to content

GitLab

Commit 533af8ef authored by zhuwenwen's avatar zhuwenwen
Browse files

update awq_marlin.py

parent 1f9aadcf
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
vllm/model_executor/layers/quantization/awq_marlin.py
View file @ 533af8ef
...@@ -571,6 +571,6 @@ class AWQMoEMethod(FusedMoEMethodBase): ...@@ -571,6 +571,6 @@ class AWQMoEMethod(FusedMoEMethodBase):
expert_map=expert_map, expert_map=expert_map,
w1_zeros=layer.w13_qzeros, w1_zeros=layer.w13_qzeros,
w2_zeros=layer.w2_qzeros, w2_zeros=layer.w2_qzeros,
workspace=layer.workspace workspace=layer.workspace,
num_bits=4 num_bits=4
) )
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment