修改awq workspace 申请

70267267 · gaoqiong · 8376cc41 · 70267267
Commit 70267267 authored Aug 15, 2024 by gaoqiong
Hide whitespace changes
Inline Side-by-side

Showing with 1 addition and 1 deletion

vllm/model_executor/layers/quantization/awq.py vllm/model_executor/layers/quantization/awq.py +1 -1

No files found.
--- a/vllm/model_executor/layers/quantization/awq.py
+++ b/vllm/model_executor/layers/quantization/awq.py
@@ -217,7 +217,7 @@ class AWQLinearMethod(LinearMethodBase):
                            k,
                            n,
                            self.quant_config.group_size)
-            output=F.linear(reshaped_x, deqweight[:,0:k])    
+            out=F.linear(reshaped_x, deqweight[:,0:k])    
        if bias is not None:
            out.add_(bias)