Skip to content

GitLab

Unverified Commit aacf0abf authored by Lucas Wilkinson's avatar Lucas Wilkinson Committed by GitHub
Browse files

[BugFix] Fix `AttributeError: 'MergedColumnParallelLinear' object has no... 


[BugFix] Fix `AttributeError: 'MergedColumnParallelLinear' object has no attribute 'weight_scale'` (#30399)
Signed-off-by: default avatarLucas Wilkinson <lwilkins@redhat.com>
parent c756fb67
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
vllm/model_executor/warmup/deep_gemm_warmup.py
View file @ aacf0abf
...@@ -89,7 +89,7 @@ def _extract_data_from_linear_base_module( ...@@ -89,7 +89,7 @@ def _extract_data_from_linear_base_module(
assert m.quant_method.quant_config is not None assert m.quant_method.quant_config is not None
w = m.weight w = m.weight
ws = m.weight_scale ws = m.weight_scale_inv if hasattr(m, "weight_scale_inv") else m.weight_scale
quant_block_size = m.quant_method.quant_config.weight_block_size quant_block_size = m.quant_method.quant_config.weight_block_size
assert isinstance(w, torch.Tensor) assert isinstance(w, torch.Tensor)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment