Skip to content

GitLab

Unverified Commit 213b6445 authored by Lucas Kabela's avatar Lucas Kabela Committed by GitHub
Browse files

[Bugfix] Convert untraceable GroupShape to list for AMD impl (#26535) 


Signed-off-by: default avatarLucas Kabela <lucaskabela@meta.com>
parent 784c2311
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 2 deletions
vllm/model_executor/layers/quantization/utils/fp8_utils.py
View file @ 213b6445
...@@ -360,7 +360,7 @@ class W8A8BlockFp8LinearOp: ...@@ -360,7 +360,7 @@ class W8A8BlockFp8LinearOp:
weight, weight,
input_scale, input_scale,
weight_scale, weight_scale,
self.weight_group_shape, list(self.weight_group_shape),
input_2d.dtype, input_2d.dtype,
) )
...@@ -377,7 +377,7 @@ class W8A8BlockFp8LinearOp: ...@@ -377,7 +377,7 @@ class W8A8BlockFp8LinearOp:
weight, weight,
input_scale, input_scale,
weight_scale, weight_scale,
self.weight_group_shape, list(self.weight_group_shape),
input_2d.dtype, input_2d.dtype,
) )
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment