Unverified Commit a5464dcf authored by Kyle Sayers's avatar Kyle Sayers Committed by GitHub
Browse files

[Compressed Tensors] Always clone output for compile robustness (#26849)


Signed-off-by: default avatarKyle Sayers <kylesayrs@gmail.com>
Co-authored-by: default avatarMichael Goin <mgoin64@gmail.com>
parent ac3ed5a8
...@@ -163,7 +163,7 @@ class CompressedTensorsLinearTransformMethod(LinearMethodBase): ...@@ -163,7 +163,7 @@ class CompressedTensorsLinearTransformMethod(LinearMethodBase):
if self.output_transform is not None: if self.output_transform is not None:
for part_id, (start, length) in enumerate(self.partition_ranges): for part_id, (start, length) in enumerate(self.partition_ranges):
x[:, start : start + length] = self.output_transform( x[:, start : start + length] = self.output_transform(
x[:, start : start + length].contiguous(), part_id=part_id x[:, start : start + length].clone(), part_id=part_id
) )
return x return x
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment