Unverified Commit e0e58f97 authored by Wentao Ye's avatar Wentao Ye Committed by GitHub
Browse files

[Bug] Enforce contiguous input for `dynamic_scaled_fp8_quant` and...


[Bug] Enforce contiguous input for `dynamic_scaled_fp8_quant` and `static_scaled_fp8_quant` (#21773)
Signed-off-by: default avataryewentao256 <zhyanwentao@126.com>
parent b361f14e
......@@ -1282,10 +1282,11 @@ def scaled_fp8_quant(
output, input.contiguous(), scale, scale_ub)
else:
scale = torch.zeros(1, device=input.device, dtype=torch.float32)
torch.ops._C.dynamic_scaled_fp8_quant(output, input, scale)
torch.ops._C.dynamic_scaled_fp8_quant(output, input.contiguous(),
scale)
else:
assert scale.numel() == 1, f"{scale.shape}"
torch.ops._C.static_scaled_fp8_quant(output, input, scale)
torch.ops._C.static_scaled_fp8_quant(output, input.contiguous(), scale)
return output, scale
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment