Skip to content

GitLab

Unverified Commit 6820724e authored by Tyler Michael Smith's avatar Tyler Michael Smith Committed by GitHub
Browse files

[Bugfix] Fix w8a8 benchmarks for int8 case (#5643)

parent b23ce920
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 3 deletions
benchmarks/cutlass_benchmarks/w8a8_benchmarks.py
View file @ 6820724e
...@@ -120,9 +120,8 @@ def bench_int8(dtype: torch.dtype, m: int, k: int, n: int, label: str, ...@@ -120,9 +120,8 @@ def bench_int8(dtype: torch.dtype, m: int, k: int, n: int, label: str,
# cutlass impl # cutlass impl
timers.append( timers.append(
bench_fn(a, b, scale_a.to(device="cpu"), scale_b.to(device="cpu"), bench_fn(a, b, scale_a, scale_b, torch.bfloat16, label, sub_label,
torch.bfloat16, label, sub_label, cutlass_impl, cutlass_impl, "cutlass_i8_i8_bf16_scaled_mm"))
"cutlass_i8_i8_bf16_scaled_mm"))
return timers return timers
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment