benchmarks/cutlass_benchmarks/w8a8_benchmarks.py · 60508ffda91c22e4cde3b18f149d222211db8886 · OpenDAS / vllm_cscc

[Kernel]: Cutlass 2:4 Sparsity + FP8/Int8 Quant Support (#10995) · 60508ffd

Dipika Sikka authored Dec 18, 2024


Co-authored-by: Faraz Shahsavan <faraz.shahsavan@gmail.com>
Co-authored-by: ilmarkov <markovilya197@gmail.com>
Co-authored-by: Rahul Tuli <rahul@neuralmagic.com>
Co-authored-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>

60508ffd

w8a8_benchmarks.py 12.6 KB

Replace w8a8_benchmarks.py