benchmarks/cutlass_benchmarks/w8a8_benchmarks.py · a5753ff5efa5cfcdd7e78256ab6ec8784762bc43 · OpenDAS / vllm_cscc

[Kernel] Factor out epilogues from cutlass kernels (#5391) · 85657b56

Tyler Michael Smith authored Jun 13, 2024


Co-authored-by: Michael Goin <michael@neuralmagic.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: zifeitong <zifei.tong@parasail.io>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-neuralmagic@users.noreply.github.com>

85657b56

w8a8_benchmarks.py 12 KB

Replace w8a8_benchmarks.py