benchmarks/cutlass_benchmarks/w8a8_benchmarks.py · 35e9c12bfaf8f273281af897b7208dfba53f103c · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Kernel] Tuned int8 Cutlass Kernels for SM75 (T4) (#6996) · 35e9c12b
Varun Sundar Rabindranath authored Jul 31, 2024
```
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
```
35e9c12b

w8a8_benchmarks.py 12.5 KB