Commits · 60508ffda91c22e4cde3b18f149d222211db8886 · OpenDAS / vllm_cscc

18 Dec, 2024 1 commit

[Kernel]: Cutlass 2:4 Sparsity + FP8/Int8 Quant Support (#10995) · 60508ffd

Dipika Sikka authored Dec 18, 2024


Co-authored-by: Faraz Shahsavan <faraz.shahsavan@gmail.com>
Co-authored-by: ilmarkov <markovilya197@gmail.com>
Co-authored-by: Rahul Tuli <rahul@neuralmagic.com>
Co-authored-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>

60508ffd

17 Jun, 2024 1 commit
- Fix w8a8 benchmark and add Llama-3-8B (#5562) · e2b85cf8
  Cody Yu authored Jun 16, 2024
  
  e2b85cf8
01 Jun, 2024 1 commit

[Kernel] Update Cutlass fp8 configs (#5144) · f081c3ce

Varun Sundar Rabindranath authored Jun 01, 2024


Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-neuralmagic@users.noreply.github.com>

f081c3ce