Commits · 3f3b6b21500bce2061cae33706bd47c8b6663771 · OpenDAS / vllm_cscc

19 Jun, 2024 1 commit
- [Bugfix] Fix w8a8 benchmarks for int8 case (#5643) · 6820724e
  Tyler Michael Smith authored Jun 18, 2024
  
  6820724e
17 Jun, 2024 1 commit
- Fix w8a8 benchmark and add Llama-3-8B (#5562) · e2b85cf8
  Cody Yu authored Jun 16, 2024
  
  e2b85cf8
13 Jun, 2024 1 commit

[Kernel] Factor out epilogues from cutlass kernels (#5391) · 85657b56

Tyler Michael Smith authored Jun 13, 2024


Co-authored-by: Michael Goin <michael@neuralmagic.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: zifeitong <zifei.tong@parasail.io>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-neuralmagic@users.noreply.github.com>

85657b56

01 Jun, 2024 1 commit

[Kernel] Update Cutlass fp8 configs (#5144) · f081c3ce

Varun Sundar Rabindranath authored Jun 01, 2024


Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-neuralmagic@users.noreply.github.com>

f081c3ce