Commits · 93548eb37e952a0af035dc524a3826cdcd78d6cf · OpenDAS / vllm_cscc

29 Jul, 2024 1 commit
- [Kernel] Tuned FP8 Kernels for Ada Lovelace (#6677) · 766435e6
  Varun Sundar Rabindranath authored Jul 29, 2024
```
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
```
  766435e6
17 Jul, 2024 1 commit
- [Misc] Use `torch.Tensor` for type annotation (#6505) · a9a2e74d
  Woosuk Kwon authored Jul 17, 2024
  
  a9a2e74d
20 Jun, 2024 1 commit
- [Frontend] Add FlexibleArgumentParser to support both underscore and dash in names (#5718) · 8065a7e2
  Michael Goin authored Jun 20, 2024
  
  8065a7e2
19 Jun, 2024 1 commit
- [Bugfix] Fix w8a8 benchmarks for int8 case (#5643) · 6820724e
  Tyler Michael Smith authored Jun 18, 2024
  
  6820724e
17 Jun, 2024 1 commit
- Fix w8a8 benchmark and add Llama-3-8B (#5562) · e2b85cf8
  Cody Yu authored Jun 16, 2024
  
  e2b85cf8
13 Jun, 2024 1 commit

[Kernel] Factor out epilogues from cutlass kernels (#5391) · 85657b56

Tyler Michael Smith authored Jun 13, 2024


Co-authored-by: Michael Goin <michael@neuralmagic.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: zifeitong <zifei.tong@parasail.io>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-neuralmagic@users.noreply.github.com>

85657b56

01 Jun, 2024 1 commit

[Kernel] Update Cutlass fp8 configs (#5144) · f081c3ce

Varun Sundar Rabindranath authored Jun 01, 2024


Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-neuralmagic@users.noreply.github.com>

f081c3ce