Commits · 00ee37efa23600d7c89d8fd5dc8bdc125c49e39d · OpenDAS / vllm_cscc

25 Mar, 2025 1 commit

Fix CUDA kernel index data type in... · 051da7ef

Lu Fang authored Mar 25, 2025

Fix CUDA kernel index data type in vllm/csrc/quantization/gptq_marlin/awq_marlin_repack.cu +10 (#15160)
Signed-off-by: Lu Fang <lufang@fb.com>
Co-authored-by: Richard Barnes <rbarnes@meta.com>

051da7ef

28 Jan, 2025 1 commit
- Update `pre-commit` hooks (#12475) · 823ab796
  Harry Mellor authored Jan 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  823ab796
27 Nov, 2024 1 commit
- [Kernel] Remove if-else with identical branches in marlin 2:4 (#10687) · e2251109
  Tyler Michael Smith authored Nov 27, 2024
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  e2251109
20 Nov, 2024 1 commit
- [Bugfix] Marlin 2:4 temp fix for large M dim (>256) (#10464) · d200972e
  Lucas Wilkinson authored Nov 19, 2024
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  d200972e
17 Oct, 2024 1 commit
- [Bugfix] Fix support for dimension like integers and ScalarType (#9299) · eca2c5f7
  bnellnm authored Oct 17, 2024
  
  eca2c5f7
04 Oct, 2024 1 commit
- [CI/Build] Per file CUDA Archs (improve wheel size and dev build times) (#8845) · aeb37c2a
  Lucas Wilkinson authored Oct 03, 2024
  
  aeb37c2a
02 Aug, 2024 1 commit
- [Misc] Disambiguate quantized types via a new ScalarType (#6396) · a8d604ca
  Lucas Wilkinson authored Aug 02, 2024
  
  a8d604ca
30 Jul, 2024 1 commit
- [Kernel] Fix marlin divide-by-zero warnings (#6904) · 61a97c32
  Tyler Michael Smith authored Jul 29, 2024
  
  61a97c32
18 Jun, 2024 1 commit
- [Bugfix] Fix CUDA version check for mma warning suppression (#5642) · b23ce920
  Tyler Michael Smith authored Jun 18, 2024
  
  b23ce920
14 Jun, 2024 1 commit
- [Kernel] Suppress mma.sp warning on CUDA 12.5 and later (#5401) · 348616ac
  Tyler Michael Smith authored Jun 14, 2024
  
  348616ac
09 Jun, 2024 1 commit
- [Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047) · 5467ac31
  bnellnm authored Jun 09, 2024
  
  5467ac31
31 May, 2024 2 commits

Revert "[Kernel] Marlin_24: Ensure the mma.sp instruction is using the... · e9d3aa04

Simon Mo authored May 31, 2024

Revert "[Kernel] Marlin_24: Ensure the mma.sp instruction is using the ::ordered_metadata modifier (introduced with PTX 8.5)" (#5149)

e9d3aa04

[Kernel] Marlin_24: Ensure the mma.sp instruction is using the... · 6d21fa1c

Alexander Matveev authored May 30, 2024

[Kernel] Marlin_24: Ensure the mma.sp instruction is using the ::ordered_metadata modifier (introduced with PTX 8.5) (#5136)

6d21fa1c

23 May, 2024 1 commit
- Marlin 24 prefill performance improvement (about 25% better on average) (#4983) · 60662532
  Alexander Matveev authored May 23, 2024
  
  60662532
22 May, 2024 1 commit
- [CI/Build] Enforce style for C++ and CUDA code with `clang-format` (#4722) · 5f6d10c1
  Michael Goin authored May 22, 2024
  
  5f6d10c1
16 May, 2024 1 commit
- Add GPTQ Marlin 2:4 sparse structured support (#4790) · 6979ade3
  Alexander Matveev authored May 16, 2024
```
Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>
```
  6979ade3