Commits · e661d5946a424d2396b719c582faebdfe6f7421a · OpenDAS / vllm_cscc

05 Aug, 2024 1 commit
- [CI/Build] Suppress divide-by-zero and missing return statement warnings (#7001) · 6e4852ce
  Tyler Michael Smith authored Aug 05, 2024
  
  6e4852ce
30 Jul, 2024 1 commit
- [Kernel] Remove unused variables in awq/gemm_kernels.cu (#6908) · aae6d36f
  Tyler Michael Smith authored Jul 29, 2024
  
  aae6d36f
09 Jun, 2024 1 commit
- [Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047) · 5467ac31
  bnellnm authored Jun 09, 2024
  
  5467ac31
22 May, 2024 1 commit
- [CI/Build] Enforce style for C++ and CUDA code with `clang-format` (#4722) · 5f6d10c1
  Michael Goin authored May 22, 2024
  
  5f6d10c1
12 Feb, 2024 1 commit
- Refactor 2 awq gemm kernels into m16nXk32 (#2723) · 56383649
  Rex authored Feb 12, 2024
```
Co-authored-by: Chunan Zeng <chunanzeng@Chunans-Air.attlocal.net>
```
  56383649
27 Jan, 2024 1 commit
- AWQ: Up to 2.66x higher throughput (#2566) · beb89f68
  Casper authored Jan 27, 2024
  
  beb89f68
16 Oct, 2023 1 commit
- Minor fix on AWQ kernel launch (#1356) · 29678cd2
  Woosuk Kwon authored Oct 15, 2023
  
  29678cd2
11 Oct, 2023 2 commits
- Fix overflow in awq kernel (#1295) · 980dd4a2
  CHU Tianxiang authored Oct 11, 2023
```
Co-authored-by: 楚天翔 <tianxiang.ctx@alibaba-inc.com>
```
  980dd4a2
- workaround of AWQ for Turing GPUs (#1252) · 82857368
  twaka authored Oct 11, 2023
  
  82857368
18 Sep, 2023 1 commit
- Add minimum capability requirement for AWQ (#1064) · 2b1c116b
  Woosuk Kwon authored Sep 18, 2023
  
  2b1c116b
16 Sep, 2023 1 commit

Implement AWQ quantization support for LLaMA (#1032) · e3e79e9e

Woosuk Kwon authored Sep 16, 2023


Co-authored-by: Robert Irvine <robert@seamlessml.com>
Co-authored-by: root <rirv938@gmail.com>
Co-authored-by: Casper <casperbh.96@gmail.com>
Co-authored-by: julian-q <julianhquevedo@gmail.com>

e3e79e9e