Commits · eb8e460c0ad886ab2ebb30e83ded763f776dd363 · xdb4_94051 / vllm

"...lm-evaluation-harness.git" did not exist on "7a357971b553a871ad955190fc883ec76499cf9e"

13 Sep, 2024 1 commit
- update mygq · eb8e460c
  nicodafagood authored Sep 13, 2024
  
  eb8e460c
12 Sep, 2024 1 commit
- add csrc of myq · 49e84bec
  nicodafagood authored Sep 12, 2024
  
  49e84bec
23 Mar, 2024 1 commit
- use half atomicAdd of dtk24.04 · 3f1166ab
  zhuwenwen authored Mar 23, 2024
  
  3f1166ab
01 Mar, 2024 1 commit

Integrate Marlin Kernels for Int4 GPTQ inference (#2497) · c0c2335c

Robert Shaw authored Mar 01, 2024


Co-authored-by: Robert Shaw <114415538+rib-2@users.noreply.github.com>
Co-authored-by: alexm <alexm@neuralmagic.com>

c0c2335c

29 Feb, 2024 1 commit
- Add Support for 2/3/8-bit GPTQ Quantization Models (#2330) · 01a5d18a
  CHU Tianxiang authored Feb 29, 2024
  
  01a5d18a
12 Feb, 2024 1 commit
- Refactor 2 awq gemm kernels into m16nXk32 (#2723) · 56383649
  Rex authored Feb 12, 2024
```
Co-authored-by: Chunan Zeng <chunanzeng@Chunans-Air.attlocal.net>
```
  56383649
01 Feb, 2024 2 commits
- Fix compile error when using rocm (#2648) · 923797fe
  zhaoyang-star authored Feb 02, 2024
  
  923797fe
- skip fp8 · 318e2b5a
  zhuwenwen authored Feb 01, 2024
  
  318e2b5a
29 Jan, 2024 1 commit

Support FP8-E5M2 KV Cache (#2279) · 9090bf02

zhaoyang-star authored Jan 29, 2024


Co-authored-by: zhaoyang <zhao.yang16@zte.com.cn>
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>

9090bf02

27 Jan, 2024 1 commit
- AWQ: Up to 2.66x higher throughput (#2566) · beb89f68
  Casper authored Jan 27, 2024
  
  beb89f68
03 Jan, 2024 2 commits
- Enable CUDA graph for GPTQ & SqueezeLLM (#2318) · 6ef00b03
  Woosuk Kwon authored Jan 03, 2024
  
  6ef00b03
- [FIX] Support non-zero CUDA devices in custom kernels (#1959) · 77af974b
  Jee Li authored Jan 03, 2024
  
  77af974b
18 Dec, 2023 1 commit
- [ROCm] Fixes for GPTQ on ROCm (#2180) · 1b7c791d
  kliuae authored Dec 19, 2023
  
  1b7c791d
15 Dec, 2023 1 commit
- Add GPTQ support (#916) · 0fbfc4b8
  CHU Tianxiang authored Dec 15, 2023
  
  0fbfc4b8
08 Dec, 2023 1 commit

Merge EmbeddedLLM/vllm-rocm into vLLM main (#1836) · 6ccc0bff

TJian authored Dec 08, 2023


Co-authored-by: Philipp Moritz <pcmoritz@gmail.com>
Co-authored-by: Amir Balwel <amoooori04@gmail.com>
Co-authored-by: root <kuanfu.liu@akirakan.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: kuanfu <kuanfu.liu@embeddedllm.com>
Co-authored-by: miloice <17350011+kliuae@users.noreply.github.com>

6ccc0bff

22 Oct, 2023 1 commit

Support SqueezeLLM (#1326) · 1f24755b

chooper1 authored Oct 22, 2023


Co-authored-by: squeeze-ai-lab <squeezeailab.bair@gmail.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

1f24755b

16 Oct, 2023 1 commit
- Minor fix on AWQ kernel launch (#1356) · 29678cd2
  Woosuk Kwon authored Oct 15, 2023
  
  29678cd2
11 Oct, 2023 2 commits
- Fix overflow in awq kernel (#1295) · 980dd4a2
  CHU Tianxiang authored Oct 11, 2023
```
Co-authored-by: 楚天翔 <tianxiang.ctx@alibaba-inc.com>
```
  980dd4a2
- workaround of AWQ for Turing GPUs (#1252) · 82857368
  twaka authored Oct 11, 2023
  
  82857368
18 Sep, 2023 1 commit
- Add minimum capability requirement for AWQ (#1064) · 2b1c116b
  Woosuk Kwon authored Sep 18, 2023
  
  2b1c116b
16 Sep, 2023 1 commit

Implement AWQ quantization support for LLaMA (#1032) · e3e79e9e

Woosuk Kwon authored Sep 16, 2023


Co-authored-by: Robert Irvine <robert@seamlessml.com>
Co-authored-by: root <rirv938@gmail.com>
Co-authored-by: Casper <casperbh.96@gmail.com>
Co-authored-by: julian-q <julianhquevedo@gmail.com>

e3e79e9e