Commits · a57a3044aa57bc4100e2033e23b6fa1dfb051a2e · OpenDAS / vllm_cscc

"vllm/vscode:/vscode.git/clone" did not exist on "007dd90859cc0337510536677418a43d8f66e286"

31 Mar, 2025 1 commit
- [V1] Fully Transparent Implementation of CPU Offloading (#15354) · 555aa219
  youkaichao authored Mar 31, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  555aa219
27 Mar, 2025 1 commit

[Kernel] CUTLASS grouped gemm fp8 MoE kernel (#13972) · 9239bf71

ElizaWszola authored Mar 27, 2025


Signed-off-by: ElizaWszola <eliza@neuralmagic.com>
Signed-off-by: ElizaWszola <ewszola@redhat.com>
Co-authored-by: Lucas Wilkinson <wilkinson.lucas@gmail.com>

9239bf71

26 Mar, 2025 1 commit

[FEAT][ROCm] Integrate Fused MoE Kernels from AITER (#14967) · 5ebf6674

vllmellm authored Mar 26, 2025


Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>

5ebf6674

25 Mar, 2025 1 commit
- [Kernel][CPU] CPU MLA (#14744) · 4f044b1d
  Thien Tran authored Mar 25, 2025
```
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
```
  4f044b1d
24 Mar, 2025 2 commits

[ROCm][Kernel] MoE weights padding (#14454) · f533b583

Gregory Shtrasberg authored Mar 24, 2025


Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Signed-off-by: charlifu <charlifu@amd.com>
Co-authored-by: charlifu <charlifu@amd.com>

f533b583

[Kernel] allow non-contiguous input for marlin kernel (#14658) · 6b3cc75b
Jinzhen Lin authored Mar 24, 2025
```
Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com>
```
6b3cc75b

22 Mar, 2025 1 commit
- Remove openvino support in favor of external plugin (#15339) · b877031d
  Russell Bryant authored Mar 22, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  b877031d
21 Mar, 2025 1 commit
- [Bugfix] Fix broken kernel test due to missing rename for v1 Triton backend (#15282) · 8afcd0f6
  Isotr0py authored Mar 21, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  8afcd0f6
20 Mar, 2025 1 commit
- [Attention] Flash Attention 3 - fp8 (#14570) · a597a575
  Mickaël Seznec authored Mar 20, 2025
```
Signed-off-by: Mickael Seznec <mickael@mistral.ai>
```
  a597a575
17 Mar, 2025 1 commit

[Misc] Replace os environ to monkeypatch in test suite (#14516) · a73e183e

Sibi authored Mar 17, 2025


Signed-off-by: sibi <85477603+t-sibiraj@users.noreply.github.com>
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Aaron Pham <contact@aarnphm.xyz>

a73e183e

15 Mar, 2025 2 commits

[Attention] Get rid of mla cache alignment (#14842) · 5952d8ab
Lucas Wilkinson authored Mar 15, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
5952d8ab

[V1] V1 Enablement Oracle (#13726) · d4d93db2

Robert Shaw authored Mar 15, 2025


Signed-off-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>

d4d93db2

12 Mar, 2025 1 commit
- [Kernel] GGUF MoE kernel (#14613) · e22ee1e7
  Szymon Ożóg authored Mar 12, 2025
```
Signed-off-by: SzymonOzog <szymon.ozog@aleph-alpha.com>
```
  e22ee1e7
11 Mar, 2025 1 commit
- dynamic distpatch of fp8 kernels (#14245) · a1c8f379
  Jeff Daily authored Mar 11, 2025
```
Signed-off-by: Jeff Daily <jeff.daily@amd.com>
```
  a1c8f379
10 Mar, 2025 1 commit

[Kernel] Add more dtype support for GGUF kernels (#14043) · 89cdaa83

Szymon Ożóg authored Mar 10, 2025


Signed-off-by: SzymonOzog <szymon.ozog@aleph-alpha.com>
Signed-off-by: SzymonOzog <szymon.ozog@gmail.com>

89cdaa83

07 Mar, 2025 1 commit
- [Kernel] optimize performance of gptq marlin kernel when n is small (#14138) · d0feea31
  Jinzhen Lin authored Mar 08, 2025
```
Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com>
```
  d0feea31
06 Mar, 2025 2 commits
- [Kernel] [V1] Improved performance for V1 Triton (ROCm) backend (#14152) · 6bd1dd9d
  Thomas Parnell authored Mar 06, 2025
  
  6bd1dd9d
- [Bugfix][CI] ALiBi test case in xformers multi_query_kv_attention (#11301) · 5ee10e99
  Nicolò Lucchesi authored Mar 06, 2025
  
  5ee10e99
05 Mar, 2025 2 commits
- Temporarily disable test_awq_gemm_opcheck (#14251) · dae9ec46
  Michael Goin authored Mar 05, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  dae9ec46
- [V1] EP/TP MoE + DP Attention (#13931) · 72c62eae
  Tyler Michael Smith authored Mar 05, 2025
  
  72c62eae
03 Mar, 2025 2 commits
- [ROCm] Faster Custom Paged Attention kernels (#12348) · 848a6438
  TJian authored Mar 04, 2025
  
  848a6438
- Update deprecated Python 3.8 typing (#13971) · cf069aa8
  Harry Mellor authored Mar 03, 2025
  
  cf069aa8
01 Mar, 2025 1 commit
- [Misc][Kernel]: Add GPTQAllSpark Quantization (#12931) · 6a92ff93
  YajieWang authored Mar 01, 2025
  
  6a92ff93
27 Feb, 2025 2 commits
- Fix test_block_fp8.py test for MoE (#13915) · 788f284b
  Michael Goin authored Feb 27, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  788f284b
- [Kernel] FlashMLA integration (#13747) · f9590390
  Lucas Wilkinson authored Feb 26, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  f9590390
25 Feb, 2025 2 commits
- [ROCm][Quantization][Kernel] Using HIP FP8 header (#12593) · aabeb268
  Gregory Shtrasberg authored Feb 25, 2025
  
  aabeb268
- Remove unused kwargs from model definitions (#13555) · cdc1fa12
  Harry Mellor authored Feb 25, 2025
  
  cdc1fa12
24 Feb, 2025 1 commit
- Expert Parallelism (EP) Support for DeepSeek V2 (#12583) · 781096e3
  Jongseok Park authored Feb 24, 2025
  
  781096e3
22 Feb, 2025 2 commits
- [V1][Kernel] Refactor the prefix_prefill kernel so that the caller no longer... · 558db808
  Sage Moore authored Feb 22, 2025
```
[V1][Kernel] Refactor the prefix_prefill kernel so that the caller no longer has to pass in the context lengths (#13095)
```
  558db808
- [NVIDIA] Support nvfp4 cutlass gemm (#13571) · e109e598
  Kaixi Hou authored Feb 22, 2025
  
  e109e598
21 Feb, 2025 1 commit

[Attention] MLA with chunked prefill (#12639) · 288cc6c2

Lucas Wilkinson authored Feb 21, 2025


Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Patrick Horn <patrick.horn@gmail.com>
Co-authored-by: simon-mo <xmo@berkeley.edu>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

288cc6c2

18 Feb, 2025 1 commit
- [Bugfix] Fix invalid rotary embedding unit test (#13431) · 38094584
  Liangfu Chen authored Feb 18, 2025
```
Signed-off-by: Liangfu Chen <liangfc@amazon.com>
```
  38094584
16 Feb, 2025 2 commits
- [ci] skip failed tests for flashinfer (#13352) · 124776eb
  youkaichao authored Feb 16, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  124776eb
- [BugFix] Enhance test_pos_encoding to support execution on multi-devices (#13187) · dc0f7ccf
  wchen61 authored Feb 16, 2025
```
Signed-off-by: wchen61 <wchen61@foxmail.com>
```
  dc0f7ccf
14 Feb, 2025 1 commit
- [Kernel][Bugfix] Refactor and Fix CUTLASS 2:4 Sparse Kernels (#13198) · c1e37bf7
  Tyler Michael Smith authored Feb 13, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  c1e37bf7
13 Feb, 2025 1 commit
- [NVIDIA] Support nvfp4 quantization (#12784) · 4fc5c23b
  Kaixi Hou authored Feb 12, 2025
  
  4fc5c23b
06 Feb, 2025 2 commits
- Add Bamba Model (#10909) · aff40457
  Yu Chin Fabian Lim authored Feb 07, 2025
```
Signed-off-by: Yu Chin Fabian Lim <flim@sg.ibm.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  aff40457
- [Kernel] Make rotary_embedding ops more flexible with input shape (#12777) · 85ac82d2
  Isotr0py authored Feb 07, 2025
  
  85ac82d2
05 Feb, 2025 1 commit

[Perf] Mem align KV caches for CUDA devices (MLA perf improvement) (#12676) · 75e94309

Lucas Wilkinson authored Feb 04, 2025


Signed-off-by: simon-mo <xmo@berkeley.edu>
Signed-off-by: Lucas Wilkinson <lcwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Co-authored-by: simon-mo <xmo@berkeley.edu>

75e94309

04 Feb, 2025 1 commit

[AMD][ROCm] Enable DeepSeek model on ROCm (#12662) · c36ac98d

Hongxia Yang authored Feb 04, 2025


Signed-off-by: Hongxia Yang <hongxia.yang@amd.com>
Co-authored-by: Matthew Wong <Matthew.Wong2@amd.com>

c36ac98d