Commits · 3b1d440ede42855f031ba72af4817583e5dddba0 · OpenDAS / vllm_cscc

"tests/vscode:/vscode.git/clone" did not exist on "b4fda58a2d0e458e0186e4caa4354b3d07153c70"

16 Dec, 2025 4 commits

[Perf][Kernels] Vectorize `csrc/activations_kernels.cu` (#29512) · 0a1ab1e5
Michael Goin authored Dec 16, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
0a1ab1e5
[Kernel][Quantization][MoE] add marlin kernel support for turing (sm75) (#29901) · ce96857f
Jinzhen Lin authored Dec 17, 2025
```
Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
ce96857f

[Bugfix][DSV32] Fix overflow in topk. (#30754) · eaa82a70

Daniel Cámpora authored Dec 16, 2025


Signed-off-by: Daniel Campora <961215+dcampora@users.noreply.github.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

eaa82a70

[Refactor] Small refactor for group topk (#30562) · f21f5ea3

Wentao Ye authored Dec 16, 2025


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

f21f5ea3

12 Dec, 2025 3 commits
- [Refactor] Reduce duplicate code in `per_token_group_quant` cuda kernels (#30496) · 1e6b1153
  Wentao Ye authored Dec 12, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  1e6b1153
- [Attention] Use sparse prefill kernel for fp8 kv-cache in DeepSeek-v3.2 (#27532) · 3e41992f
  Lucas Wilkinson authored Dec 12, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  3e41992f
- gptq marlin quantization support for fused moe with lora (#30254) · 6a6fc41c
  Bhanu Prakash Voutharoja authored Dec 12, 2025
```
Signed-off-by: Bhanu068 <voutharoja.bhanu06@gmail.com>
```
  6a6fc41c
11 Dec, 2025 1 commit
- [Refactor] Remove useless syncwarp (#30510) · 61249b17
  Wentao Ye authored Dec 11, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  61249b17
10 Dec, 2025 2 commits
- [CPU] Support for Whisper (#30062) · cebda2a4
  Aditya Tewari authored Dec 10, 2025
```
Signed-off-by: Aditya Tewari <aditya.tewari@arm.com>
```
  cebda2a4
- Fix typos in comments across multiple files (#30345) · 3bdd4266
  Wilson Wu authored Dec 10, 2025
```
Signed-off-by: Wilson Wu <iwilsonwu@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  3bdd4266
09 Dec, 2025 4 commits
- Improve wvsplitK tile and balance heristics. (#29937) · 2e7054da
  Hashem Hashemi authored Dec 09, 2025
```
Signed-off-by: Hashem Hashemi <hashem.hashemi@amd.com>
```
  2e7054da
- [Kernel]Support W4A8 Grouped GEMM on Hopper (#29691) · f6227c22
  czhu-cohere authored Dec 08, 2025
```
Signed-off-by: czhu-cohere <conway.zhu@cohere.com>
```
  f6227c22
- Lora MoE Align Improvements (#29257) · ea657f20
  gnovack authored Dec 08, 2025
```
Signed-off-by: gnovack <gnovack@amazon.com>
```
  ea657f20
- [Perf] Optimize `group_topk` kernel, 1.9% Throughput improvement, 2.1% TPOT improvemnt (#30159) · 0ee6416f
  Wentao Ye authored Dec 08, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  0ee6416f
08 Dec, 2025 1 commit

[DeepSeek v3.2] Make top-k work for any logit values. (#27568) · 184076c3

Daniel Cámpora authored Dec 08, 2025


Signed-off-by: Daniel Campora <961215+dcampora@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

184076c3

07 Dec, 2025 3 commits

[Performance] Fused blockwise quant RMS norm (#27883) · af0444bf

ElizaWszola authored Dec 07, 2025


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>

af0444bf

[Perf] Deepgemm fused layout kernel for activations, 4.3% throughput... · 541a2ef8

Wentao Ye authored Dec 07, 2025


[Perf] Deepgemm fused layout kernel for activations, 4.3% throughput improvement, 10.7% TTFT improvement. (#29546)
Signed-off-by: yewentao256 <zhyanwentao@126.com>

541a2ef8

[Kernel][MoE] optimize `moe_align_block_size` (#29642) · 879ddb09

Jinzhen Lin authored Dec 07, 2025


Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

879ddb09

05 Dec, 2025 1 commit

[CPU][Perf] Add fast vectorized exp impl from Arm Optimized Routines (#30068) · 9843e332

Elham authored Dec 05, 2025

Signed-off-by: Ubuntu <ubuntu@ip-10-252-30-150.eu-west-1.compute.internal>
Signed-off-by: Elham Harirpoush <elham.harirpoush@arm.com>
Co-authored-by: Ubuntu <ubuntu@ip-10-252-30-150.eu-west-1.compute.internal>

9843e332

02 Dec, 2025 2 commits
- [CPU]Parallelize over tokens in int4 moe (#29600) · 13ea39bc
  Zhang Xiangze authored Dec 02, 2025
```
Signed-off-by: Zhang Xiangze <Xiangze.Zhang@arm.com>
```
  13ea39bc
- SM120 / NVFP4: add device guard and runtime SM dispatch to cutlass_scaled_fp4_mm (#29711) · c0dfc894
  Hendrik Holtmann authored Dec 02, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  c0dfc894
29 Nov, 2025 1 commit

[Kernel][Quantization] add w4a8 support for marlin kernel (#24722) · 1656ad37

Jinzhen Lin authored Nov 29, 2025


Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin@redhat.com>

1656ad37

28 Nov, 2025 1 commit
- [CPU] Update torch 2.9.1 for CPU backend (#29664) · e2f56c30
  Li, Jiang authored Nov 28, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  e2f56c30
27 Nov, 2025 1 commit

[Bugfix] fix IMA issue in certain cases of the moe marlin kernel (#28619) · a67dec7c

Jinzhen Lin authored Nov 27, 2025


Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

a67dec7c

26 Nov, 2025 1 commit
- [Performance][MLA][ROCm] Remove redundant D2D copy in deepseek (#27457) · d9d342d2
  Pleaplusone authored Nov 26, 2025
```
Signed-off-by: ganyi <ygan@amd.com>
```
  d9d342d2
25 Nov, 2025 2 commits

[Kernel] Add NVFP4 MoE CUTLASS support for SM120 (#29242) · e5020986
Michael Goin authored Nov 25, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
e5020986

[Perf][Deepseek] optimize gather_and_maybe_dequant_cache kernel's perf for... · 77e10c9c

Pleaplusone authored Nov 25, 2025


[Perf][Deepseek] optimize gather_and_maybe_dequant_cache kernel's perf for extremely long sequence (#28029)
Signed-off-by: ganyi <ygan@amd.com>

77e10c9c

24 Nov, 2025 1 commit
- [CPU][IBM Z] Fix BF16 support and vectorize math operations for s390x (#28926) · 4de87866
  R3hankhan authored Nov 24, 2025
```
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
```
  4de87866
22 Nov, 2025 2 commits
- [perf][cpu] Accelerate paged attention GEMMs (QK, PV) on Arm CPUs with NEON (#29193) · 730bd353
  Fadi Arafeh authored Nov 22, 2025
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
  730bd353
- Simplify `from_blob` usage in `get_cuda_view_from_cpu_tensor` (#29027) · e6309acd
  Jane (Yuan) Xu authored Nov 22, 2025
```
Signed-off-by: Jane Xu <janeyx@meta.com>
```
  e6309acd
21 Nov, 2025 2 commits

[Perf] These changes enhance the NUMA functionality of vllm for systems with... · f1805db1

skaraban3807 authored Nov 21, 2025


[Perf] These changes enhance the NUMA functionality of vllm for systems with more than one NUMA nodes per socket (#25559)
Signed-off-by: Siddappa Karabannavar <siddappa.karabannavar@amd.com>

f1805db1

[kernel][perf] support uncontiguous input for rms_norm kernel (#28103) · a982f5b5

zhrrr authored Nov 21, 2025


Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
Signed-off-by: izhuhaoran <izhuhaoran@qq.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

a982f5b5

20 Nov, 2025 3 commits
- [ROCm] Add AMD GPU support on Deepseek v3.2 and SparseMLA (#26670) · 06c20c99
  Pleaplusone authored Nov 20, 2025
```
Signed-off-by: ganyi <ygan@amd.com>
```
  06c20c99
- [Bugfix][cache_kernels]: Fix OOB in cache_kernels.cu (#28760) · fb8851f2
  Vensen authored Nov 20, 2025
```
Signed-off-by: vensen <vensenmu@gmail.com>
Signed-off-by: Vensenmu <vensenmu@gmail.com>
```
  fb8851f2
- cleanup at::Tag::needs_fixed_stride_order (#28974) · a903d59f
  Boyuan Feng authored Nov 20, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  a903d59f
19 Nov, 2025 3 commits
- [CI/Build] Fix broken build on Apple M1 (#28999) · bbc6c2f1
  j20120307 authored Nov 19, 2025
```
Signed-off-by: Kan Zhu <j20120307@gmail.com>
```
  bbc6c2f1
- refactor(cpu_types_scalar.hpp): Unify scalar loop implementations using unroll_loop (#28847) · 81516095
  ihb2032 authored Nov 19, 2025
```
Signed-off-by: ihb2032 <1355790728@qq.com>
Co-authored-by: lyd1992 <liuyudong@iscas.ac.cn>
```
  81516095
- [CPU] Refactor CPU WNA16 (#28826) · 20852c8f
  Li, Jiang authored Nov 19, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  20852c8f
17 Nov, 2025 2 commits
- Cast return value to int64_t for cache size (#28814) · e42bd8c2
  tiehexue authored Nov 18, 2025
```
Signed-off-by: tiehexue <tiehexue@hotmail.com>
```
  e42bd8c2
- [CPU][Bugfix] Fix _to_list in CPU model runner (#28824) · 577bb34f
  Li, Jiang authored Nov 17, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  577bb34f