Commits · f4b42df04847dcbd3247f7f4c56dff45e40bdf0d · OpenDAS / vllm_cscc

15 Apr, 2026 1 commit

[Attention Backend] TurboQuant: 2-bit KV cache compression with 4x capacity (#38479) · f4b42df0

Vibhav Agarwal authored Apr 15, 2026


Signed-off-by: vibhavagarwal5 <vibhavagarwal5@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Xinyu Chen <xinyu1.chen@intel.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

f4b42df0

13 Apr, 2026 1 commit

[Bugfix] Use is_integrated to detect UMA GPUs for memory reporting (#35356) · 995e9a20

haosdent authored Apr 14, 2026


Signed-off-by: haosdent <haosdent@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

995e9a20

10 Apr, 2026 1 commit
- Add platform manual_seed_all API (#38468) · ec68d53b
  Yan Ma authored Apr 10, 2026
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
  ec68d53b
09 Apr, 2026 1 commit

Fix NUMA binding on non-CDMM Grace-Blackwell systems (#39361) · ed733802

Qidong Su authored Apr 09, 2026


Signed-off-by: Qidong Su <soodoshll@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

ed733802

08 Apr, 2026 1 commit

[Feature] NUMA binding support for GPU workers (#38635) · 75e01a39

Shengqi Chen authored Apr 09, 2026


Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
Co-authored-by: Jason Li <jasonlizhengjian@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

75e01a39

01 Apr, 2026 2 commits

[1/N][Cleanup] Standardize on use of `is_quantized_kv_cache` (#38659) · 116f4be4
Matthew Bonanni authored Apr 01, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
116f4be4

[vLLM IR] 1/N Implement IR skeleton and rms_norm op (#33825) · 40bb1750

Luka Govedič authored Mar 31, 2026


Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Xinyu Chen <xinyu1.chen@intel.com>
Signed-off-by: chzhang <chaojun.zhang@intel.com>
Signed-off-by: Luka Govedic <luka.govedic@gmail.com>
Co-authored-by: Xinyu Chen <xinyu1.chen@intel.com>
Co-authored-by: Chaojun Zhang <chaojun.zhang@intel.com>
Co-authored-by: Luka Govedič <ProExpertProg@h100-01.nemg-001.lab.rdu2.dc.redhat.com>

40bb1750

31 Mar, 2026 1 commit

replace cuda_device_count_stateless() to current_platform.device_count() (#37841) · 4dfad17e

wliao2 authored Mar 31, 2026


Signed-off-by: Liao, Wei <wei.liao@intel.com>
Signed-off-by: wliao2 <wei.liao@intel.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>

4dfad17e

20 Mar, 2026 1 commit
- refactor: abstract deepgemm support into platform (#37519) · 6ec5e9fd
  SherryC41 authored Mar 21, 2026
```
Co-authored-by: sherryC41 <sherry.c.c41@gmail.com>
```
  6ec5e9fd
19 Mar, 2026 1 commit
- [1/n] Migrate permute_cols to libtorch stable ABI (#31509) · 8b10e4fb
  mikaylagawarecki authored Mar 19, 2026
```
Signed-off-by: Mikayla Gawarecki <mikaylagawarecki@gmail.com>
```
  8b10e4fb
18 Mar, 2026 1 commit
- [Log] Reduce duplicate log (#37313) · c373b5c0
  Wentao Ye authored Mar 18, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c373b5c0
17 Mar, 2026 1 commit
- [Perf] Set Flashinfer sparse MLA as default backend for FP8 kv cache (#37252) · b36adfa3
  Wei Zhao authored Mar 17, 2026
```
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
```
  b36adfa3
09 Mar, 2026 2 commits
- Reapply [Attention] Refactor `check_and_update_config` (#35122) · 77a73458
  Matthew Bonanni authored Mar 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  77a73458
- [MM Encoder] Default to use TORCH_SDPA backend for ViT on Volta/Turing GPU (#36472) · b0906d8b
  Isotr0py authored Mar 09, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  b0906d8b
05 Mar, 2026 1 commit
- Add platform method to enable custom collective ops registration (#34760) · 792cbd64
  nkm-meta authored Mar 04, 2026
```
Signed-off-by: Naina Kuruballi Mahesh <nainakm@meta.com>
```
  792cbd64
28 Feb, 2026 1 commit

[1/N] Elastic EP Milestone 2 (#34861) · dea26833

Itay Alroy authored Feb 28, 2026


Signed-off-by: Yongji Wu <wuyongji317@gmail.com>
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: Ron Tourgeman <rtourgeman@nvidia.com>
Co-authored-by: Yongji Wu <wuyongji317@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Ron Tourgeman <rtourgeman@nvidia.com>

dea26833

27 Feb, 2026 1 commit

Flashinfer cuDNN backend for Qwen3 VL ViT attention (#34580) · 9c3fe993

Max Hu authored Feb 27, 2026


Signed-off-by: Max Hu <maxhu@nvidia.com>
Signed-off-by: Max Hu <hyoung2991@gmail.com>
Co-authored-by: Max Hu <maxhu@nvidia.com>
Co-authored-by: Shang Wang <shangw@nvidia.com>

9c3fe993

25 Feb, 2026 1 commit
- [Platform] Add current_platform.num_compute_units interface (#35042) · 8ad54a99
  Kunshang Ji authored Feb 25, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
```
  8ad54a99
20 Feb, 2026 1 commit
- [CI] Revert PRs 34818 and 33600 (#34979) · aaefc58e
  Lucas Wilkinson authored Feb 20, 2026
  
  aaefc58e
19 Feb, 2026 1 commit

[Bugfix] Fix Basic Models Test (#34818) · 662205d3

Matthew Bonanni authored Feb 19, 2026


Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

662205d3

18 Feb, 2026 1 commit
- [Attention] Refactor `check_and_update_config` (#33600) · 77431529
  Matthew Bonanni authored Feb 17, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  77431529
15 Feb, 2026 1 commit
- [MM Encoder] Add Triton ViT attention backend (#32183) · 71cd8926
  Isotr0py authored Feb 15, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  71cd8926
12 Feb, 2026 1 commit

[Attention] Add FlashInfer Sparse MLA backend (#33451) · f2c47886

Matthew Bonanni authored Feb 12, 2026


Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>

f2c47886

04 Feb, 2026 1 commit
- [rocm][ray] Fix: Unify Ray device visibility handling across CUDA and ROCm (#33308) · 2f6d17cb
  kourosh hakhamaneshi authored Feb 04, 2026
```
Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>
```
  2f6d17cb
02 Feb, 2026 1 commit
- [UX] Format attention backend log line (#33570) · 5d1aef30
  Matthew Bonanni authored Feb 02, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  5d1aef30
30 Jan, 2026 1 commit

[Misc] Replace Optional[X] with X | None syntax (#33332) · 1a7894db

杨朱 · Kiki authored Jan 30, 2026


Signed-off-by: carlory <baofa.fan@daocloud.io>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>

1a7894db

23 Jan, 2026 1 commit

fix: Add glm4_moe_lite to MLA detection (#32614) · 586a57ad

Markus / Mark authored Jan 23, 2026


Signed-off-by: marksverdhei <marksverdhei@hotmail.com>
Signed-off-by: Markus / Mark <46672778+marksverdhei@users.noreply.github.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

586a57ad

19 Jan, 2026 1 commit

[Attention][MLA] Make FLASHINFER_MLA the default MLA backend on Blackwell, and... · 1a1fc3bb

Matthew Bonanni authored Jan 19, 2026


[Attention][MLA] Make FLASHINFER_MLA the default MLA backend on Blackwell, and TRTLLM the default prefill (#32615)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

1a1fc3bb

17 Jan, 2026 1 commit
- Revert "[Attention][MLA] Make `FLASHINFER_MLA` the default MLA backen… (#32484) · 2e7c89e7
  Matthew Bonanni authored Jan 16, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  2e7c89e7
15 Jan, 2026 1 commit

[Attention][MLA] Make `FLASHINFER_MLA` the default MLA backend on Blackwell,... · 8ebfacaa

Matthew Bonanni authored Jan 15, 2026


[Attention][MLA] Make `FLASHINFER_MLA` the default MLA backend on Blackwell, and TRTLLM the default prefill (#32339)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

8ebfacaa

09 Jan, 2026 1 commit
- [1/N][Attention] Restructure attention: move files (#31916) · 2612ba92
  Matthew Bonanni authored Jan 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  2612ba92
15 Dec, 2025 2 commits

[Platform] Refactor Platform attention backend selection to avoid breakpoint... · ec154c36

Isotr0py authored Dec 16, 2025


[Platform] Refactor Platform attention backend selection to avoid breakpoint for OOT platform (#30212)
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

ec154c36

[CustomOp][MM] Extract MMEncoderAttention as CustomOp and replace the backend... · 87b4d155

Shanshan Shen authored Dec 15, 2025


[CustomOp][MM] Extract MMEncoderAttention as CustomOp and replace the backend of QwenVisionAttention with it. (#30125)
Signed-off-by: shen-shanshan <467638484@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>