Commits · 9bb38130cb19eb084d39f269cbeae2952789fafd · OpenDAS / vllm_cscc

10 Oct, 2025 1 commit
- [deepseek] kernel block size for UniformTypeKVCacheSpecs (#26559) · 6f0f570c
  Chen Zhang authored Oct 10, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  6f0f570c
09 Oct, 2025 5 commits
- [Bugfix] Fix CUDA graph selection bug in FlashInfer at high concurrency (#26499) · 6e783bc5
  Benjamin Chislett authored Oct 09, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  6e783bc5
- [Attention][DCP] Support DCP with query length > 1 (MTP) with FA3 (#25049) · 3b736e1c
  Ming Yang authored Oct 09, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  3b736e1c
- Bump Flashinfer to v0.4.0 (#26326) · 5e49c3e7
  elvischenv authored Oct 09, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  5e49c3e7
- [Hybrid]: Decouple Kernel Block Size from KV Page Size (#24486) · d24cf322
  Zhiyuan Li authored Oct 09, 2025
```
Signed-off-by: lizhiyuan <uniartisan2017@gmail.com>
Signed-off-by: Zhiyuan Li <uniartisan2017@gmail.com>
```
  d24cf322
- Separate MLAAttention class from Attention (#25103) · e614ab78
  Naveenraj Kamalakannan authored Oct 08, 2025
```
Signed-off-by: Naveenraj Kamalakannan <therealnaveenkamal@gmail.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  e614ab78
08 Oct, 2025 4 commits

[Attention] Register FLASHMLA_SPARSE (#26441) · 2a03f93d
Matthew Bonanni authored Oct 08, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
2a03f93d

[Bugfix][Flashinfer] fix VLLM_USE_TRTLLM_ATTENTION issue for models with diff... · b82f4307

elvischenv authored Oct 09, 2025


[Bugfix][Flashinfer] fix VLLM_USE_TRTLLM_ATTENTION issue for models with diff hyperparameters (#25924)
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>

b82f4307

[TPU] Rename tpu_commons to tpu_inference (#26279) · 335b28f7

Utkarsh Sharma authored Oct 08, 2025


Signed-off-by: Utkarsh Sharma <utksharma@google.com>
Co-authored-by: Utkarsh Sharma <utksharma@google.com>
Co-authored-by: Chengji Yao <chengjiyao@google.com>

335b28f7

[Misc] Clean up cruft from previous FlashMLA sparse implementation (#26125) · f80e7866
Lucas Wilkinson authored Oct 07, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
f80e7866

07 Oct, 2025 2 commits
- [Spec Decode] Enable efficient speculative decoding with FlashInfer-MLA (#25984) · 3d1f6761
  Benjamin Chislett authored Oct 07, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  3d1f6761
- [Bugfix] Add missing sink tensor into flash attn cascade attn implementation (#26325) · eb577e46
  Pei-Lun Liao authored Oct 07, 2025
  
  eb577e46
06 Oct, 2025 6 commits
- [Perf] Add decode full-graph support to FlashInfer-MLA backend (#26313) · f77df946
  Benjamin Chislett authored Oct 06, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  f77df946
- [ROCm] Split AITER unified attention into its own backend (#25507) · f231e5bc
  Gregory Shtrasberg authored Oct 06, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  f231e5bc
- [Attention] Remove unused reorder_batch method (#24463) · 4727a8af
  Matthew Bonanni authored Oct 06, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  4727a8af
- [Misc] Clean up unnecessary E501 ignore (#26274) · 43c146ca
  Roger Wang authored Oct 06, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  43c146ca
- Fix per file ruff ignores related to line length (#26262) · 6c046382
  Harry Mellor authored Oct 06, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6c046382
- [V1] [Hybrid] Some additional clean-up in Mamba2 prefix caching (#26222) · 778f5541
  Thomas Parnell authored Oct 06, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  778f5541
05 Oct, 2025 3 commits
- Fix per file ruff ignores related to typing (#26254) · 1c0c6820
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  1c0c6820
- Remove all references to `yapf` as it's no longer used (#26251) · 4e256cad
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4e256cad
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
04 Oct, 2025 4 commits

[CPU] Refine batch reorder of CPU attention backend (#26096) · 5c057e06
Li, Jiang authored Oct 04, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
5c057e06
Revert "Add batch invariant kernel override for FlashInfer backend [2/n]" (#26220) · 1838cd48
Cyrus Leung authored Oct 04, 2025

1838cd48

[V1] [Hybrid] Mamba2 Automatic Prefix Caching (#25752) · ea507c3a

Stan Wozniak authored Oct 04, 2025


Signed-off-by: Stanislaw Wozniak <stw@zurich.ibm.com>
Signed-off-by: Thomas Ortner <boh@zurich.ibm.com>
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Thomas Ortner <boh@zurich.ibm.com>
Co-authored-by: Thomas Parnell <tpa@zurich.ibm.com>

ea507c3a

Add batch invariant kernel override for FlashInfer backend [2/n] (#25769) · 2f7dbc9b

Bram Wasti authored Oct 03, 2025


Signed-off-by: Bram Wasti <bwasti@meta.com>
Signed-off-by: Bram Wasti <bwasti@fb.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

2f7dbc9b

03 Oct, 2025 2 commits
- [backends][short_conv] CUDA graph piecewise edits (#24215) · 5f42fc53
  Paul Pak authored Oct 03, 2025
```
Signed-off-by: Paul Pak <paulpak58@gmail.com>
```
  5f42fc53
- Quick fix for IMA with the Prefix Prefill kernel during graph capture (#25983) · 5f2cacdb
  Sage Moore authored Oct 03, 2025
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  5f2cacdb
02 Oct, 2025 4 commits

[Bugfix] Disable cascade attention with FlashInfer (#26130) · f1fc2107

Michael Goin authored Oct 02, 2025

Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

f1fc2107

[Deepseek v3.2] Support indexer prefill chunking (#25999) · 1e50f1be
Chen Zhang authored Oct 02, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
1e50f1be

[BugFix] Fix FI accuracy issue when used for MLA prefill (#26063) · decf7f79

Lucas Wilkinson authored Oct 02, 2025

Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

decf7f79

[ROCm][Bugfix] Add missing parameter to ROCm backend (#26029) · 0b018d8b
Gregory Shtrasberg authored Oct 01, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
0b018d8b

01 Oct, 2025 2 commits
- Fix test_mamba_ssm_ssd.py due to missing _query_start_loc_to_chunk_indices_offsets (#25995) · c36f0aa3
  Huamin Li authored Oct 01, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  c36f0aa3
- [Model] MTP fallback to eager for DeepSeek v32 (#25982) · 001e50c9
  Lucia Fang authored Sep 30, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
```
  001e50c9
30 Sep, 2025 1 commit

[New Model] DeepSeek-V3.2 (Rebased to Main) (#25896) · fa7e254a

Yongye Zhu authored Sep 30, 2025


Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>
Signed-off-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Xiaozhu Meng <mxz297@gmail.com>
Co-authored-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>

fa7e254a

29 Sep, 2025 1 commit
- [Kernel] Chunk-aligned mamba2 (#24683) · fea3e476
  Thomas Parnell authored Sep 29, 2025
  
  fea3e476
26 Sep, 2025 4 commits
- Kernel-override Determinism [1/n] (#25603) · dc48ba0c
  Bram Wasti authored Sep 26, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
```
  dc48ba0c
- [Model] Mamba2 varlen refactor (#21467) · 2b6b1d78
  Chih-Chieh Yang authored Sep 26, 2025
```
Signed-off-by: Chih-Chieh-Yang <7364402+cyang49@users.noreply.github.com>
Co-authored-by: RishiAstra <40644327+RishiAstra@users.noreply.github.com>
```
  2b6b1d78
- Remove cuda hard-code in compute_causal_conv1d_metadata (#25555) · dd70437a
  Icey authored Sep 26, 2025
```
Signed-off-by: Icey <1790571317@qq.com>
```
  dd70437a
- [Qwen3-Next][GDN] fixes cuda graph capturing bug in GDN metadata and a stride... · 99b3a504
  Tao He authored Sep 26, 2025
```
[Qwen3-Next][GDN] fixes cuda graph capturing bug in GDN metadata and a stride bug in causal_conv_1d. (#25743)
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
```
  99b3a504
25 Sep, 2025 1 commit
- [V0 deprecation] Remove _VLLM_V1 suffixes from attention backend names (#25489) · 3468f17e
  Matthew Bonanni authored Sep 25, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  3468f17e