Commits · 421012b63ae2e3f26bba0506e9f3951e9dc53ded · OpenDAS / vllm_cscc

"vscode:/vscode.git/clone" did not exist on "c8c42597abd5c6843fb8b6b02c0f62a5d3f284c8"

22 Jan, 2026 1 commit
- OffloadingConnector: Support kernel_block_size != block_size (#30692) · 421012b6
  Or Ozeri authored Jan 22, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  421012b6
21 Jan, 2026 1 commit
- Update FlashMLA (#32491) · b4f64e5b
  Lucas Wilkinson authored Jan 20, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  b4f64e5b
10 Jan, 2026 1 commit
- Revert "[Kernels][FI] Skip trtllm attention when num_kv_heads=1 (#308… (#31617) · 1c46dea0
  shyeh25 authored Jan 11, 2026
```
Signed-off-by: shyeh25 <206795756+shyeh25@users.noreply.github.com>
```
  1c46dea0
09 Jan, 2026 2 commits

[1/N][Attention] Restructure attention: move files (#31916) · 2612ba92
Matthew Bonanni authored Jan 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
2612ba92

[Bugfix][ROCm]Fix Qwen3-Next-80B-A3B-Thinking inference and optimize... · 1a19e9cd

vllmellm authored Jan 09, 2026


[Bugfix][ROCm]Fix Qwen3-Next-80B-A3B-Thinking inference and optimize non-standard block size (544) support under rocm_atten (#31380)
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>

1a19e9cd

08 Jan, 2026 1 commit

[Misc] Fix `Current vLLM config is not set.` warnings, assert to avoid issues... · 6cdf015c

Lucas Wilkinson authored Jan 08, 2026


[Misc] Fix `Current vLLM config is not set.` warnings, assert to avoid issues in the future (#31747)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

6cdf015c

05 Jan, 2026 2 commits
- [v1] Add encoder-only/cross attention support to Triton Attention backend (#31406) · 6aa5b18e
  Isotr0py authored Jan 06, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  6aa5b18e
- [Platform] Deprecate seed_everything (#31659) · bb4337b3
  wangxiyuan authored Jan 05, 2026
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  bb4337b3
24 Dec, 2025 1 commit
- [Misc] Remove unused custom ops `copy_blocks` and `copy_blocks_mla` (#30967) · 4ed11105
  rongfu.leng authored Dec 24, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  4ed11105
18 Dec, 2025 1 commit

[MM Encoder]: Migrate legacy ViT `MultiHeadAttention` to new... · 700a5ad6

Isotr0py authored Dec 19, 2025


[MM Encoder]: Migrate legacy ViT `MultiHeadAttention` to new `MMEncoderAttention` interface (#30684)
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

700a5ad6

17 Dec, 2025 2 commits
- [Attention] Update tests to remove deprecated env vars (#30563) · 7eb6cb6c
  Matthew Bonanni authored Dec 17, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  7eb6cb6c
- [Kernels][FI] Skip trtllm attention when num_kv_heads=1 (#30842) · a1001522
  Ye (Charlotte) Qi authored Dec 17, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  a1001522
13 Dec, 2025 1 commit

[Feature] Add SM103 (Blackwell Ultra) Support to vLLM (#30484) · 4fa7ce46

Roberto L. Castro authored Dec 13, 2025

Signed-off-by: LopezCastroRoberto <robertol.c510@gmail.com>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

4fa7ce46

12 Dec, 2025 1 commit

[Kernel] Support CUDA Graphs in 3D Triton Attention Kernel (#28306) · 9c0ee995

jvlunteren authored Dec 12, 2025


Signed-off-by: Jan van Lunteren <jvl@zurich.ibm.com>
Signed-off-by: jvlunteren <161835099+jvlunteren@users.noreply.github.com>
Co-authored-by: Thomas Parnell <tom.parnell@gmail.com>
Co-authored-by: Thomas Parnell <tpa@zurich.ibm.com>

9c0ee995

10 Dec, 2025 1 commit
- [cpu][ci] Add CPU Attention Tests for Neon Backend (#30347) · 434ac76a
  Fadi Arafeh authored Dec 10, 2025
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
  434ac76a
09 Dec, 2025 1 commit
- [CI/Build] Make test_mha_attn.py run on correct platform only and check for... · 7618dc97
  rasmith authored Dec 09, 2025
```
[CI/Build] Make test_mha_attn.py run on correct platform only and check for flash_attn_varlen_func in layer.py (#29145)
```
  7618dc97
28 Nov, 2025 1 commit
- [Misc] Remove redundant attention var constants (#29650) · 33b06a6f
  Cyrus Leung authored Nov 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  33b06a6f
25 Nov, 2025 1 commit

[Perf][Deepseek] optimize gather_and_maybe_dequant_cache kernel's perf for... · 77e10c9c

Pleaplusone authored Nov 25, 2025


[Perf][Deepseek] optimize gather_and_maybe_dequant_cache kernel's perf for extremely long sequence (#28029)
Signed-off-by: ganyi <ygan@amd.com>

77e10c9c

24 Nov, 2025 1 commit
- [Core] Deprecate `xformers` (#29262) · 0ff70821
  Roger Wang authored Nov 23, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  0ff70821
21 Nov, 2025 1 commit

[CI/Build] Fix illegal memory access and unsupported test in... · 711241c1

rasmith authored Nov 21, 2025


[CI/Build] Fix illegal memory access and unsupported test in kernels/attention/test_cache.py (#29118)
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>

711241c1

20 Nov, 2025 3 commits

[CI/Build] Make test_attention_selector.py run tests on correct platform (#29064) · 5e5a7eb1

rasmith authored Nov 20, 2025


Signed-off-by: Randall Smith <ransmith@amd.com>
Signed-off-by: rasmith <Randall.Smith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

5e5a7eb1

[CI/Build][AMD] Skip if flash_attn_varlen_func not available in test_aiter_flash_attn.py (#29043) · 3d84ef90
rasmith authored Nov 20, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
3d84ef90
[CI/Build][AMD] Fix import errors in tests/kernels/attention (#29032) · 322cb028
rasmith authored Nov 20, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
322cb028

19 Nov, 2025 2 commits
- [CI/Build] Fix test_prefix_prefill for AMD (#28905) · 68d72319
  Ryan Rock authored Nov 19, 2025
```
Signed-off-by: Ryan Rock <ryan.rock@amd.com>
```
  68d72319
- [Attention] FlashAttention ViT support, make default backend (#28763) · 4c23690f
  Matthew Bonanni authored Nov 18, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  4c23690f
18 Nov, 2025 1 commit
- Replace `torch.cuda.Event` with `torch.Event` for better hardware compatibility (#26985) · 2a2d5d27
  Kunshang Ji authored Nov 19, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  2a2d5d27
14 Nov, 2025 1 commit
- [BugFix] Fix FA3 IMA with FULL_AND_PIECEWISE and cascade attention (default) (#28702) · db56a599
  Lucas Wilkinson authored Nov 14, 2025
  
  db56a599
12 Nov, 2025 1 commit
- [CPU] Refactor CPU attention backend (#27954) · 7f829be7
  Li, Jiang authored Nov 12, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  7f829be7
11 Nov, 2025 2 commits

[CI/Build] Refactor Attention backend for test_prefix_prefill from xformers to SDPA (#28424) · e5534249
Zhewen Li authored Nov 11, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
e5534249

[Attention] Refactor CUDA attention backend selection logic (#24794) · b30dfa03

Matthew Bonanni authored Nov 11, 2025


Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

b30dfa03

10 Nov, 2025 1 commit
- [Test] Remove old non-varlen FA2 test (#28420) · 0bf29fad
  Matthew Bonanni authored Nov 10, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  0bf29fad
08 Nov, 2025 1 commit
- Update Flashinfer from `v0.4.1` to `v0.5.2` (#27952) · 811df41e
  Harry Mellor authored Nov 07, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  811df41e
05 Nov, 2025 1 commit
- [ROCm][MLA] Support block-size > 1 for AITER MLA backend (#27224) · 6cae1e53
  Pleaplusone authored Nov 05, 2025
```
Signed-off-by: ganyi <ygan@amd.com>
Co-authored-by: wuhuikx <hattie.wu@amd.com>
```
  6cae1e53
26 Oct, 2025 1 commit

[Chore]:Extract math and argparse utilities to separate modules (#27188) · 71b1c8b6

Yeshwanth N authored Oct 26, 2025


Signed-off-by: Yeshwanth Surya <yeshsurya@gmail.com>
Signed-off-by: Yeshwanth N <yeshsurya@gmail.com>
Signed-off-by: yeshsurya <yeshsurya@gmail.com>

71b1c8b6

22 Oct, 2025 1 commit

[Chore] Separate out optional dependency checks from vllm.utils (#27207) · 3ae082c3

dongbo910220 authored Oct 22, 2025

Signed-off-by: dongbo910220 <1275604947@qq.com>
Signed-off-by: dongbo910220 <32610838+dongbo910220@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

3ae082c3

18 Oct, 2025 2 commits

[Chore] Clean up pytorch helper functions in `vllm.utils` (#26908) · 6ac5e06f
Isotr0py authored Oct 19, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: isotr0py <2037008807@qq.com>
```
6ac5e06f

[Chore] Separate out `vllm.utils.mem_utils` (#27143) · 1d165d6d

iAmir97 authored Oct 18, 2025

Signed-off-by: iAmir97 <Amir.balwel@embeddedllm.com>
Signed-off-by: iAmir97 <71513472+iAmir97@users.noreply.github.com>
Co-authored-by: iAmir97 <Amir.balwel@embeddedllm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

1d165d6d

12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
09 Oct, 2025 2 commits
- [Flashinfer][gpt-oss] Support FP8-qkv Flashinfer TRTLLM Sinks Attention (#25674) · 44f633db
  elvischenv authored Oct 10, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  44f633db
- [Bugfix] Move current_platform import to avoid python import cache. (#16601) · ec10fd0a
  Wenzheng Bi authored Oct 09, 2025
```
Signed-off-by: iwzbi <wzbi@zju.edu.cn>
```
  ec10fd0a