Commits · a810671a261997b5d95fee7868d79514844e6e81 · OpenDAS / vllm_cscc · GitLab

18 Dec, 2025 2 commits
- [XPU] allow custom workers (e.g. vllm-omni workers) to be used on XPU (#30935) · 058926d4
  Fanli Lin authored Dec 19, 2025
```
Signed-off-by: Fanli Lin <fanli.lin@intel.com>
```
  058926d4
- skip fp32_precision and static_scaled_fp8_quant, set VLLM_USE_BYTECODE_HOOK=0 · e9660f3a
  zhuwenwen authored Dec 18, 2025
  
  e9660f3a
16 Dec, 2025 1 commit
- [ROCm] [AITER] [DOC] Add usage description about check functions in `_aiter_ops` (#30586) · d0fb5729
  TJian authored Dec 16, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  d0fb5729
15 Dec, 2025 2 commits

[Platform] Refactor Platform attention backend selection to avoid breakpoint... · ec154c36

Isotr0py authored Dec 16, 2025


[Platform] Refactor Platform attention backend selection to avoid breakpoint for OOT platform (#30212)
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

ec154c36

[CustomOp][MM] Extract MMEncoderAttention as CustomOp and replace the backend... · 87b4d155

Shanshan Shen authored Dec 15, 2025


[CustomOp][MM] Extract MMEncoderAttention as CustomOp and replace the backend of QwenVisionAttention with it. (#30125)
Signed-off-by: shen-shanshan <467638484@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>

87b4d155

13 Dec, 2025 2 commits

[Logs] Optimize startup logs 4 (#29903) · 6e78ed6b

Wentao Ye authored Dec 13, 2025

Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

6e78ed6b

[Feature] Add SM103 (Blackwell Ultra) Support to vLLM (#30484) · 4fa7ce46

Roberto L. Castro authored Dec 13, 2025

Signed-off-by: LopezCastroRoberto <robertol.c510@gmail.com>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

4fa7ce46

12 Dec, 2025 1 commit
- [CPU][FIX] Fix build failures on Arm CPUs with torch nightly (#30481) · f355ad54
  Fadi Arafeh authored Dec 12, 2025
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
  f355ad54
11 Dec, 2025 1 commit
- [ROCm] Fix broken import in platform attention backend dispatching (#30432) · b51255f3
  Andreas Karatzas authored Dec 10, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  b51255f3
09 Dec, 2025 1 commit
- [ROCm] Aiter Quant Kernels (#25552) · ee14644b
  vllmellm authored Dec 09, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  ee14644b
07 Dec, 2025 3 commits
- [BugFix][DeepSeek-V3.2] Fix backend selection logic for Blackwell (#30195) · 0044c403
  Lucas Wilkinson authored Dec 07, 2025
  
  0044c403
- [v1] Add PrefixLM support to FlexAttention backend (#27938) · b952f4d3
  Isotr0py authored Dec 07, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  b952f4d3
- [Perf] Enable cuda graph for deepepHT, 5.3% throughput improvement, 4.4% TTFT improvement (#29558) · 17eb25e3
  Wentao Ye authored Dec 06, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  17eb25e3
05 Dec, 2025 2 commits

[Attention][UX][1/N] Add AttentionConfig and change attention env vars to CLI arguments (#26315) · 66e674cd

Matthew Bonanni authored Dec 05, 2025

Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>

66e674cd

[PCP&DCP] move CUDAGraph check for PCP&DCP to the check func of platforms (#29952) · 0098a6e3
Qiu authored Dec 05, 2025
```
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
0098a6e3

04 Dec, 2025 1 commit
- [Bugfix][CPU] Fix CPU KV cache fallback memory allocation (#29604) · 28097d56
  gausah01 authored Dec 04, 2025
```
Signed-off-by: Gauri Sahnan <gauri.sahnan@arm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
```
  28097d56
28 Nov, 2025 1 commit
- [CPU] Update torch 2.9.1 for CPU backend (#29664) · e2f56c30
  Li, Jiang authored Nov 28, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  e2f56c30
27 Nov, 2025 3 commits
- [Bugfix][MM encoder] Fix ViT attention backend resolving for Turing GPU (#29614) · 38658ec6
  Isotr0py authored Nov 28, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  38658ec6
- [Attention] Update attention imports (#29540) · fc1d8be3
  Matthew Bonanni authored Nov 27, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  fc1d8be3
- Fix tpu-inference platform path (#29554) · 3ecabd06
  Johnny Yang authored Nov 26, 2025
```
Signed-off-by: Johnny Yang <johnnyyang@google.com>
```
  3ecabd06
26 Nov, 2025 2 commits
- [TPU] add tpu_inference (#27277) · ba1fcd84
  Johnny Yang authored Nov 26, 2025
```
Signed-off-by: Johnny Yang <johnnyyang@google.com>
```
  ba1fcd84
- [Attention] Remove imports from `vllm/attention/__init__.py` (#29342) · 430dd4d9
  Matthew Bonanni authored Nov 26, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  430dd4d9
25 Nov, 2025 4 commits
- [UX] Put CUDA attention backend selection log into one line (#29337) · dbc3d999
  Michael Goin authored Nov 25, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  dbc3d999
- [ROCm][CI] Fix test_cudagraph_mode failure in AMD CI (#29367) · ef1f7030
  Micah Williamson authored Nov 25, 2025
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
  ef1f7030
- Allow oot custom compiler extension via CompilerInterface (#28623) · 888152bf
  Icey authored Nov 25, 2025
```
Signed-off-by: wxsIcey <1790571317@qq.com>
Signed-off-by: Mengqing Cao <cmq0113@163.com>
Signed-off-by: Icey <1790571317@qq.com>
Co-authored-by: Mengqing Cao <cmq0113@163.com>
```
  888152bf
- [Bugfix] [ROCm] [UX]: revert Flex attention backend (#29371) · 64deead7
  vllmellm authored Nov 25, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  64deead7
24 Nov, 2025 2 commits
- [Bugfix] [ROCm] [UX] Reorganize ROCm Backend Selection Logic (#26980) · e48b2e68
  vllmellm authored Nov 24, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  e48b2e68
- [Core] Deprecate `xformers` (#29262) · 0ff70821
  Roger Wang authored Nov 23, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  0ff70821
21 Nov, 2025 2 commits
- [NIXL] Fix after virtual block_size for host_buffer with heter kv_layout (#29122) · 460d02a4
  Chendi.Xue authored Nov 21, 2025
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
```
  460d02a4
- [Attention] Add ROCM_AITER_MLA_SPARSE to attention backend registry (#29103) · 11857a00
  Matthew Bonanni authored Nov 20, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  11857a00
20 Nov, 2025 1 commit
- [ROCm] Add AMD GPU support on Deepseek v3.2 and SparseMLA (#26670) · 06c20c99
  Pleaplusone authored Nov 20, 2025
```
Signed-off-by: ganyi <ygan@amd.com>
```
  06c20c99
19 Nov, 2025 3 commits
- Upstreaming aiter triton attention backend as a new backend (#28701) · ac10fd3c
  Aleksandr Malyshev authored Nov 19, 2025
```
Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>
```
  ac10fd3c
- [Attention] FlashAttention ViT support, make default backend (#28763) · 4c23690f
  Matthew Bonanni authored Nov 18, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  4c23690f
- Enable bitsandbytes quantization on AMD GPUs that use warp size 32 (#27307) · 814843e0
  Strahinja Stamenkovic authored Nov 19, 2025
```
Signed-off-by: sstamenk <strahinja.stamenkovic@amd.com>
```
  814843e0
15 Nov, 2025 2 commits
- [Misc] Make `SchedulerConfig.max_model_len` init-only (#28733) · 638e4196
  Cyrus Leung authored Nov 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  638e4196
- [TPU] Fix import error in tpu launch (#28758) · 9fc81ec7
  QiliangCui authored Nov 14, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  9fc81ec7
14 Nov, 2025 2 commits
- [Chore] Rename `SchedulerConfig.chunked_prefill_enabled` (#28735) · e2741f6c
  Cyrus Leung authored Nov 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e2741f6c
- [Config] Clean up SchedulerConfig initialization (#28665) · 511a6b61
  Cyrus Leung authored Nov 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  511a6b61
13 Nov, 2025 2 commits
- [CI Failure] Fix backend selection for encoder-only models (#28534) · 07a606aa
  Huamin Li authored Nov 13, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  07a606aa
- [XPU] Support Triton path for LoRA operations on XPU (#28511) · dbbe0c75
  Fanli Lin authored Nov 13, 2025
```
Signed-off-by: Fanli Lin <fanli.lin@intel.com>
```
  dbbe0c75