Commits · e0919f331d12dc5dbdefd0775bb6f94dd2fab4e2 · OpenDAS / vllm_cscc

07 Nov, 2025 1 commit
- [Core][MM] Add mechanism to configure multimodal fields which should stay on CPU (#28168) · e0919f33
  Lukas Geiger authored Nov 07, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  e0919f33
01 Nov, 2025 2 commits

[CI/Build] Bump transformers version (#27528) · 879a0657

Cyrus Leung authored Nov 01, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

879a0657

[Multimodal][XPU]Enable vision attn backend for xpu platform (#27525) · 7e2729b5

Yan Ma authored Nov 01, 2025


Signed-off-by: Yan Ma <yan.ma@intel.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Yejing Lai <yejing.lai@intel.com>
Co-authored-by: Guancheng Fu <110874468+gc-fu@users.noreply.github.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>

7e2729b5

27 Oct, 2025 1 commit
- [Model] Use merge_by_field_config for MM models (Qwen series) (#27546) · cbd5e07a
  Cyrus Leung authored Oct 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  cbd5e07a
26 Oct, 2025 1 commit

[BUGFIX][ROCM] ViT FlashAttention on ROCm (no GFX9) and contiguous on qwen3vl... · 65d2cf95

JartX authored Oct 26, 2025


[BUGFIX][ROCM] ViT FlashAttention on ROCm (no GFX9) and contiguous on qwen3vl ROCm TORCH_SDPA (#27190)
Signed-off-by: JartX <sagformas@epdcenter.es>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>

65d2cf95

24 Oct, 2025 1 commit
- [MM][Bugfix] Replace `PatchEmbed`'s conv3d to linear layer (#27418) · 42efe609
  Isotr0py authored Oct 24, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  42efe609
23 Oct, 2025 1 commit

[Bugfix] Honor --mm_encoder_attn_backend when used (#27124) · 570c3e1c

Bradley D authored Oct 23, 2025


Co-authored-by: Bradley D <4551889+bradleyhd@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

570c3e1c

21 Oct, 2025 1 commit
- [MM][Core] Decouple ViT backend from LM backend (#27061) · c3a2c6ac
  Roger Wang authored Oct 21, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  c3a2c6ac
18 Oct, 2025 1 commit
- [Models][QwenVL] Remove unnecessary `.contiguous()` calls (#27106) · 5c2acb27
  Lukas Geiger authored Oct 18, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  5c2acb27
14 Oct, 2025 1 commit
- [Bugfix] Standardize merging multimodal embeddings (#26771) · d2f816d6
  Cyrus Leung authored Oct 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d2f816d6
12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
05 Oct, 2025 1 commit
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
04 Oct, 2025 1 commit

Fix tensor device and dtype placement in Qwen2VL model (#26219) · 86ee9491

yuafng authored Oct 04, 2025


Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Yuanfeng Li <yuanfengli@meta.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

86ee9491

03 Oct, 2025 4 commits

[BugFix][QWEN-VL]fix wrong apply_rotary_emb_torch selection introduced by #24642 (#26123) · dd96465f

Chendi.Xue authored Oct 03, 2025


Signed-off-by: Chendi Xue <Chendi.Xue@intel.com>
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

dd96465f

[Multi Modal] Configurable MM Profiling (#25631) · 79aa2446

Wenlong Wang authored Oct 03, 2025

Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

79aa2446

[ROCm] [VL] [Bugfix] Fix vit flash attn dispatcher logic for ROCm (#26104) · 9c5ee91b
TJian authored Oct 02, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
9c5ee91b
[Attention] Move Backend enum into registry (#25893) · 2aaa4238
Matthew Bonanni authored Oct 02, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
2aaa4238

02 Oct, 2025 1 commit
- [Qwen][ROCm] Flash Attention Rotary Embeddings (#24642) · 5e4a8223
  vllmellm authored Oct 02, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  5e4a8223
29 Sep, 2025 1 commit
- [V0 Deprecation][Models] Remove all V0 condition for mm embeddings merge (#25331) · bd51f78e
  Isotr0py authored Sep 29, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: isotr0py <2037008807@qq.com>
```
  bd51f78e
28 Sep, 2025 1 commit

[VLM] Update Qwen3-VL max_num_video_tokens calculation for configurable video profiling (#25557) · 0efd540d

Isotr0py authored Sep 28, 2025


Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>

0efd540d

27 Sep, 2025 1 commit

[Bugfix] Merge MM embeddings by index instead of token IDs (#16229) · 27d7638b

Cyrus Leung authored Sep 27, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

27d7638b

26 Sep, 2025 1 commit
- [Quantization] Add field to skip unquantized modules for GPTQ config (#25455) · d4d98998
  Isotr0py authored Sep 26, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  d4d98998
25 Sep, 2025 1 commit
- [Bugfix] Fix Qwen3-VL max_num_video_tokens calculation for video profiling (#25648) · 17b4c668
  Isotr0py authored Sep 25, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  17b4c668
23 Sep, 2025 2 commits
- [Misc] Move DP for ViT code inside model executor dir (#25459) · babad6e5
  Cyrus Leung authored Sep 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  babad6e5
- [Model] Enable DP for ViT in Qwen2-VL (#25445) · c98be0a2
  Cyrus Leung authored Sep 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c98be0a2
21 Sep, 2025 2 commits
- [V0 Deprecation] Remove V0 sampling metadata (#25345) · 1c3ffdbe
  Woosuk Kwon authored Sep 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  1c3ffdbe
- [Multi Modal][Performance] Fused Q,K's apply_rope in more models (#25005) · 035fd2bd
  Wenlong Wang authored Sep 20, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  035fd2bd
18 Sep, 2025 1 commit

[feat]: Create interface for model-specific M-RoPE (#24194) · 38db529f

Aziz authored Sep 18, 2025

Signed-off-by: AzizCode92 <azizbenothman76@gmail.com>
Signed-off-by: Aziz <azizbenothman76@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

38db529f

17 Sep, 2025 1 commit

[Model] Support Qwen3-VL Model Series (#24727) · 0f7acdd7

Roger Wang authored Sep 16, 2025


Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Huang Jie <92386084+JJJYmmm@users.noreply.github.com>
Co-authored-by: 松灵 <26085463+wulipc@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

0f7acdd7

13 Sep, 2025 1 commit
- [Docs] Fix warnings in mkdocs build (continued) (#24791) · 9a8966bc
  Hyogeun Oh (오효근) authored Sep 13, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
```
  9a8966bc
12 Sep, 2025 2 commits
- [Models] Optimise and simplify `_validate_and_reshape_mm_tensor` (#24742) · 57f94e88
  Lukas Geiger authored Sep 12, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  57f94e88
- [Multi Modal] Add FA3 in VIT (#24347) · 72fc8aa4
  Wenlong Wang authored Sep 12, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
  72fc8aa4
08 Sep, 2025 1 commit
- [Model] Remove unnecessary CUDA sync of Qwen2VL image and video preprocess (#24334) · 60f0843e
  Chatcharin Sangbutsarakum authored Sep 08, 2025
```
Signed-off-by: Win <chatcharinsang@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  60f0843e
07 Sep, 2025 1 commit

Migrate Qwen2 inputs to TensorSchema (#23475) · 37a6fa95

Benji Beck authored Sep 06, 2025


Signed-off-by: Benji Beck <benjibeck@meta.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

37a6fa95

06 Sep, 2025 1 commit
- [Multimodal] Improve max video embedding length estimation in V1 (#24312) · eddaafc1
  Roger Wang authored Sep 06, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Roger Wang <hey@rogerw.me>
```
  eddaafc1
22 Aug, 2025 1 commit

[BugFix] Fix the issue where image embeddings were incorrectly split.… (#23366) · 424fb7a5

bppps authored Aug 23, 2025


Signed-off-by: bppps <bpppsaka@gmail.com>
Co-authored-by: zouyu.zzx <zouyu.zzx@alibaba-inc.com>
Co-authored-by: bppps <bpppsaka@gmail.com>

424fb7a5

19 Aug, 2025 1 commit

[FEAT] [Performance] Enable DP for ViT in Qwen2.5VL (#22742) · 1298c677

TJian authored Aug 19, 2025


Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

1298c677

18 Aug, 2025 1 commit
- [Refactor] Define MultiModalKwargsItems separate from MultiModalKwargs (#23053) · 27e8d1ea
  Cyrus Leung authored Aug 18, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  27e8d1ea
17 Aug, 2025 1 commit
- [Misc] Remove dead return (#23061) · c55bc1db
  Woosuk Kwon authored Aug 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  c55bc1db
09 Aug, 2025 1 commit

Implicit language-model-only mode via limit-mm-per-prompt (#22299) · 08b751ba

Roger Wang authored Aug 08, 2025


Signed-off-by: Roger Wang <hey@rogerw.me>
Signed-off-by: Andy Xie <andy.xning@gmail.com>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
Signed-off-by: Shu Wang <shuw@nvidia.com>
Signed-off-by: Po-Han Huang <pohanh@nvidia.com>
Signed-off-by: Shu Wang. <shuw@nvidia.com>
Signed-off-by: XIn Li <xinli@nvidia.com>
Signed-off-by: Junhao Li <junhao@ubicloud.com>
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: zitian.zhao <zitian.zhao@tencentmusic.com>
Signed-off-by: zitian zhao <zitian.zhao@tencentmusic.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: iAmir97 <Amir.balwel@embeddedllm.com>
Signed-off-by: iAmir97 <71513472+iAmir97@users.noreply.github.com>
Signed-off-by: Linkun <github@lkchen.net>
Co-authored-by: Ning Xie <andy.xning@gmail.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
Co-authored-by: Andrew Sansom <andrew@protopia.ai>
Co-authored-by: Zhiyu <zhiyuc@nvidia.com>
Co-authored-by: Shu Wang <shuw@nvidia.com>
Co-authored-by: XIn Li <xinli@nvidia.com>
Co-authored-by: Junhao Li <streaver91@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
Co-authored-by: Yuxuan Zhang <2448370773@qq.com>
Co-authored-by: ZiTian Zhao <zitian.zhao@tencentmusic.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
Co-authored-by: iAmir97 <71513472+iAmir97@users.noreply.github.com>
Co-authored-by: iAmir97 <Amir.balwel@embeddedllm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Hong Hanh <hanh.usth@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: lkchen <github@lkchen.net>

08b751ba