Commits · 3d4e7d34be856cc4f54033e6a019059afacb5e76 · OpenDAS / vllm_cscc

19 Nov, 2025 1 commit
- [Model][QwenVL] Simplify cos/sin rotary embedding indexing (#28962) · 3d4e7d34
  Lukas Geiger authored Nov 19, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  3d4e7d34
18 Nov, 2025 1 commit
- [Model][Perf] Use cos and sin cache in QwenVL (#28798) · b9489f51
  Canlin Guo authored Nov 18, 2025
```
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
```
  b9489f51
14 Nov, 2025 1 commit

[Model][MM] Extract conv layer as CustomOp (#28455) · 41b92f7d

Shanshan Shen authored Nov 14, 2025


Signed-off-by: shen-shanshan <467638484@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

41b92f7d

13 Nov, 2025 1 commit
- Rename clashing method names for vLLM model protocol (#27583) · 97d1c993
  Harry Mellor authored Nov 13, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  97d1c993
12 Nov, 2025 1 commit
- [Refactor] Remove redundant TP gather/split in split_qkv in QwenVL (#28271) · bc5bd45c
  Canlin Guo authored Nov 12, 2025
```
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
```
  bc5bd45c
11 Nov, 2025 2 commits
- [Model] Pass `mm_features` directly into `get_mrope_input_positions` (#28399) · afffd3cc
  Cyrus Leung authored Nov 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  afffd3cc
- [Attention] Refactor CUDA attention backend selection logic (#24794) · b30dfa03
  Matthew Bonanni authored Nov 11, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  b30dfa03
10 Nov, 2025 1 commit
- [V0 Deprecation] Remove unused `context_len` and `seq_len` from M-RoPE (#28395) · d0e186c1
  Cyrus Leung authored Nov 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d0e186c1
07 Nov, 2025 1 commit
- [Core][MM] Add mechanism to configure multimodal fields which should stay on CPU (#28168) · e0919f33
  Lukas Geiger authored Nov 07, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  e0919f33
01 Nov, 2025 2 commits

[CI/Build] Bump transformers version (#27528) · 879a0657

Cyrus Leung authored Nov 01, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

879a0657

[Multimodal][XPU]Enable vision attn backend for xpu platform (#27525) · 7e2729b5

Yan Ma authored Nov 01, 2025


Signed-off-by: Yan Ma <yan.ma@intel.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Yejing Lai <yejing.lai@intel.com>
Co-authored-by: Guancheng Fu <110874468+gc-fu@users.noreply.github.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>

7e2729b5

27 Oct, 2025 1 commit
- [Model] Use merge_by_field_config for MM models (Qwen series) (#27546) · cbd5e07a
  Cyrus Leung authored Oct 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  cbd5e07a
26 Oct, 2025 1 commit

[BUGFIX][ROCM] ViT FlashAttention on ROCm (no GFX9) and contiguous on qwen3vl... · 65d2cf95

JartX authored Oct 26, 2025


[BUGFIX][ROCM] ViT FlashAttention on ROCm (no GFX9) and contiguous on qwen3vl ROCm TORCH_SDPA (#27190)
Signed-off-by: JartX <sagformas@epdcenter.es>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>

65d2cf95

24 Oct, 2025 1 commit
- [MM][Bugfix] Replace `PatchEmbed`'s conv3d to linear layer (#27418) · 42efe609
  Isotr0py authored Oct 24, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  42efe609
23 Oct, 2025 1 commit

[Bugfix] Honor --mm_encoder_attn_backend when used (#27124) · 570c3e1c

Bradley D authored Oct 23, 2025


Co-authored-by: Bradley D <4551889+bradleyhd@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

570c3e1c

21 Oct, 2025 1 commit
- [MM][Core] Decouple ViT backend from LM backend (#27061) · c3a2c6ac
  Roger Wang authored Oct 21, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  c3a2c6ac
18 Oct, 2025 1 commit
- [Models][QwenVL] Remove unnecessary `.contiguous()` calls (#27106) · 5c2acb27
  Lukas Geiger authored Oct 18, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  5c2acb27
14 Oct, 2025 1 commit
- [Bugfix] Standardize merging multimodal embeddings (#26771) · d2f816d6
  Cyrus Leung authored Oct 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d2f816d6
12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
05 Oct, 2025 1 commit
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
04 Oct, 2025 1 commit

Fix tensor device and dtype placement in Qwen2VL model (#26219) · 86ee9491

yuafng authored Oct 04, 2025


Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Yuanfeng Li <yuanfengli@meta.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

86ee9491

03 Oct, 2025 4 commits

[BugFix][QWEN-VL]fix wrong apply_rotary_emb_torch selection introduced by #24642 (#26123) · dd96465f

Chendi.Xue authored Oct 03, 2025


Signed-off-by: Chendi Xue <Chendi.Xue@intel.com>
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

dd96465f

[Multi Modal] Configurable MM Profiling (#25631) · 79aa2446

Wenlong Wang authored Oct 03, 2025

Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

79aa2446

[ROCm] [VL] [Bugfix] Fix vit flash attn dispatcher logic for ROCm (#26104) · 9c5ee91b
TJian authored Oct 02, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
9c5ee91b
[Attention] Move Backend enum into registry (#25893) · 2aaa4238
Matthew Bonanni authored Oct 02, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
2aaa4238

02 Oct, 2025 1 commit
- [Qwen][ROCm] Flash Attention Rotary Embeddings (#24642) · 5e4a8223
  vllmellm authored Oct 02, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  5e4a8223
29 Sep, 2025 1 commit
- [V0 Deprecation][Models] Remove all V0 condition for mm embeddings merge (#25331) · bd51f78e
  Isotr0py authored Sep 29, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: isotr0py <2037008807@qq.com>
```
  bd51f78e
28 Sep, 2025 1 commit

[VLM] Update Qwen3-VL max_num_video_tokens calculation for configurable video profiling (#25557) · 0efd540d

Isotr0py authored Sep 28, 2025


Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>

0efd540d

27 Sep, 2025 1 commit

[Bugfix] Merge MM embeddings by index instead of token IDs (#16229) · 27d7638b

Cyrus Leung authored Sep 27, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

27d7638b

26 Sep, 2025 1 commit
- [Quantization] Add field to skip unquantized modules for GPTQ config (#25455) · d4d98998
  Isotr0py authored Sep 26, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  d4d98998
25 Sep, 2025 1 commit
- [Bugfix] Fix Qwen3-VL max_num_video_tokens calculation for video profiling (#25648) · 17b4c668
  Isotr0py authored Sep 25, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  17b4c668
23 Sep, 2025 2 commits
- [Misc] Move DP for ViT code inside model executor dir (#25459) · babad6e5
  Cyrus Leung authored Sep 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  babad6e5
- [Model] Enable DP for ViT in Qwen2-VL (#25445) · c98be0a2
  Cyrus Leung authored Sep 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c98be0a2
21 Sep, 2025 2 commits
- [V0 Deprecation] Remove V0 sampling metadata (#25345) · 1c3ffdbe
  Woosuk Kwon authored Sep 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  1c3ffdbe
- [Multi Modal][Performance] Fused Q,K's apply_rope in more models (#25005) · 035fd2bd
  Wenlong Wang authored Sep 20, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  035fd2bd
18 Sep, 2025 1 commit

[feat]: Create interface for model-specific M-RoPE (#24194) · 38db529f

Aziz authored Sep 18, 2025

Signed-off-by: AzizCode92 <azizbenothman76@gmail.com>
Signed-off-by: Aziz <azizbenothman76@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

38db529f

17 Sep, 2025 1 commit

[Model] Support Qwen3-VL Model Series (#24727) · 0f7acdd7

Roger Wang authored Sep 16, 2025


Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Huang Jie <92386084+JJJYmmm@users.noreply.github.com>
Co-authored-by: 松灵 <26085463+wulipc@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

0f7acdd7

13 Sep, 2025 1 commit
- [Docs] Fix warnings in mkdocs build (continued) (#24791) · 9a8966bc
  Hyogeun Oh (오효근) authored Sep 13, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
```
  9a8966bc
12 Sep, 2025 2 commits
- [Models] Optimise and simplify `_validate_and_reshape_mm_tensor` (#24742) · 57f94e88
  Lukas Geiger authored Sep 12, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  57f94e88
- [Multi Modal] Add FA3 in VIT (#24347) · 72fc8aa4
  Wenlong Wang authored Sep 12, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
  72fc8aa4