Commits · 17edd8a807019c8d1e58634aecb1de7984e8d467 · OpenDAS / vllm_cscc

05 Oct, 2025 2 commits
- [Bugfix] Always apply MM processor even when no MM items are passed (#26240) · b7e8e4e6
  Cyrus Leung authored Oct 05, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b7e8e4e6
- [Model] Use `merge_by_field_config` for MM models (H-L) (#26230) · 59a85c36
  Cyrus Leung authored Oct 05, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  59a85c36
04 Oct, 2025 8 commits
- [V1] [Hybrid] Remove code to override default CUDA graph configuration (#26226) · ed3aeb25
  Thomas Parnell authored Oct 04, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  ed3aeb25
- Fix tensor device and dtype placement in Qwen2VL model (#26219) · 86ee9491
  yuafng authored Oct 04, 2025
```
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Yuanfeng Li <yuanfengli@meta.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  86ee9491
- [Model] CLIP Embedding Support (#26010) · 4570535e
  Cyrus Leung authored Oct 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4570535e
- [Model] Support nested structures for TensorSchema (#26212) · 44ea8513
  Cyrus Leung authored Oct 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  44ea8513
- Support expert parallel in Transformers backend (#26162) · d3d649ef
  Harry Mellor authored Oct 04, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  d3d649ef
- [V1] [Hybrid] Mamba2 Automatic Prefix Caching (#25752) · ea507c3a
  Stan Wozniak authored Oct 04, 2025
```
Signed-off-by: Stanislaw Wozniak <stw@zurich.ibm.com>
Signed-off-by: Thomas Ortner <boh@zurich.ibm.com>
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Thomas Ortner <boh@zurich.ibm.com>
Co-authored-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  ea507c3a
- [Bugfix] Fix qwen3 vl dummy data generation with overrides (#26193) · 67bc0c00
  Roger Wang authored Oct 03, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  67bc0c00
- Fix issue of using only the part of video frame [Nemotron Nano] (#26186) · 5a05f266
  Eugene Khvedchenya authored Oct 04, 2025
```
Signed-off-by: Eugene Khvedchenia <ekhvedchenia@nvidia.com>
```
  5a05f266
03 Oct, 2025 9 commits
- [BugFix][QWEN-VL]fix wrong apply_rotary_emb_torch selection introduced by #24642 (#26123) · dd96465f
  Chendi.Xue authored Oct 03, 2025
```
Signed-off-by: Chendi Xue <Chendi.Xue@intel.com>
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  dd96465f
- [Model] Supplement to PR 24862: Pass param prefix to LLMHead (#25805) · cbf92219
  whx authored Oct 03, 2025
```
Signed-off-by: whx-sjtu <2952154980@qq.com>
```
  cbf92219
- [Multi Modal] Configurable MM Profiling (#25631) · 79aa2446
  Wenlong Wang authored Oct 03, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  79aa2446
- [Model] Use `merge_by_field_config` for MM models (InternVL family) (#26153) · f9a8084e
  Cyrus Leung authored Oct 03, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f9a8084e
- [Input] Remove unused `prompt` field (#26097) · 0ad9951c
  Cyrus Leung authored Oct 03, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0ad9951c
- `FusedMoE` support for the Transformers backend (#22650) · 10d76548
  Harry Mellor authored Oct 03, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  10d76548
- [Model] Use `merge_by_field_config` for MM models (G) (#26117) · 39b643dc
  Cyrus Leung authored Oct 03, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  39b643dc
- [ROCm] [VL] [Bugfix] Fix vit flash attn dispatcher logic for ROCm (#26104) · 9c5ee91b
  TJian authored Oct 02, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  9c5ee91b
- [Attention] Move Backend enum into registry (#25893) · 2aaa4238
  Matthew Bonanni authored Oct 02, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  2aaa4238
02 Oct, 2025 4 commits
- [Deepseek v3.2] Support indexer prefill chunking (#25999) · 1e50f1be
  Chen Zhang authored Oct 02, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  1e50f1be
- [Qwen][ROCm] Flash Attention Rotary Embeddings (#24642) · 5e4a8223
  vllmellm authored Oct 02, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  5e4a8223
- [Model] Use `merge_by_field_config` for MM models (D-F) (#26076) · cc253b73
  Cyrus Leung authored Oct 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  cc253b73
- [Model] Use `merge_by_field_config` for MM models (A-C) (#26073) · 7d6fb905
  Cyrus Leung authored Oct 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7d6fb905
01 Oct, 2025 5 commits
- [Misc] Factor out common `_apply_feature_select_strategy` (#26003) · 1405f0c7
  Cyrus Leung authored Oct 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1405f0c7
- [BugFix][MM] Fix Nonetype error when video is cache in qwen2.5-omni-thinker (#26004) · 84d57342
  Wenlong Wang authored Oct 01, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
  84d57342
- Update to Transformers `v4.56.2` (#24638) · 2a69ab48
  Harry Mellor authored Oct 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  2a69ab48
- [BugFix] Fix default kv-cache-dtype default for DeepseekV3.2 (#25988) · 8d7da92f
  Lucas Wilkinson authored Oct 01, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  8d7da92f
- [MM] Add text-only mode for Qwen3-VL (#26000) · 66bca9b8
  Roger Wang authored Sep 30, 2025
  
  66bca9b8
30 Sep, 2025 9 commits

Add explicit pooling classes for the Transformers backend (#25322) · a388252a

Harry Mellor authored Sep 30, 2025


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

a388252a

[Bugfix] Token type and position embeddings fail to be applied to `inputs_embeds` (#25922) · 9f1c4eca
Cyrus Leung authored Oct 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
9f1c4eca

[Bugfix][Model] Fix inference for Hunyuan dense models (#25354) · f4db5e6d

Anion authored Sep 30, 2025


Signed-off-by: anion <1005128408@qq.com>
Signed-off-by: Anion <123177548+Anionex@users.noreply.github.com>

f4db5e6d

[Model] Move `vision_feature_select_strategy` into `resolve_visual_encoder_outputs` (#25938) · d7e34b42
Cyrus Leung authored Sep 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
d7e34b42
[Bugfix][Model]fix ernie45 moe gate&bias dtype to float32 (#25936) · ef6e0e71
CSWYF3634076 authored Sep 30, 2025
```
Signed-off-by: wangyafeng <wangyafeng@baidu.com>
```
ef6e0e71

[New Model] DeepSeek-V3.2 (Rebased to Main) (#25896) · fa7e254a

Yongye Zhu authored Sep 30, 2025


Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>
Signed-off-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Xiaozhu Meng <mxz297@gmail.com>
Co-authored-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>