Commits · f23b4c04fd099aa15ba02df779f7bf6ae66d99a5 · OpenDAS / vllm_cscc · GitLab

06 Oct, 2025 11 commits

[Bugfix] Fix gemma3 with transformers backend (#23178) · 7cd95dc8

Raushan Turganbay authored Oct 06, 2025

Signed-off-by: raushan <raushan@huggingface.co>
Signed-off-by: Raushan Turganbay <raushan@huggingface.co>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

7cd95dc8

Add bias handling to CPUFusedMOE kernel (#26289) · c02058c2

Crefeda Rodrigues authored Oct 06, 2025


Signed-off-by: Crefeda Rodrigues <crefeda.rodrigues@arm.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Crefeda Rodrigues <65665931+cfRod@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Sharif Inamdar <Sharif.Inamdar@arm.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

c02058c2

Support llama3 eagle3 head with llama4 verifier (#25961) · 05f6846e
Rahul Tuli authored Oct 06, 2025
```
Signed-off-by: rahul-tuli <rtuli@redhat.com>
Signed-off-by: Rahul Tuli <rtuli@redhat.com>
```
05f6846e

[Model] EVS support for nano_nemotron_vl (#26269) · b8f603ce

tomeras91 authored Oct 06, 2025

Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>
Signed-off-by: tomeras91 <57313761+tomeras91@users.noreply.github.com>
Signed-off-by: Eugene Khvedchenia <ekhvedchenia@nvidia.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Eugene Khvedchenia <ekhvedchenia@nvidia.com>

b8f603ce

Fix `DotsOCR` tensor type (#26281) · fc679696
Chatcharin Sangbutsarakum authored Oct 06, 2025
```
Signed-off-by: what_in_the_nim <chatcharinsang@gmail.com>
```
fc679696

[Bugfix] Fix mrope in Transformers Backend (#26087) · ab5e7d93

Raushan Turganbay authored Oct 06, 2025

Signed-off-by: raushan <raushan@huggingface.co>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

ab5e7d93

Support expert parallel load balancing in Transformers backend (#26287) · 0340f455
Harry Mellor authored Oct 06, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
0340f455
[Model] Use `merge_by_field_config` for MM models (Llava family) (#26280) · 19a00eb2
Cyrus Leung authored Oct 06, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
19a00eb2
[Misc] Clean up unnecessary E501 ignore (#26274) · 43c146ca
Roger Wang authored Oct 06, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
43c146ca
Fix per file ruff ignores related to line length (#26262) · 6c046382
Harry Mellor authored Oct 06, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
6c046382
[V1] [Hybrid] Some additional clean-up in Mamba2 prefix caching (#26222) · 778f5541
Thomas Parnell authored Oct 06, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
778f5541

05 Oct, 2025 8 commits
- Fix per file ruff ignores related to simplification (#26259) · b893d661
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b893d661
- Fix per file ruff ignores related to typing (#26254) · 1c0c6820
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  1c0c6820
- Remove all cases of `fmt: on/off` (#26253) · 557b2e96
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  557b2e96
- Remove all references to `yapf` as it's no longer used (#26251) · 4e256cad
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4e256cad
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
- [Bugfix] Always apply MM processor even when no MM items are passed (#26240) · b7e8e4e6
  Cyrus Leung authored Oct 05, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b7e8e4e6
- [Bugfix]: Assertion error when using FlashInfer backend (#25933) · 432e1cbc
  Simon Danielsson authored Oct 05, 2025
```
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  432e1cbc
- [Model] Use `merge_by_field_config` for MM models (H-L) (#26230) · 59a85c36
  Cyrus Leung authored Oct 05, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  59a85c36
04 Oct, 2025 12 commits
- [V1] [Hybrid] Remove code to override default CUDA graph configuration (#26226) · ed3aeb25
  Thomas Parnell authored Oct 04, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  ed3aeb25
- Fix tensor device and dtype placement in Qwen2VL model (#26219) · 86ee9491
  yuafng authored Oct 04, 2025
```
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Yuanfeng Li <yuanfengli@meta.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  86ee9491
- [Model] CLIP Embedding Support (#26010) · 4570535e
  Cyrus Leung authored Oct 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4570535e
- Revert "Add batch invariant kernel override for FlashInfer backend [2/n]" (#26220) · 1838cd48
  Cyrus Leung authored Oct 04, 2025
  
  1838cd48
- [Model] Support nested structures for TensorSchema (#26212) · 44ea8513
  Cyrus Leung authored Oct 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  44ea8513
- Support expert parallel in Transformers backend (#26162) · d3d649ef
  Harry Mellor authored Oct 04, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  d3d649ef
- [V1] [Hybrid] Mamba2 Automatic Prefix Caching (#25752) · ea507c3a
  Stan Wozniak authored Oct 04, 2025
```
Signed-off-by: Stanislaw Wozniak <stw@zurich.ibm.com>
Signed-off-by: Thomas Ortner <boh@zurich.ibm.com>
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Thomas Ortner <boh@zurich.ibm.com>
Co-authored-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  ea507c3a
- [cpu][perf] Accelerate unquantized-linear for AArch64 through oneDNN/ACL and... · 9705fba7
  Fadi Arafeh authored Oct 04, 2025
```
[cpu][perf] Accelerate unquantized-linear for AArch64 through oneDNN/ACL and weight prepack (#25948)
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
```
  9705fba7
- Add batch invariant kernel override for FlashInfer backend [2/n] (#25769) · 2f7dbc9b
  Bram Wasti authored Oct 03, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
Signed-off-by: Bram Wasti <bwasti@fb.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  2f7dbc9b
- [Bugfix] Fix qwen3 vl dummy data generation with overrides (#26193) · 67bc0c00
  Roger Wang authored Oct 03, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  67bc0c00
- Fix issue of using only the part of video frame [Nemotron Nano] (#26186) · 5a05f266
  Eugene Khvedchenya authored Oct 04, 2025
```
Signed-off-by: Eugene Khvedchenia <ekhvedchenia@nvidia.com>
```
  5a05f266
- [GPTOSS][DP/EP][Marlin] Enable GPTOSS DP/EP using Marlin kernels (#25488) · 7ef40bb9
  Varun Sundar Rabindranath authored Oct 03, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  7ef40bb9
03 Oct, 2025 9 commits
- [Refactor] Optimize FP8 MOE Backend Choice and Log (#26044) · c1ffcb55
  Wentao Ye authored Oct 03, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c1ffcb55
- [Quantization/NVFP4] Speed up TRTLLM NVFP4 MOE weight loading and fix K/V... · a2691733
  Pavani Majety authored Oct 03, 2025
```
[Quantization/NVFP4] Speed up TRTLLM NVFP4 MOE weight loading and fix K/V scale loading for MLA Attn (#25968)
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  a2691733
- [BugFix][QWEN-VL]fix wrong apply_rotary_emb_torch selection introduced by #24642 (#26123) · dd96465f
  Chendi.Xue authored Oct 03, 2025
```
Signed-off-by: Chendi Xue <Chendi.Xue@intel.com>
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  dd96465f
- [Model] Supplement to PR 24862: Pass param prefix to LLMHead (#25805) · cbf92219
  whx authored Oct 03, 2025
```
Signed-off-by: whx-sjtu <2952154980@qq.com>
```
  cbf92219
- [backends][short_conv] CUDA graph piecewise edits (#24215) · 5f42fc53
  Paul Pak authored Oct 03, 2025
```
Signed-off-by: Paul Pak <paulpak58@gmail.com>
```
  5f42fc53
- [Doc] Fixed shape description for fused_batched_moe.py (#25668) · aa5053e3
  Egor authored Oct 03, 2025
```
Signed-off-by: Egor <e.a.krivov@gmail.com>
```
  aa5053e3
- [Multi Modal] Configurable MM Profiling (#25631) · 79aa2446
  Wenlong Wang authored Oct 03, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  79aa2446
- [Model] Use `merge_by_field_config` for MM models (InternVL family) (#26153) · f9a8084e
  Cyrus Leung authored Oct 03, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f9a8084e
- [Input] Remove unused `prompt` field (#26097) · 0ad9951c
  Cyrus Leung authored Oct 03, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0ad9951c