Commits · b98219670fb1ca2952d449404c2b4921d7cdce73 · OpenDAS / vllm_cscc

18 Sep, 2025 3 commits

[Core][MM] Cleanup `MultiModalCache` (#25006) · b9821967
Lukas Geiger authored Sep 18, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
b9821967

[MM Encoder] Apply DP ViT for Qwen3-VL model series (#24955) · 3127274d

Roger Wang authored Sep 17, 2025

Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Huang Jie <92386084+JJJYmmm@users.noreply.github.com>
Co-authored-by: 松灵 <26085463+wulipc@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

3127274d

[Kernels] Enable DeepGEMM by default (#24462) · 4ac510f4
bnellnm authored Sep 17, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
4ac510f4

17 Sep, 2025 36 commits
- [Kernel] Delegate construction of FusedMoEQuantConfig to FusedMoEMethodBase subclasses (#22537) · 5963b98b
  bnellnm authored Sep 17, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  5963b98b
- [Bugfix] Refactor Flashinfer TRTLLM attention kernel selection logic (#24600) · e67a79db
  elvischenv authored Sep 18, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  e67a79db
- Aiter mha fp8 fix (#24991) · 1a456c7c
  Douglas Lehr authored Sep 17, 2025
```
Signed-off-by: Doug Lehr <douglehr@amd.com>
Co-authored-by: Doug Lehr <douglehr@amd.com>
```
  1a456c7c
- [gpt-oss][2] fix types for streaming (#24556) · bff2e5f1
  Andrew Xia authored Sep 17, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
```
  bff2e5f1
- [BUG] Exclude .pth files when pulling remote files (#25092) · f20c3b09
  ahao-anyscale authored Sep 17, 2025
```
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
```
  f20c3b09
- [Bugfix] Update import path for bc_linter_include (#24766) · 88313154
  Mohammad Miadh Angkad authored Sep 18, 2025
```
Signed-off-by: Mohammad Miadh Angkad <mangkad.bsdsba2027@aim.edu>
```
  88313154
- [V1] Logits processor docs (#22919) · 7ae98875
  afeldman-nm authored Sep 17, 2025
```
Signed-off-by: Andrew Feldman <afeldman@redhat.com>
Signed-off-by: afeldman-nm <156691304+afeldman-nm@users.noreply.github.com>
Co-authored-by: Joseph Marinier <Joseph.Marinier@gmail.com>
```
  7ae98875
- Change log level from info to debug for IOProcessor (#24999) · 8b32464a
  Michael Goin authored Sep 17, 2025
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  8b32464a
- [V0 Deprecation] Remove unused output processor util (#25023) · 99cc41ad
  Woosuk Kwon authored Sep 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  99cc41ad
- cleanup: remove adapter commons (#25045) · 4aa8c7b0
  Simon Mo authored Sep 17, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  4aa8c7b0
- [Docs] vllm/benchmarks/datasets.py fix docstring param format. (#24970) · 4a2d33e3
  samzong authored Sep 17, 2025
```
Signed-off-by: samzong <samzong.lu@gmail.com>
```
  4a2d33e3
- Remove old cutlass mla (#23961) · 8f3616f4
  Matthew Bonanni authored Sep 17, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  8f3616f4
- [Docs] improve code formatting and comments for eliminate griffe build warning. (#25010) · 47f670b0
  samzong authored Sep 17, 2025
```
Signed-off-by: samzong <samzong.lu@gmail.com>
```
  47f670b0
- [Bugfix][Qwen3-Next] fixes the varlen issue in qwen3-next's MTP implementation. (#24957) · dd6a910a
  Tao He authored Sep 17, 2025
```
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
```
  dd6a910a
- [Bugfix] Fix Stream usage in CPU model runner and OneDNN kernel check (#25046) · 9fccd04e
  Li, Jiang authored Sep 17, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  9fccd04e
- Add RADIO Vision Encoder Support to vLLM (#24595) · 252ada55
  danielafrimi authored Sep 17, 2025
```
Signed-off-by: Daniel Afrimi <danielafrimi8@gmail.com>
Co-authored-by: root <root@cw-dfw-h100-001-305-026.cm.cluster>
```
  252ada55
- [BugFix] enable DOTALL to match multi-line tool_call parameters in... · 2b856970
  Shijun Yin authored Sep 17, 2025
```
[BugFix] enable DOTALL to match multi-line tool_call parameters in extract_tool_call_required_streaming (#24668)
Signed-off-by: Shijun Yin <shijun.yin@outlook.com>
```
  2b856970
- [Frontend] Support returning all prompt logprobs (#24956) · 544fe76b
  Chauncey authored Sep 17, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  544fe76b
- [DP] Create placement groups by ray_device_key (#25026) · bb58dc8c
  Xinyu Chen authored Sep 17, 2025
```
Signed-off-by: Xinyu Chen <xinyu1.chen@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
```
  bb58dc8c
- [Docs] Fix griffe warning in base_static_graph.py (#25018) · 0fb2551c
  Michael Yao authored Sep 17, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  0fb2551c
- [Core] Remove tokenizer group in vLLM (#24078) · 6c47f6bf
  Zhuohan Li authored Sep 17, 2025
```
Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
```
  6c47f6bf
- [Model] Apply SharedFusedMoE to glm4_moe. (#24849) · c15309a7
  whx authored Sep 17, 2025
```
Signed-off-by: whx-sjtu <2952154980@qq.com>
```
  c15309a7
- [Model] Pass param prefix to LLMHead (#24862) · 4a9375fe
  whx authored Sep 17, 2025
```
Signed-off-by: whx-sjtu <2952154980@qq.com>
```
  4a9375fe
- [Core][MultiModalHasher] Hash images without converting image mode (#24969) · 03191cd8
  Lukas Geiger authored Sep 17, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  03191cd8
- [EPLB] Support EPLB for Mixtral Model (#22842) · b77bf34e
  rouchenzi authored Sep 17, 2025
```
Signed-off-by: rouchenzi <ruochenwen@gmail.com>
Signed-off-by: rouchenzi <40842833+rouchenzi@users.noreply.github.com>
Co-authored-by: Bowen Wang <abmfy@icloud.com>
```
  b77bf34e
- [XPU] Fix xpu model runner call torch.cuda APIs (#25011) · dd39baf7
  Kunshang Ji authored Sep 17, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  dd39baf7
- [Rocm] [quantization] Fix quark ptpc moe and add test case (#24649) · ca2d1925
  haoyangli-amd authored Sep 17, 2025
```
Signed-off-by: Haoyang Li <lihaoyang0109@gmail.com>
Co-authored-by: Haoyang Li <haoyang.li@amd.com>
```
  ca2d1925
- [Model] Support Qwen3-VL Model Series (#24727) · 0f7acdd7
  Roger Wang authored Sep 16, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Huang Jie <92386084+JJJYmmm@users.noreply.github.com>
Co-authored-by: 松灵 <26085463+wulipc@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  0f7acdd7
- [V0 Deprecation] Remove MQLLMEngine (#25019) · 5801e497
  Woosuk Kwon authored Sep 16, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  5801e497
- [Core] Get num_encoder_tokens from scheduler config (#24989) · 58d4c705
  Russell Bryant authored Sep 16, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  58d4c705
- [misc] fix typo in value error (#24995) · ea3de5ef
  Prashant Gupta authored Sep 16, 2025
```
Signed-off-by: Prashant Gupta <prashantgupta@us.ibm.com>
```
  ea3de5ef
- [UX] Remove "quantization is not fully optimized yet" log (#25012) · 67532a1a
  Michael Goin authored Sep 16, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  67532a1a
- [UX] Enforce valid choices for envs like VLLM_ATTENTION_BACKEND, etc (#24761) · dd83a157
  Michael Goin authored Sep 16, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  dd83a157
- [Benchmarks] Add MMVU video dataset support and clean up deprecated datasets (#24719) · 5a411ef6
  Isotr0py authored Sep 17, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  5a411ef6
- [Core] Use `CpuGpuBuffer` for block table tensors (#24795) · eeb135eb
  Nick Hill authored Sep 16, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  eeb135eb
- [FP8] Extend per-token-group quantization support to QuantFP8 (#24342) · cef32104
  Tahsin Tunan authored Sep 17, 2025
```
Signed-off-by: Tahsin Tunan <tahsintunan@gmail.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>
```
  cef32104
16 Sep, 2025 1 commit

[CI][Bugfix] Fix failing Blackwell test (#24993) · d119fc86

Matthew Bonanni authored Sep 16, 2025


Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

d119fc86