Commits · d54a18a47e7cb6a126a022914c7965f84e15217c · OpenDAS / vllm_cscc

14 Nov, 2025 31 commits

[CI][CPU] Smoke test for Apple Silicon using GHA MacOS runner (#28688) · d54a18a4
Michael Goin authored Nov 14, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
d54a18a4
[Docs] Update the name of `Transformers backend` -> `Transformers modeling backend` (#28725) · 5f3cd7f7
Harry Mellor authored Nov 14, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
5f3cd7f7

[Fix] improve aspect ratio in dummy image generation and add common VLM tests... · c934caee

dongbo910220 authored Nov 15, 2025


[Fix] improve aspect ratio in dummy image generation and add common  VLM tests for PaddleOCR-VL (#28711)
Signed-off-by: dongbo910220 <1275604947@qq.com>

c934caee

[Kernels] Enable FlashInfer FP8 Blockscale on SM90 (for TEP DSR1) (#27134) · 3f8a8740

Duncan Moss authored Nov 14, 2025

Signed-off-by: Duncan Moss <djm.moss@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

3f8a8740

[Config] Clean up SchedulerConfig initialization (#28665) · 511a6b61
Cyrus Leung authored Nov 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
511a6b61
[Bugfix][Nixl] Fix kernel physical<>logical block_size issue (#28677) · 96b23b8e
Nicolò Lucchesi authored Nov 14, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
96b23b8e
[Model] Fix bailing_moe accuracy problem (#28277) · 433c0f86
zhaozx-cn authored Nov 14, 2025
```
Signed-off-by: zhaozx-cn <zhaozx2116@163.com>
```
433c0f86
[Doc] Fix macOS installation dependency resolution issue (#26721) · 8d3748d3
Fasal Shah authored Nov 14, 2025
```
Signed-off-by: faisal shah <fashah@redhat.com>
```
8d3748d3
[BugFix] Fix FA3 IMA with FULL_AND_PIECEWISE and cascade attention (default) (#28702) · db56a599
Lucas Wilkinson authored Nov 14, 2025

db56a599
Fix KV sharing fast prefill with cudagraph enabled (#28537) · 9324e102
Yong Hoon Shin authored Nov 14, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
9324e102

[DCP] Support Decode Context Parallel (DCP) for GQA with Flashinfer (#25438) · 4516d44b

Jingchun Gao authored Nov 14, 2025


Signed-off-by: gaojc <1055866782@qq.com>
Signed-off-by: Jingchun Gao <gaojingchun1@huawei.com>
Signed-off-by: Jingchun Gao <63247409+gjc0824@users.noreply.github.com>
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Co-authored-by: gaojingchun (A) <g00955623@china.huawei.com>
Co-authored-by: Jingchun Gao <gaojingchun1@huawei.com>
Co-authored-by: QiuChunshuo <qiuchunshuo@huawei.com>

4516d44b

[Model][MM] Extract conv layer as CustomOp (#28455) · 41b92f7d

Shanshan Shen authored Nov 14, 2025


Signed-off-by: shen-shanshan <467638484@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

41b92f7d

[Frontend] Added chat-style multimodal support to /classify. (#27516) · 360bd876

Srreyansh Sethi authored Nov 14, 2025


Signed-off-by: WorldExplored <srreyansh.sethi@gmail.com>
Signed-off-by: Srreyansh Sethi <107075589+WorldExplored@users.noreply.github.com>
Signed-off-by: vnadathur <glvikramn@gmail.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: vnadathur <236933696+vnadathur@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: vnadathur <glvikramn@gmail.com>
Co-authored-by: wang.yuqi <noooop@126.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

360bd876

[Metrics] Log number of preempted requests (#28522) · ecf8230d

lyn610 authored Nov 14, 2025

Add tracking and periodic logging for the number of preempted requests in the
metrics logger. This helps monitor system behavior under load.
Signed-off-by: Yining Liu <610lyn@gmail.com>

ecf8230d

[Misc] fix comment in test_envs (#28529) · 8cfbe89b
Xing Liu authored Nov 14, 2025
```
Signed-off-by: Xing Liu <xingliu14@gmail.com>
```
8cfbe89b
[Minor] avoid register new custom and just import silly_attn (#28578) · fd75d3e8
Boyuan Feng authored Nov 14, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
fd75d3e8
Add output token counting to gsm8k eval (#28594) · c9a3a021
Michael Goin authored Nov 14, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
c9a3a021
[BugFix] Fix multi-modal async scheduling race condition (#28706) · bc3e4306
Nick Hill authored Nov 14, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
bc3e4306
[Bugfix] fix dots.ocr pp support (#28705) · c36bcfe6
Jiangyun Zhu authored Nov 14, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
c36bcfe6
use default CCL_ZE_IPC_EXCHANGE (#28700) · 529cea34
Yan Ma authored Nov 14, 2025
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
529cea34

[BugFix][CI/Build][ROCM] Fix import error and apply assert in appropriate case... · 93103575

rasmith authored Nov 14, 2025


[BugFix][CI/Build][ROCM] Fix import error and apply assert in appropriate case in test_struct_output_generate (#28311)
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>

93103575

[Bugfix][CI/Test][Spec Decode] Fix illegal memory access in... · 15ae8e07

rasmith authored Nov 14, 2025


[Bugfix][CI/Test][Spec Decode] Fix illegal memory access in offline_inference/spec_decode.py (Issue  27619) (#28432)
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>

15ae8e07

[Misc] add ignore mapper for quark quantization (#28275) · 0b254989
haoyangli-amd authored Nov 14, 2025
```
Signed-off-by: Haoyang Li <lihaoyang0109@gmail.com>
```
0b254989
[Misc] Update xformers to 0.33.0.post1 (#28678) · 0aecd913
Roger Wang authored Nov 13, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
0aecd913
[XPU][CI]disable lm cache uts (#28696) · da14ae0f
Kunshang Ji authored Nov 14, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
da14ae0f
[Misc] Remove `warn_for_unimplemented_methods` (#28613) · 01bea115
Cyrus Leung authored Nov 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
01bea115
[ci][amd] fix basic models extra init test (#28676) · b39a5026
Bradley D authored Nov 13, 2025
```
Signed-off-by: Bradley Davis <bradleyhd@meta.com>
```
b39a5026
[CPU][Bugfix] Fix Apple Silicon M1 compilation failure (#28681) · 622e6106
Michael Goin authored Nov 13, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
622e6106
[ROCm] Bump up the version of amd-smi to 6.4.3 (#28680) · 2aa75c75
Sage Moore authored Nov 13, 2025
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
2aa75c75
[quantization][config] enable override existing quant_config (#28510) · 4d5943bd
Hank_ authored Nov 14, 2025
```
Signed-off-by: Hank <hcc.mayday@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
4d5943bd
Mirrored test group definitions for AMD (2025-11-11) (#28573) · f2b8e1c5
Alexei-V-Ivanov-AMD authored Nov 13, 2025
```
Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
```
f2b8e1c5

13 Nov, 2025 9 commits

[KV Connector] Test async mode in scheduler tests (#28550) · 6e25b1cd
Mark McLoughlin authored Nov 13, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
6e25b1cd
[CI] Bug: Fix ci entrypoint pooling (#28684) · e64011f2
Wentao Ye authored Nov 13, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
e64011f2
[Misc] Update CODEOWNERS for simon-mo and comaniac (#28675) · 1b622deb
Simon Mo authored Nov 13, 2025
```
Signed-off-by: Simon Mo <simon.mo@hey.com>
```
1b622deb

[Bugfix] [CPU] bump torch to 2.9.0 for Darwin to fix segmentation fault (#27791) · faed7bf0

Kebe authored Nov 14, 2025


Signed-off-by: Kebe <mail@kebe7jun.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

faed7bf0

[Bugfix] Eliminate tuple inputs to submodules in graph partitioning (#28533) · 262d263f
Yanan Cao authored Nov 13, 2025
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
```
262d263f

[bugfix] correct local_chunk_len for DCP in reorg_kvcache with long context (#28526) · 968060c1

Qiu authored Nov 14, 2025


Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

968060c1

[Perf] Support stream interval for reducing host overhead (#27869) · 5d6ce2b9

elvischenv authored Nov 14, 2025


Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

5d6ce2b9

[Attention][Bugfix] Fix FA sink support (#28660) · f9f3b596
Matthew Bonanni authored Nov 13, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
f9f3b596

[Bugfix] Fix validate model input for decoder models (#27099) · 119c4927

Yannick Schnider authored Nov 13, 2025


Signed-off-by: Yannick Schnider <yannick.schnider1@ibm.com>
Signed-off-by: Yannick Schnider <Yannick.Schnider1@ibm.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

119c4927