Commits · 0de4f217abe2c73ce6df52743365302466f7bc00 · OpenDAS / vllm_cscc

14 Nov, 2025 40 commits

[Bugfix] TypeError: 'NoneType' object is not callable (#27410) · 0de4f217
Marcin Ostrowski authored Nov 14, 2025
```
Signed-off-by: Marcin Ostrowski <marcinx.ostrowski@intel.com>
```
0de4f217
[CI] Fix macos smoke test uv cache issue (#28736) · f08eab2a
Michael Goin authored Nov 14, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
f08eab2a
[ROCm][Bugfix] Fix compilation errors with fused_qknorm_rope_kernel.cu (#28682) · 8977ffb5
Sage Moore authored Nov 14, 2025
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
8977ffb5
[BugFix] Fix misprint introduced by modular_kernel refactoring. (#28728) · fd455508
Andrey Khalyavin authored Nov 14, 2025
```
Signed-off-by: Andrey Khalyavin <halyavin@yandex-team.ru>
```
fd455508

[Bugfix] resolve Qwen3-VL GPTQModel quantized model loading failure (#28663) · cec275ef

GuanH authored Nov 15, 2025


Signed-off-by: GuanH <guansdrailib@gmail.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

cec275ef

[Chore] Rename `SchedulerConfig.chunked_prefill_enabled` (#28735) · e2741f6c
Cyrus Leung authored Nov 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
e2741f6c
[Docs] Enable some more markdown lint rules for the docs (#28731) · 67187554
Harry Mellor authored Nov 14, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
67187554
[Bugfix] [ROCm] [AITER]: Fix aiter block quant not compatible with torch compile dynamo (#28716) · a425dc25
TJian authored Nov 14, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
a425dc25

LLaMA4 LoRA Adapter Enablement (#28602) · 964d65de

Fardin Hoque authored Nov 14, 2025


Signed-off-by: Fardin Hoque <kfhfar@amazon.com>
Co-authored-by: Wei Wei <wwei6@meta.com>

964d65de

docs(lora_resolvers): clarify multi-resolver order and storage path requirement (#28153) · 9261eb3d

Chen Wang authored Nov 14, 2025

Signed-off-by: Chen Wang <Chen.Wang1@ibm.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

9261eb3d

[kernel] Improve FP8 PTPC on Hopper for larger shapes (#28692) · cdd70259
czhu-cohere authored Nov 14, 2025
```
Signed-off-by: czhu-cohere <conway.zhu@cohere.com>
```
cdd70259

Remove audio optional dependency for mistral-common (#28722) · 08542480

Julien Denize authored Nov 14, 2025


Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

08542480

Fix typo in comment: existance -> existence (#28737) · a17e36f2
Mohammad Othman authored Nov 14, 2025
```
Signed-off-by: Mohammad Othman <emranm226@hotmail.com>
```
a17e36f2

[Attention] Bump FA for removed method (#28429) · 8cc40f89

Matthew Bonanni authored Nov 14, 2025


Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

8cc40f89

[DisaggEverything] Tokens in<>out `/generate` endpoint (#24261) · 6f1e7f72

Nicolò Lucchesi authored Nov 14, 2025

Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6f1e7f72

[CI][CPU] Smoke test for Apple Silicon using GHA MacOS runner (#28688) · d54a18a4
Michael Goin authored Nov 14, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
d54a18a4
[Docs] Update the name of `Transformers backend` -> `Transformers modeling backend` (#28725) · 5f3cd7f7
Harry Mellor authored Nov 14, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
5f3cd7f7

[Fix] improve aspect ratio in dummy image generation and add common VLM tests... · c934caee

dongbo910220 authored Nov 15, 2025


[Fix] improve aspect ratio in dummy image generation and add common  VLM tests for PaddleOCR-VL (#28711)
Signed-off-by: dongbo910220 <1275604947@qq.com>

c934caee

[Kernels] Enable FlashInfer FP8 Blockscale on SM90 (for TEP DSR1) (#27134) · 3f8a8740

Duncan Moss authored Nov 14, 2025

Signed-off-by: Duncan Moss <djm.moss@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

3f8a8740

[Config] Clean up SchedulerConfig initialization (#28665) · 511a6b61
Cyrus Leung authored Nov 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
511a6b61
[Bugfix][Nixl] Fix kernel physical<>logical block_size issue (#28677) · 96b23b8e
Nicolò Lucchesi authored Nov 14, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
96b23b8e
[Model] Fix bailing_moe accuracy problem (#28277) · 433c0f86
zhaozx-cn authored Nov 14, 2025
```
Signed-off-by: zhaozx-cn <zhaozx2116@163.com>
```
433c0f86
[Doc] Fix macOS installation dependency resolution issue (#26721) · 8d3748d3
Fasal Shah authored Nov 14, 2025
```
Signed-off-by: faisal shah <fashah@redhat.com>
```
8d3748d3
[BugFix] Fix FA3 IMA with FULL_AND_PIECEWISE and cascade attention (default) (#28702) · db56a599
Lucas Wilkinson authored Nov 14, 2025

db56a599
Fix KV sharing fast prefill with cudagraph enabled (#28537) · 9324e102
Yong Hoon Shin authored Nov 14, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
9324e102

[DCP] Support Decode Context Parallel (DCP) for GQA with Flashinfer (#25438) · 4516d44b

Jingchun Gao authored Nov 14, 2025


Signed-off-by: gaojc <1055866782@qq.com>
Signed-off-by: Jingchun Gao <gaojingchun1@huawei.com>
Signed-off-by: Jingchun Gao <63247409+gjc0824@users.noreply.github.com>
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Co-authored-by: gaojingchun (A) <g00955623@china.huawei.com>
Co-authored-by: Jingchun Gao <gaojingchun1@huawei.com>
Co-authored-by: QiuChunshuo <qiuchunshuo@huawei.com>

4516d44b

[Model][MM] Extract conv layer as CustomOp (#28455) · 41b92f7d

Shanshan Shen authored Nov 14, 2025


Signed-off-by: shen-shanshan <467638484@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

41b92f7d

[Frontend] Added chat-style multimodal support to /classify. (#27516) · 360bd876

Srreyansh Sethi authored Nov 14, 2025


Signed-off-by: WorldExplored <srreyansh.sethi@gmail.com>
Signed-off-by: Srreyansh Sethi <107075589+WorldExplored@users.noreply.github.com>
Signed-off-by: vnadathur <glvikramn@gmail.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: vnadathur <236933696+vnadathur@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: vnadathur <glvikramn@gmail.com>
Co-authored-by: wang.yuqi <noooop@126.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

360bd876

[Metrics] Log number of preempted requests (#28522) · ecf8230d

lyn610 authored Nov 14, 2025

Add tracking and periodic logging for the number of preempted requests in the
metrics logger. This helps monitor system behavior under load.
Signed-off-by: Yining Liu <610lyn@gmail.com>

ecf8230d

[Misc] fix comment in test_envs (#28529) · 8cfbe89b
Xing Liu authored Nov 14, 2025
```
Signed-off-by: Xing Liu <xingliu14@gmail.com>
```
8cfbe89b
[Minor] avoid register new custom and just import silly_attn (#28578) · fd75d3e8
Boyuan Feng authored Nov 14, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
fd75d3e8
Add output token counting to gsm8k eval (#28594) · c9a3a021
Michael Goin authored Nov 14, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
c9a3a021
[BugFix] Fix multi-modal async scheduling race condition (#28706) · bc3e4306
Nick Hill authored Nov 14, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
bc3e4306
[Bugfix] fix dots.ocr pp support (#28705) · c36bcfe6
Jiangyun Zhu authored Nov 14, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
c36bcfe6
use default CCL_ZE_IPC_EXCHANGE (#28700) · 529cea34
Yan Ma authored Nov 14, 2025
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
529cea34

[BugFix][CI/Build][ROCM] Fix import error and apply assert in appropriate case... · 93103575

rasmith authored Nov 14, 2025


[BugFix][CI/Build][ROCM] Fix import error and apply assert in appropriate case in test_struct_output_generate (#28311)
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>

93103575

[Bugfix][CI/Test][Spec Decode] Fix illegal memory access in... · 15ae8e07

rasmith authored Nov 14, 2025


[Bugfix][CI/Test][Spec Decode] Fix illegal memory access in offline_inference/spec_decode.py (Issue  27619) (#28432)
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>

15ae8e07

[Misc] add ignore mapper for quark quantization (#28275) · 0b254989
haoyangli-amd authored Nov 14, 2025
```
Signed-off-by: Haoyang Li <lihaoyang0109@gmail.com>
```
0b254989
[Misc] Update xformers to 0.33.0.post1 (#28678) · 0aecd913
Roger Wang authored Nov 13, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
0aecd913
[XPU][CI]disable lm cache uts (#28696) · da14ae0f
Kunshang Ji authored Nov 14, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
da14ae0f