Commits · 35bc22f23ce3fcd9c57f318836ec102f7c85647a · OpenDAS / vllm_cscc

13 Oct, 2025 24 commits

[ResponseAPI] Further polish message serialization and unit tests (#26728) · 35bc22f2
Jialin Ouyang authored Oct 13, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
35bc22f2

[FrontEnd] UNREVERT CompilationConfig overhaul (#20283): deprecate... · e3fdb627

Morrison Turnansky authored Oct 13, 2025


[FrontEnd] UNREVERT CompilationConfig overhaul (#20283): deprecate use_inductor in favor of backend, simplify custom_ops  (#26502)
Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>

e3fdb627

[Bug] Fix Assertion error DeepEP/csrc/kernels/intranode.cu:928: 'false and... · 7200a21c

Wentao Ye authored Oct 13, 2025


[Bug] Fix Assertion error DeepEP/csrc/kernels/intranode.cu:928: 'false and Unsupported type' (#26532)
Signed-off-by: yewentao256 <zhyanwentao@126.com>

7200a21c

[CI] Fix mypy for `vllm/distributed` (#26593) · 314285d4

Wentao Ye authored Oct 13, 2025

Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

314285d4

[Frontend][1/N] Improve all pooling task | Support FP16 Embedding Base64... · d2a79385

wang.yuqi authored Oct 14, 2025


[Frontend][1/N] Improve all pooling task | Support FP16 Embedding Base64 (Still uses fp32 by default). (#26414)
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Maximilien de Bayser <maxdebayser@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

d2a79385

[Quantization] [Performance] Enable Marlin GEMM kernels for the... · 89342ce4

Alex Kogan authored Oct 13, 2025


[Quantization] [Performance] Enable Marlin GEMM kernels for the calibration-free RTN-based quantization (#26051)
Signed-off-by: Alex Kogan <alex.kogan@oracle.com>
Signed-off-by: Alex Kogan <82225080+sakogan@users.noreply.github.com>

89342ce4

[Log] Optimize Startup Log (#26601) · e251e457
Wentao Ye authored Oct 13, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
e251e457
[Model] Use merge_by_field_config for MM models (M-N) (#26710) · afc47e4d
Cyrus Leung authored Oct 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
afc47e4d
[Bugfix][Speculative Decoding] Extend Eagle quantization config fix to llama_eagle.py (#26590) · e3b90c1b
Rahul Tuli authored Oct 13, 2025
```
Signed-off-by: Rahul Tuli <rtuli@redhat.com>
```
e3b90c1b
[CI/Build] upgrade compressed-tensors to 0.12.2 to address LGPLv3 (#26501) · a1b2d658
Sangyeon Cho authored Oct 14, 2025
```
Signed-off-by: Sangyeon Cho <josang1204@gmail.com>
```
a1b2d658
[Misc] Separate prompt logging to debug (#26713) · 5c7fe254
Aleksei Tsvetkov authored Oct 13, 2025
```
Signed-off-by: Aleksei Tsvetkov <aitsvet@ya.ru>
```
5c7fe254
[P/D] [NixlConnector] kv load recovery integration (#26171) · 53c9a7ce
Will Eaton authored Oct 13, 2025
```
Signed-off-by: Will Eaton <weaton@redhat.com>
```
53c9a7ce

[UX] Speedup DeepGEMM warmup with heuristics (#25619) · 0d21b9b5

Michael Goin authored Oct 13, 2025

Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

0d21b9b5

[FEATURE]: Use pydantic validation in `multimodal.py` config (#26629) · 10214b69

Anand Roy authored Oct 13, 2025

Signed-off-by: Anand Roy <86306690+andycandy@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

10214b69

[Hardware][CPU] Disable torch.compile for RISC-V to prevent APIError (#26693) · 4a61950f

ihb2032 authored Oct 13, 2025


Signed-off-by: lyd1992 <liuyudong@iscas.ac.cn>
Signed-off-by: ihb2032 <1355790728@qq.com>
Signed-off-by: lyd1992 <liuyudong@iscas.ac.cn

4a61950f

[unrevert] Add batch invariant kernel override for FlashInfer backend [2/n] (#26373) · 32637990
Bram Wasti authored Oct 13, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
Signed-off-by: Bram Wasti <bwasti@fb.com>
```
32637990
[Bugfix] Fix out of bound index issue for Jina-embedding-v3 RoPE with cuda graph (#26687) · 8e67b255
Isotr0py authored Oct 13, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
8e67b255
[ResponseAPI] Simplify input/output message serialization (#26620) · 4073c82c
Jialin Ouyang authored Oct 13, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
4073c82c
[Model][0/N] Improve all pooling task | clean up (#25817) · 767c3ab8
wang.yuqi authored Oct 13, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
767c3ab8
[Model] Add reasoning_parser and tool_parser for Ernie45 thinking (#25027) · 782505ed
CSWYF3634076 authored Oct 13, 2025
```
Signed-off-by: wangyafeng <wangyafeng@baidu.com>
```
782505ed
[Model] Fix Skywork R1V mlp (#26673) · 98f30b8c
Jee Jee Li authored Oct 13, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
98f30b8c
[FIX] Throwing an exception when the model does not support pool tasks (#25840) (#25855) · 46ad7395
yyzxw authored Oct 13, 2025
```
Signed-off-by: zxw <1020938856@qq.com>
Co-authored-by: wang.yuqi <noooop@126.com>
```
46ad7395
[Bugfix][Core]Fix block table out-of-range issue in priority scheduling (#26661) · 41f38844
quanliu authored Oct 13, 2025
```
Signed-off-by: quanliu <18646313696@163.com>
```
41f38844
[Misc] cache result of disable_inplace (#26666) · 60e419c1
bnellnm authored Oct 12, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
60e419c1

12 Oct, 2025 9 commits

[easy] fix pre commit error on trunk (#26665) · 4fca1a1b
Huamin Li authored Oct 12, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
4fca1a1b
[Models][Qwen3VL] Speedup `fast_pos_embed_interpolate` (#26647) · a6049be7
Lukas Geiger authored Oct 12, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
a6049be7
[Feature] Add support for naver/splade-v3 (BERT-based sparse embedding model) (#26339) · 18ed7746
gjgjos authored Oct 13, 2025
```
Signed-off-by: gjgjos <gjgjos@naver.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
18ed7746
Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
8fcaaf6a
[Bugfix][DCP] Set default CUDAGraphMode to PIECEWISE for DCP (#26574) · b91d8db8
Jaya Yuan authored Oct 12, 2025
```
Signed-off-by: FENP <32334296+FENP@users.noreply.github.com>
```
b91d8db8
[Bugfix][CI/Build] Fix failing Mteb CI (#26638) · 045b396d
Isotr0py authored Oct 12, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
045b396d

[MISC] Rename the torch profiler filename as instance_id+rank_id for merging... · 76852017

wang.yuqi authored Oct 12, 2025


[MISC] Rename the torch profiler filename as instance_id+rank_id for merging the Profiler results of each Rank (#25867)
Signed-off-by: wang.yuqi <noooop@126.com>

76852017

[PERF] [Qwen3-next] Speed up gated RMSNorm (#26207) · 82e64c7a

Vadim Gimpelson authored Oct 12, 2025

Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
Signed-off-by: Vadim Gimpelson <156319763+vadiklyutiy@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

82e64c7a

[EPLB] Support ernie4.5-moe (#22100) · c5c8f5ea

Haisheng Chen authored Oct 11, 2025


Signed-off-by: Haisheng Chen <langzs335@outlook.com>
Signed-off-by: Haisheng Chen <60504847+HsChen-sys@users.noreply.github.com>
Signed-off-by: Haisheng Chen <hac048@ucsd.edu>
Co-authored-by: Haisheng Chen <langzs335@outlook.com>

c5c8f5ea

11 Oct, 2025 7 commits
- [compile] Fix inductor partition config (#26645) · 01653a91
  Angela Yi authored Oct 11, 2025
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  01653a91
- CP: make correct_attn_out robust to 4‑D views and fix Triton arg binding (#26509) · 0cd103e7
  Huamin Li authored Oct 11, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  0cd103e7
- [Benchmark] Support Infinity API (#26641) · 5be7ca1b
  Cyrus Leung authored Oct 12, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5be7ca1b
- [Bugfix] Fix qwen-moe packed_modules_mapping (#26634) · f0a30a06
  Jee Jee Li authored Oct 11, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  f0a30a06
- [Bugfix][Qwen3VL] fix deepstack in qwen3vl (#26626) · 9d6cff3e
  JJJYmmm authored Oct 11, 2025
```
Signed-off-by: liuye.hj <liuye.hj@alibaba-inc.com>
Signed-off-by: JJJYmmm <92386084+JJJYmmm@users.noreply.github.com>
Co-authored-by: liuye.hj <liuye.hj@alibaba-inc.com>
```
  9d6cff3e
- [compile] Add patched_fused_scaled_matmul_reduce_scatter (#26604) · a25f2ade
  Angela Yi authored Oct 11, 2025
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  a25f2ade
- [Refactor]Reduce duplicate code in serving_chat (#26627) · d0bed837
  Chauncey authored Oct 11, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  d0bed837