Commits · 2e36cdbe2b4bff4370a02105fdfbdd015d6ec4e8 · OpenDAS / vllm_cscc

14 Oct, 2025 9 commits
- [Docs] Add a start tag to build.inc.md (#26747) · 2e36cdbe
  Michael Yao authored Oct 14, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  2e36cdbe
- Add support for the /rerank endpoint in vllm bench serve (#26602) · fe3edb4c
  Maximilien de Bayser authored Oct 14, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  fe3edb4c
- [Feature][Quantization] auto_round format add support for regex (#24024) · 29350922
  Heng Guo authored Oct 14, 2025
```
Signed-off-by: n1ck-guo <heng.guo@intel.com>
Signed-off-by: Heng Guo <heng.guo@intel.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  29350922
- [torch.compile] Unwrap fused_marlin_moe custom op (#26739) · 8ae16928
  Varun Sundar Rabindranath authored Oct 13, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  8ae16928
- [build][torch.compile] upgrade depyf version (#26702) · 8a0af6a5
  youkaichao authored Oct 14, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  8a0af6a5
- [Easy] Fix env type check errors from VLLM_DEBUG_LOG_API_SERVER_RESPONSE (#26742) · cfded807
  Jialin Ouyang authored Oct 13, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  cfded807
- [compile] Enable sequence parallelism for full cuda graph without specifying compile sizes (#26681) · b59dd19b
  Angela Yi authored Oct 13, 2025
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  b59dd19b
- [UX] Replace VLLM_ALL2ALL_BACKEND with --all2all-backend (#26732) · 3e051bda
  Michael Goin authored Oct 13, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  3e051bda
- [Misc][DP] support customized aggregated logger for dp (#24354) · 8317f723
  Lucia Fang authored Oct 13, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
```
  8317f723
13 Oct, 2025 31 commits

Add tests for chunked prefill and prefix cache with causal pooling models (#26526) · d8bebb00
Maximilien de Bayser authored Oct 13, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Ayush Singh <ayush1009208@gmail.com>
```
d8bebb00
[ResponseAPI] Further polish message serialization and unit tests (#26728) · 35bc22f2
Jialin Ouyang authored Oct 13, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
35bc22f2
Pruning kernel Core Tests (#26727) · fa96fb9c
Fardin Hoque authored Oct 13, 2025
```
Signed-off-by: Fardin Hoque <kfhfar@amazon.com>
```
fa96fb9c

[FrontEnd] UNREVERT CompilationConfig overhaul (#20283): deprecate... · e3fdb627

Morrison Turnansky authored Oct 13, 2025


[FrontEnd] UNREVERT CompilationConfig overhaul (#20283): deprecate use_inductor in favor of backend, simplify custom_ops  (#26502)
Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>

e3fdb627

[Bug] Fix Assertion error DeepEP/csrc/kernels/intranode.cu:928: 'false and... · 7200a21c

Wentao Ye authored Oct 13, 2025


[Bug] Fix Assertion error DeepEP/csrc/kernels/intranode.cu:928: 'false and Unsupported type' (#26532)
Signed-off-by: yewentao256 <zhyanwentao@126.com>

7200a21c

[CI Perf]Prune Tests in kernel/mamba (#26538) · 577c72a2

Fardin Hoque authored Oct 13, 2025

Signed-off-by: Fardin Hoque <kfhfar@amazon.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

577c72a2

[CI] Fix mypy for `vllm/distributed` (#26593) · 314285d4

Wentao Ye authored Oct 13, 2025

Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

314285d4

[Frontend][1/N] Improve all pooling task | Support FP16 Embedding Base64... · d2a79385

wang.yuqi authored Oct 14, 2025


[Frontend][1/N] Improve all pooling task | Support FP16 Embedding Base64 (Still uses fp32 by default). (#26414)
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Maximilien de Bayser <maxdebayser@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

d2a79385

[Quantization] [Performance] Enable Marlin GEMM kernels for the... · 89342ce4

Alex Kogan authored Oct 13, 2025


[Quantization] [Performance] Enable Marlin GEMM kernels for the calibration-free RTN-based quantization (#26051)
Signed-off-by: Alex Kogan <alex.kogan@oracle.com>
Signed-off-by: Alex Kogan <82225080+sakogan@users.noreply.github.com>

89342ce4

[CI][Release][Arm64]: Build arm64 release for gpu arch 8.9 (#26698) · f89f5993
Yibo Cai authored Oct 14, 2025

f89f5993
[Log] Optimize Startup Log (#26601) · e251e457
Wentao Ye authored Oct 13, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
e251e457
[Model] Use merge_by_field_config for MM models (M-N) (#26710) · afc47e4d
Cyrus Leung authored Oct 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
afc47e4d
[Bugfix][Speculative Decoding] Extend Eagle quantization config fix to llama_eagle.py (#26590) · e3b90c1b
Rahul Tuli authored Oct 13, 2025
```
Signed-off-by: Rahul Tuli <rtuli@redhat.com>
```
e3b90c1b

[Bugfix][Rocm] fix qr error when different inp shape (#25892) · 134f70b3

haoyangli-amd authored Oct 14, 2025


Signed-off-by: Haoyang Li <lihaoyang0109@gmail.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: ilmarkov <markovilya197@gmail.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

134f70b3

[CI/Build] upgrade compressed-tensors to 0.12.2 to address LGPLv3 (#26501) · a1b2d658
Sangyeon Cho authored Oct 14, 2025
```
Signed-off-by: Sangyeon Cho <josang1204@gmail.com>
```
a1b2d658
[Misc] Separate prompt logging to debug (#26713) · 5c7fe254
Aleksei Tsvetkov authored Oct 13, 2025
```
Signed-off-by: Aleksei Tsvetkov <aitsvet@ya.ru>
```
5c7fe254
[P/D] [NixlConnector] kv load recovery integration (#26171) · 53c9a7ce
Will Eaton authored Oct 13, 2025
```
Signed-off-by: Will Eaton <weaton@redhat.com>
```
53c9a7ce

[UX] Speedup DeepGEMM warmup with heuristics (#25619) · 0d21b9b5

Michael Goin authored Oct 13, 2025

Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

0d21b9b5

[FEATURE]: Use pydantic validation in `multimodal.py` config (#26629) · 10214b69

Anand Roy authored Oct 13, 2025

Signed-off-by: Anand Roy <86306690+andycandy@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

10214b69

[Hardware][CPU] Disable torch.compile for RISC-V to prevent APIError (#26693) · 4a61950f

ihb2032 authored Oct 13, 2025


Signed-off-by: lyd1992 <liuyudong@iscas.ac.cn>
Signed-off-by: ihb2032 <1355790728@qq.com>
Signed-off-by: lyd1992 <liuyudong@iscas.ac.cn

4a61950f

[unrevert] Add batch invariant kernel override for FlashInfer backend [2/n] (#26373) · 32637990
Bram Wasti authored Oct 13, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
Signed-off-by: Bram Wasti <bwasti@fb.com>
```
32637990
[Bugfix] Fix out of bound index issue for Jina-embedding-v3 RoPE with cuda graph (#26687) · 8e67b255
Isotr0py authored Oct 13, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
8e67b255
[ResponseAPI] Simplify input/output message serialization (#26620) · 4073c82c
Jialin Ouyang authored Oct 13, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
4073c82c
[Model][0/N] Improve all pooling task | clean up (#25817) · 767c3ab8
wang.yuqi authored Oct 13, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
767c3ab8
Ignore large reformatting PRs in `git blame` (#26690) · 4f207c71
Harry Mellor authored Oct 13, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
4f207c71
[Model] Add reasoning_parser and tool_parser for Ernie45 thinking (#25027) · 782505ed
CSWYF3634076 authored Oct 13, 2025
```
Signed-off-by: wangyafeng <wangyafeng@baidu.com>
```
782505ed
[Model] Fix Skywork R1V mlp (#26673) · 98f30b8c
Jee Jee Li authored Oct 13, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
98f30b8c
docs: wrong command in structured_outputs README (#26677) · 3cd36660
yihong authored Oct 13, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
3cd36660
[FIX] Throwing an exception when the model does not support pool tasks (#25840) (#25855) · 46ad7395
yyzxw authored Oct 13, 2025
```
Signed-off-by: zxw <1020938856@qq.com>
Co-authored-by: wang.yuqi <noooop@126.com>
```
46ad7395
[Bugfix][Core]Fix block table out-of-range issue in priority scheduling (#26661) · 41f38844
quanliu authored Oct 13, 2025
```
Signed-off-by: quanliu <18646313696@163.com>
```
41f38844
[Misc] cache result of disable_inplace (#26666) · 60e419c1
bnellnm authored Oct 12, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
60e419c1