Commits · 7200a21cd14d48d548be4ce4af1870d3caf1a994 · OpenDAS / vllm_cscc · GitLab

13 Oct, 2025 27 commits
- [Bug] Fix Assertion error DeepEP/csrc/kernels/intranode.cu:928: 'false and... · 7200a21c
  Wentao Ye authored Oct 13, 2025
```
[Bug] Fix Assertion error DeepEP/csrc/kernels/intranode.cu:928: 'false and Unsupported type' (#26532)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  7200a21c
- [CI Perf]Prune Tests in kernel/mamba (#26538) · 577c72a2
  Fardin Hoque authored Oct 13, 2025
```
Signed-off-by: Fardin Hoque <kfhfar@amazon.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  577c72a2
- [CI] Fix mypy for `vllm/distributed` (#26593) · 314285d4
  Wentao Ye authored Oct 13, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  314285d4
- [Frontend][1/N] Improve all pooling task | Support FP16 Embedding Base64... · d2a79385
  wang.yuqi authored Oct 14, 2025
```
[Frontend][1/N] Improve all pooling task | Support FP16 Embedding Base64 (Still uses fp32 by default). (#26414)
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Maximilien de Bayser <maxdebayser@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  d2a79385
- [Quantization] [Performance] Enable Marlin GEMM kernels for the... · 89342ce4
  Alex Kogan authored Oct 13, 2025
```
[Quantization] [Performance] Enable Marlin GEMM kernels for the calibration-free RTN-based quantization (#26051)
Signed-off-by: Alex Kogan <alex.kogan@oracle.com>
Signed-off-by: Alex Kogan <82225080+sakogan@users.noreply.github.com>
```
  89342ce4
- [CI][Release][Arm64]: Build arm64 release for gpu arch 8.9 (#26698) · f89f5993
  Yibo Cai authored Oct 14, 2025
  
  f89f5993
- [Log] Optimize Startup Log (#26601) · e251e457
  Wentao Ye authored Oct 13, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  e251e457
- [Model] Use merge_by_field_config for MM models (M-N) (#26710) · afc47e4d
  Cyrus Leung authored Oct 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  afc47e4d
- [Bugfix][Speculative Decoding] Extend Eagle quantization config fix to llama_eagle.py (#26590) · e3b90c1b
  Rahul Tuli authored Oct 13, 2025
```
Signed-off-by: Rahul Tuli <rtuli@redhat.com>
```
  e3b90c1b
- [Bugfix][Rocm] fix qr error when different inp shape (#25892) · 134f70b3
  haoyangli-amd authored Oct 14, 2025
```
Signed-off-by: Haoyang Li <lihaoyang0109@gmail.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: ilmarkov <markovilya197@gmail.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  134f70b3
- [CI/Build] upgrade compressed-tensors to 0.12.2 to address LGPLv3 (#26501) · a1b2d658
  Sangyeon Cho authored Oct 14, 2025
```
Signed-off-by: Sangyeon Cho <josang1204@gmail.com>
```
  a1b2d658
- [Misc] Separate prompt logging to debug (#26713) · 5c7fe254
  Aleksei Tsvetkov authored Oct 13, 2025
```
Signed-off-by: Aleksei Tsvetkov <aitsvet@ya.ru>
```
  5c7fe254
- [P/D] [NixlConnector] kv load recovery integration (#26171) · 53c9a7ce
  Will Eaton authored Oct 13, 2025
```
Signed-off-by: Will Eaton <weaton@redhat.com>
```
  53c9a7ce
- [UX] Speedup DeepGEMM warmup with heuristics (#25619) · 0d21b9b5
  Michael Goin authored Oct 13, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  0d21b9b5
- [FEATURE]: Use pydantic validation in `multimodal.py` config (#26629) · 10214b69
  Anand Roy authored Oct 13, 2025
```
Signed-off-by: Anand Roy <86306690+andycandy@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  10214b69
- [Hardware][CPU] Disable torch.compile for RISC-V to prevent APIError (#26693) · 4a61950f
  ihb2032 authored Oct 13, 2025
```
Signed-off-by: lyd1992 <liuyudong@iscas.ac.cn>
Signed-off-by: ihb2032 <1355790728@qq.com>
Signed-off-by: lyd1992 <liuyudong@iscas.ac.cn
```
  4a61950f
- [unrevert] Add batch invariant kernel override for FlashInfer backend [2/n] (#26373) · 32637990
  Bram Wasti authored Oct 13, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
Signed-off-by: Bram Wasti <bwasti@fb.com>
```
  32637990
- [Bugfix] Fix out of bound index issue for Jina-embedding-v3 RoPE with cuda graph (#26687) · 8e67b255
  Isotr0py authored Oct 13, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  8e67b255
- [ResponseAPI] Simplify input/output message serialization (#26620) · 4073c82c
  Jialin Ouyang authored Oct 13, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  4073c82c
- [Model][0/N] Improve all pooling task | clean up (#25817) · 767c3ab8
  wang.yuqi authored Oct 13, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  767c3ab8
- Ignore large reformatting PRs in `git blame` (#26690) · 4f207c71
  Harry Mellor authored Oct 13, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4f207c71
- [Model] Add reasoning_parser and tool_parser for Ernie45 thinking (#25027) · 782505ed
  CSWYF3634076 authored Oct 13, 2025
```
Signed-off-by: wangyafeng <wangyafeng@baidu.com>
```
  782505ed
- [Model] Fix Skywork R1V mlp (#26673) · 98f30b8c
  Jee Jee Li authored Oct 13, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  98f30b8c
- docs: wrong command in structured_outputs README (#26677) · 3cd36660
  yihong authored Oct 13, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  3cd36660
- [FIX] Throwing an exception when the model does not support pool tasks (#25840) (#25855) · 46ad7395
  yyzxw authored Oct 13, 2025
```
Signed-off-by: zxw <1020938856@qq.com>
Co-authored-by: wang.yuqi <noooop@126.com>
```
  46ad7395
- [Bugfix][Core]Fix block table out-of-range issue in priority scheduling (#26661) · 41f38844
  quanliu authored Oct 13, 2025
```
Signed-off-by: quanliu <18646313696@163.com>
```
  41f38844
- [Misc] cache result of disable_inplace (#26666) · 60e419c1
  bnellnm authored Oct 12, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  60e419c1
12 Oct, 2025 12 commits
- [CI/Build] Add tool to build vllm-tpu wheel (#19165) · 7ef60528
  Michael Goin authored Oct 12, 2025
```
Signed-off-by: mgoin <michael@neuralmagic.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  7ef60528
- [easy] fix pre commit error on trunk (#26665) · 4fca1a1b
  Huamin Li authored Oct 12, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  4fca1a1b
- [Models][Qwen3VL] Speedup `fast_pos_embed_interpolate` (#26647) · a6049be7
  Lukas Geiger authored Oct 12, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  a6049be7
- [Feature] Add support for naver/splade-v3 (BERT-based sparse embedding model) (#26339) · 18ed7746
  gjgjos authored Oct 13, 2025
```
Signed-off-by: gjgjos <gjgjos@naver.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  18ed7746
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
- [Bugfix] Fix GPU_ID issue in test script (#26442) · 9bb38130
  Chendi.Xue authored Oct 12, 2025
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
```
  9bb38130
- [Bugfix][DCP] Set default CUDAGraphMode to PIECEWISE for DCP (#26574) · b91d8db8
  Jaya Yuan authored Oct 12, 2025
```
Signed-off-by: FENP <32334296+FENP@users.noreply.github.com>
```
  b91d8db8
- [Bugfix][CI/Build] Fix failing Mteb CI (#26638) · 045b396d
  Isotr0py authored Oct 12, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  045b396d
- [MISC] Rename the torch profiler filename as instance_id+rank_id for merging... · 76852017
  wang.yuqi authored Oct 12, 2025
```
[MISC] Rename the torch profiler filename as instance_id+rank_id for merging the Profiler results of each Rank (#25867)
Signed-off-by: wang.yuqi <noooop@126.com>
```
  76852017
- [PERF] [Qwen3-next] Speed up gated RMSNorm (#26207) · 82e64c7a
  Vadim Gimpelson authored Oct 12, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
Signed-off-by: Vadim Gimpelson <156319763+vadiklyutiy@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  82e64c7a
- Add @noooop to codeowner for pooling models (#26652) · 4ca20405
  wang.yuqi authored Oct 12, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  4ca20405
- [EPLB] Support ernie4.5-moe (#22100) · c5c8f5ea
  Haisheng Chen authored Oct 11, 2025
```
Signed-off-by: Haisheng Chen <langzs335@outlook.com>
Signed-off-by: Haisheng Chen <60504847+HsChen-sys@users.noreply.github.com>
Signed-off-by: Haisheng Chen <hac048@ucsd.edu>
Co-authored-by: Haisheng Chen <langzs335@outlook.com>
```
  c5c8f5ea
11 Oct, 2025 1 commit
- [compile] Fix inductor partition config (#26645) · 01653a91
  Angela Yi authored Oct 11, 2025
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  01653a91