Commits · 82a64b3d8f93521d39569078d4ac56992a50a640 · OpenDAS / vllm_cscc

"tests/spec_decode/e2e/untest_logprobs.py" did not exist on "955b5191c966296e22cc0d9207d68665df90e2c9"

04 Dec, 2025 7 commits
- [Bugfix] fixed deepseekv32 tool calling error (#30025) · 82a64b3d
  Chauncey authored Dec 04, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  82a64b3d
- [Misc] Various cleanups for MM input processing (#29970) · 9ae2f603
  Cyrus Leung authored Dec 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9ae2f603
- [KVConnector] remove unused code (the model aware kv ops class) (#29709) · 8aaa81b3
  Kuntai Du authored Dec 04, 2025
```
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
```
  8aaa81b3
- [Frontend] Fixes anthropic /v1/messages streaming not containing input_tokens... · fca3f466
  Benjamin Bartels authored Dec 04, 2025
```
[Frontend] Fixes anthropic /v1/messages streaming not containing input_tokens on first chunk (#29971)
Signed-off-by: bbartels <benjamin@bartels.dev>
```
  fca3f466
- [Bugfix][CPU] Fix CPU KV cache fallback memory allocation (#29604) · 28097d56
  gausah01 authored Dec 04, 2025
```
Signed-off-by: Gauri Sahnan <gauri.sahnan@arm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
```
  28097d56
- [Bugfix] Fix adapter_enabled IMA (#29977) · dd38ba3a
  Jee Jee Li authored Dec 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  dd38ba3a
- enable multi-node in external launcher mode (#29833) · ad32e3e1
  Xieyang Xu authored Dec 03, 2025
  
  ad32e3e1
03 Dec, 2025 27 commits

[CI] fix docker image build by specifying merge-base commit id when... · 1109f982

Shengqi Chen authored Dec 04, 2025


[CI] fix docker image build by specifying merge-base commit id when downloading pre-compiled wheels (#29930)
Signed-off-by: Shengqi Chen <harry-chen@outlook.com>

1109f982

[Bugfix] Respect VLLM_CONFIGURE_LOGGING value (#28671) · b5407869

Elizabeth Thomas authored Dec 03, 2025


Signed-off-by: Elizabeth Thomas <email2eliza@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Jane Xu <janeyx@meta.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Johnny Yang <johnnyyang@google.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: bruceszchen <bruceszchen@tencent.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Jane (Yuan) Xu <31798555+janeyx99@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Johnny Yang <24908445+jcyang43@users.noreply.github.com>

b5407869

[Kernels] Remove BatchedTritonOrDeepGemmExperts and default fallback to Triton (#29929) · 2902c348

bnellnm authored Dec 03, 2025


Signed-off-by: Bill Nell <bnell@redhat.com>
Signed-off-by: bnellnm <49004751+bnellnm@users.noreply.github.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

2902c348

[CI] Fix re import error (#29973) · ac188658
Wentao Ye authored Dec 03, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
ac188658
Fix LLMEngine.del dp_group cleanup condition (#29954) · 2fc5d6e0
Yongtao Huang authored Dec 04, 2025
```
Signed-off-by: Yongtao Huang <yongtaoh2022@gmail.com>
```
2fc5d6e0
[Bugfix] Fix flashinfer ar+norm kernel not available issue (#29960) · afe9eb40
elvischenv authored Dec 04, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
afe9eb40

[Performance][DP/EP] Add silu_mul_per_token_group_quant_fp8_colmajor kernel (#29470) · 19bee6d1

Varun Sundar Rabindranath authored Dec 03, 2025

Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

19bee6d1

[Bugfix] Mistral tool parser streaming update (#19425) · dd5d1ef7

avigny authored Dec 03, 2025


Signed-off-by: avigny <47987522+avigny@users.noreply.github.com>
Signed-off-by: Chauncey <chaunceyjiang@gmail.com>
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: Jeff Cook <jeff@jeffcook.io>
Co-authored-by: sfbemerk <benjaminmerkel@mail.de>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

dd5d1ef7

SigLIP example add chat_template (#29902) · 9ae3c55b
Yu Jiaqi authored Dec 04, 2025
```
Signed-off-by: piood <2477084691@qq.com>
```
9ae3c55b

[Core] Add xxHash as a high-performance hash option for accelerating prefix caching (#29163) · 9bcf9229

Lumis Chen authored Dec 04, 2025


Signed-off-by: LuminolT <lumischen01@gmail.com>
Signed-off-by: Lumis Chen <lumischen01@gmail.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>

9bcf9229

[Frontend] supports deepseekv32 chat template (#29837) · b78772c4
Chauncey authored Dec 03, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
b78772c4
[docker] Build CUDA kernels in separate Docker stage for faster rebuilds (#29452) · f5d3d93c
Amr Mahdi authored Dec 03, 2025
```
Signed-off-by: Amr Mahdi <amrmahdi@meta.com>
```
f5d3d93c

[refactor] CTMoEMethods to use QuantizationArgs (#28871) · b294e28d

HDCharles authored Dec 03, 2025


Signed-off-by: HDCharles <charlesdavidhernandez@gmail.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

b294e28d

[Bugfix] Follow-up fix on MediaWithBytes (#29951) · 787b84a9
Roger Wang authored Dec 03, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
787b84a9
[Bugfix][Quantization] Support BF16 tensors on GGUF (#29948) · 42c19496
Tsukasa OI authored Dec 03, 2025
```
Signed-off-by: Tsukasa OI <floss_llm@irq.a4lg.com>
```
42c19496

[Bugfix] Fix incorrect `image_grid_thw` rank for HunyuanOCR from missing... · a21cd9ed

Isotr0py authored Dec 03, 2025


[Bugfix] Fix incorrect `image_grid_thw` rank for HunyuanOCR from missing `merge_by_field_config=True` (#29950)
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

a21cd9ed

[CI] Add Async Eplb nightly CI tests (#29385) · 7fe9c1a2

WeiQing Chen authored Dec 03, 2025


Signed-off-by: David Chen <530634352@qq.com>
Signed-off-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

7fe9c1a2

[Refactor] [1/N] to simplify the vLLM serving architecture (#28040) · 3f42b05f
Chauncey authored Dec 03, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
3f42b05f
Add logging for cudagraph related info (#29825) · 69520bc6
Yong Hoon Shin authored Dec 02, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
69520bc6
[responsesAPI] support input output messages for non harmony models (#29549) · 3a775148
Andrew Xia authored Dec 02, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
3a775148
[Misc] Allow `fetch_*` utils to access local files by default (#29932) · bbfb55c2
Cyrus Leung authored Dec 03, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
bbfb55c2
[BugFix] fix imgs_pos in hunyuan_vl (#29879) · 0bec63fa
JackieWu authored Dec 03, 2025
```
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
0bec63fa

[Bugfix] Defunctionalize TRTLLM AR+Norm op for avoiding extra clone kernel before it (#29631) · c719c405

elvischenv authored Dec 03, 2025

Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

c719c405

[Docs] Discuss api key limitations in security guide (#29922) · b08025a8
Russell Bryant authored Dec 02, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
b08025a8

[Core] Rename PassConfig flags as per RFC #27995 (#29646) · d7284a26

Arpit Khandelwal authored Dec 02, 2025


Signed-off-by: arpitkh101 <arpit5khandelwal@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

d7284a26

[Bugfix] Fix regression on pooling models from PR#29621 (#29921) · 4dd79783

Roger Wang authored Dec 02, 2025


Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

4dd79783

[BugFix] Fix assert in `build_for_cudagraph_capture` (#29893) · 5cdd6645
Lucas Wilkinson authored Dec 02, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
5cdd6645

02 Dec, 2025 6 commits
- [Doc] Add allocate_slots parameter docs (#29777) · 5d91d2b2
  maang-h authored Dec 03, 2025
```
Signed-off-by: maang <maang_h@163.com>
Signed-off-by: maang-h <55082429+maang-h@users.noreply.github.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
```
  5d91d2b2
- [BUGFIX] Fix regex pattern for Mistral Tool Call (#29918) · 1b1e35aa
  Julien Denize authored Dec 02, 2025
```
Signed-off-by: juliendenize <julien.denize@mistral.ai>
```
  1b1e35aa
- [BUGFIX] llama_4_scaling wrongly passed to DeepseekAttention (#29908) · 5e5646e2
  Julien Denize authored Dec 02, 2025
```
Signed-off-by: juliendenize <julien.denize@mistral.ai>
```
  5e5646e2
- [Bugfix] fix --scheduling-policy=priority & n>1 crashes engine (#29764) · 0a9caca9
  Chauncey authored Dec 03, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  0a9caca9
- [Bugfix][EPLB] Prevent user-provided EPLB config from being overwritten with defaults (#29911) · e6f114ac
  Sage Moore authored Dec 02, 2025
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  e6f114ac
- Fix some more Transformers nightly tests (#29872) · 6fc5841d
  Harry Mellor authored Dec 02, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6fc5841d