Commits · 9e6bcda3ac13b97ea620155c8dc98ca434cdb234 · OpenDAS / vllm_cscc

"include/vscode:/vscode.git/clone" did not exist on "1cf5003179970b3ce9f8252395962810adb50f76"

28 Nov, 2025 8 commits
- [mypy] Enable type checking for more directories (#29674) · 9e6bcda3
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9e6bcda3
- Guard FlashInfer sampler using the same check as FlashInfer attention backend (#29415) · 9eec282c
  Harry Mellor authored Nov 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  9eec282c
- [BugFix] Fix spec decoding max_tokens scheduling perf issue (#29542) · 8e7a8916
  Nick Hill authored Nov 28, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  8e7a8916
- [mypy] Pass type checking for `vllm/utils` and `vllm/v1/pool` (#29666) · 953d9c82
  Cyrus Leung authored Nov 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  953d9c82
- [Doc] Improve abnormal information string (#29655) · cc0f2a0e
  maang-h authored Nov 28, 2025
```
Signed-off-by: maang <maang_h@163.com>
```
  cc0f2a0e
- Improve enable chunked_prefill & prefix_caching logic. (#26623) · f4b76056
  wang.yuqi authored Nov 28, 2025
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  f4b76056
- [Multimodal][Speculative Decoding]Eagle3 mm support, enablement on qwen3vl (#29594) · 37b15e97
  EanWang211123 authored Nov 28, 2025
```
Signed-off-by: Tsai, Louie <louie.tsai@intel.com>
Signed-off-by: EanWang211123 <wangyiheng@sangfor.com.cn>
Co-authored-by: Louie Tsai <louie.tsai@intel.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  37b15e97
- [BugFix] Fix ValueError in NewRequestData repr methods (#29392) · c7ba1f6b
  maang-h authored Nov 28, 2025
```
Signed-off-by: maang <maang_h@163.com>
```
  c7ba1f6b
27 Nov, 2025 13 commits
- [BugFix] Fix new nightly failures (#29578) · be493e0b
  Lucas Wilkinson authored Nov 27, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  be493e0b
- [Model Runner V2][BugFix] Keep reference to GPU tensors in AsyncOutput (#29623) · ae0ce1be
  Woosuk Kwon authored Nov 27, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  ae0ce1be
- [BugFix] Fix `plan` API Mismatch when using latest FlashInfer (#29426) · a5345bf4
  Andrii Skliar authored Nov 27, 2025
```
Signed-off-by: Andrii Skliar <askliar@askliar-mlt.client.nvidia.com>
Co-authored-by: Andrii Skliar <askliar@askliar-mlt.client.nvidia.com>
```
  a5345bf4
- [Deprecation] Advance deprecation status (#29617) · a24ea541
  Cyrus Leung authored Nov 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a24ea541
- [Attention] Update attention imports (#29540) · fc1d8be3
  Matthew Bonanni authored Nov 27, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  fc1d8be3
- [Doc]: fixing typos in diverse files (#29492) · 66d3d542
  Didier Durand authored Nov 27, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  66d3d542
- [Bugfix] Fix pre-commit (#29601) · e6d4f3c2
  Cyrus Leung authored Nov 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e6d4f3c2
- [Frontend][torch.compile] CompilationConfig Overhaul (#20283): Set up -O infrastructure (#26847) · 0838b52e
  Morrison Turnansky authored Nov 27, 2025
```
Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: adabeyta <aabeyta@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Co-authored-by: adabeyta <aabeyta@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0838b52e
- [Model Runner V2] Implement multi-step Eagle with CUDA graph (#29559) · da3222f3
  Woosuk Kwon authored Nov 27, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  da3222f3
- [Model Runner V2] Refactor CudaGraphManager (#29583) · 11ea5ec1
  Woosuk Kwon authored Nov 26, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  11ea5ec1
- [Model Runner V2] Minor cleanup for build_attn_metadata (#29576) · ee80aee1
  Woosuk Kwon authored Nov 26, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  ee80aee1
- [Model Runner V2] Minor code cleanup (#29570) · 0aeb698b
  Woosuk Kwon authored Nov 26, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  0aeb698b
- [Attention][Async] Eliminate `seq_lens_cpu` in FlashAttention metadata... · 77740191
  Matthew Bonanni authored Nov 26, 2025
```
[Attention][Async] Eliminate `seq_lens_cpu` in FlashAttention metadata building with DCP > 1 (#29449)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  77740191
26 Nov, 2025 5 commits
- [TPU] add tpu_inference (#27277) · ba1fcd84
  Johnny Yang authored Nov 26, 2025
```
Signed-off-by: Johnny Yang <johnnyyang@google.com>
```
  ba1fcd84
- [Core] Refactor padding logic and pad for CUDA graphs before attention metadata building (#28579) · 56539cdd
  Lucas Wilkinson authored Nov 26, 2025
  
  56539cdd
- [Attention] Remove imports from `vllm/attention/__init__.py` (#29342) · 430dd4d9
  Matthew Bonanni authored Nov 26, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  430dd4d9
- [Performance][MLA][ROCm] Remove redundant D2D copy in deepseek (#27457) · d9d342d2
  Pleaplusone authored Nov 26, 2025
```
Signed-off-by: ganyi <ygan@amd.com>
```
  d9d342d2
- dummy run corner case (#29433) · 12866af7
  Xieyang Xu authored Nov 25, 2025
  
  12866af7
25 Nov, 2025 14 commits

[BugFix] Fix initialization of draft model. (#29319) · de75b0bb

Andrey Khalyavin authored Nov 26, 2025


Signed-off-by: Andrey Khalyavin <halyavin@yandex-team.ru>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>

de75b0bb

[Core] Support logprobs with spec decode + async scheduling (#29223) · 4e57c658
Nick Hill authored Nov 25, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
4e57c658

Scheduled removal of `override_pooler_config` and `disable_log_requests` (#29402) · a1f26768

Harry Mellor authored Nov 25, 2025


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

a1f26768

[Hybrid Allocator] Support KV cache groups with different block_size (#29143) · 48ddb02b
Yifan Qiao authored Nov 25, 2025
```
Signed-off-by: Yifan Qiao <yifanqiao@berkeley.edu>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
```
48ddb02b
Revert back to torch.equal over torch.allclose from #28819 (#29086) · 0231ce83
Eldar Kurtić authored Nov 25, 2025
```
Signed-off-by: Eldar Kurtic <8884008+eldarkurtic@users.noreply.github.com>
```
0231ce83
[Bugfix] Fix overallocation in MM profiling (#29386) · c2c661af
Roger Wang authored Nov 25, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
c2c661af

[Core] Generalize Encoder-Decoder `seq_lens` computation to avoid Whisper... · 798e87db

Nicolò Lucchesi authored Nov 25, 2025


[Core] Generalize Encoder-Decoder `seq_lens` computation to avoid Whisper hardcoded logic   (#29268)
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>

798e87db

[BugFix] bad_words filtering ineffective when n > 1 (#29313) · 32c40b95
Avishek Goswami authored Nov 25, 2025
```
Signed-off-by: GOavi101 <1704178@kiit.ac.in>
```
32c40b95
[Bugfix] If chunked_prefill is disabled, end the scheduling early. (#28911) · 67fc16cd
wang.yuqi authored Nov 25, 2025
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
67fc16cd

EAGLE Support DP>1 (#26086) · 12c007e2

Rémi Delacourt authored Nov 25, 2025


Signed-off-by: Rémi Delacourt <remi@mistral.ai>
Signed-off-by: Rémi Delacourt <54138269+Flechman@users.noreply.github.com>
Signed-off-by: remi <remi@mistral.ai>

12c007e2

[Attention] add `_cudagraph_support` for linear attention (#28934) · 81db702e
Jiangyun Zhu authored Nov 25, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
81db702e

[Model] Add HunyuanOCR support (#29327) · 92effb07

Isotr0py authored Nov 25, 2025


Signed-off-by: manayang <jackmanayang@gmail.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: sergeywang <sergeywang@tencent.com>
Co-authored-by: manayang <jackmanayang@gmail.com>
Co-authored-by: manayang <manayang@tencent.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

92effb07

[Metrics] Scheduled removal of deprecated metrics (#29330) · 9cf4edae
Mark McLoughlin authored Nov 25, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
9cf4edae

[ROCm][MLA] enable fp8 MLA decode on ROCm (#28032) · cb7214d8

gbyu-amd authored Nov 25, 2025


Signed-off-by: guanbao <gyu@amd.com>
Signed-off-by: Guanbao Yu <gyu@amd.com>
Signed-off-by: gbyu-amd <Guanbao.Yu@amd.com>
Co-authored-by: guanbao <gyu@amd.com>

cb7214d8