Commits · 4ccffe561f0bc9fe007fdaafe8342171592db7db · OpenDAS / vllm_cscc

12 Nov, 2025 1 commit

[Core] Encoder separation for Encode-Prefill-Decode Disaggregation (#25233) · 4ccffe56

Chenguang Zheng authored Nov 12, 2025


Signed-off-by: n00909098 <nguyen.kha.long@huawei.com>
Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Signed-off-by: herotai214 <herotai214@gmail.com>
Signed-off-by: Khuong Le <khuong.le.manh@huawei.com>
Signed-off-by: Khuong Le <lemanhkhuong2611@gmail.com>
Co-authored-by: n00909098 <nguyen.kha.long@huawei.com>
Co-authored-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Co-authored-by: herotai214 <herotai214@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Khuong Le <khuong.le.manh@huawei.com>
Co-authored-by: Khuong Le <lemanhkhuong2611@gmail.com>

4ccffe56

11 Nov, 2025 2 commits
- [Model] Pass `mm_features` directly into `get_mrope_input_positions` (#28399) · afffd3cc
  Cyrus Leung authored Nov 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  afffd3cc
- [Attention] Refactor CUDA attention backend selection logic (#24794) · b30dfa03
  Matthew Bonanni authored Nov 11, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  b30dfa03
10 Nov, 2025 3 commits
- [Bugfix] Ensure calculated KV scales are applied in attention. (#27232) · a5a790ee
  Adrian Abeyta authored Nov 10, 2025
```
Signed-off-by: adabeyta <aabeyta@redhat.com>
```
  a5a790ee
- [Misc] Add more scoping for improved trace (#28329) · bf6a3d0f
  Wei Wei authored Nov 10, 2025
```
Signed-off-by: Wei Wei <wwei6@meta.com>
```
  bf6a3d0f
- [V0 deprecation] Remove no longer used `get_metadata_cls` (#28370) · e8697faf
  Lucas Wilkinson authored Nov 10, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  e8697faf
09 Nov, 2025 2 commits
- [Core] Separate out attention metadata building logic from prepare inputs (#26764) · 636efd10
  Lucas Wilkinson authored Nov 09, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  636efd10
- [Misc] fix typo and add detailed log (#28178) · e5e9067e
  Ning Xie authored Nov 09, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  e5e9067e
08 Nov, 2025 3 commits

[DCP] Support dcp kv_cache interleave size > 1 (#26696) · 2108a571

zhangsicheng5 authored Nov 09, 2025


Signed-off-by: zhangsicheng5 <zhangsicheng5@huawei.com>
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Signed-off-by: Qiu <qiuchunshuo@huawei.com>
Co-authored-by: QiuChunshuo <qiuchunshuo@huawei.com>

2108a571

[bugfix] support eagle with lora cudagraph specialization (#28318) · 70af44fd
gnovack authored Nov 07, 2025
```
Signed-off-by: gnovack <gnovack@amazon.com>
```
70af44fd

[Bugfix][LoRA][Spec Decode] Support LoRA with speculative decoding (#21068) · d0c77920

Xiaohong (Sean) Chen authored Nov 07, 2025

Signed-off-by: Sean Chen <xiaohong_chen1991@hotmail.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Danielle Robinson <dcmaddix@gmail.com>
Co-authored-by: Haipeng Li <li2haipeng@gmail.com>
Co-authored-by: li2haipeng <44383182+li2haipeng@users.noreply.github.com>

d0c77920

07 Nov, 2025 1 commit
- [Core][MM] Add mechanism to configure multimodal fields which should stay on CPU (#28168) · e0919f33
  Lukas Geiger authored Nov 07, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  e0919f33
05 Nov, 2025 2 commits

[BugFix] Support EP/DP + EPLB with MTP (#25311) · e50c4546

Ilya Markov authored Nov 05, 2025


Signed-off-by: ilmarkov <markovilya197@gmail.com>
Signed-off-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>

e50c4546

[DCP] check return_lse for all layers in dcp (#27929) · 5d16d0fa
Chen Zhang authored Nov 05, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
5d16d0fa

04 Nov, 2025 1 commit
- [BugFix] Fix incorrect preallocated sampled_token_ids tensor size (#28025) · 5a0a6dfd
  Nick Hill authored Nov 04, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  5a0a6dfd
03 Nov, 2025 2 commits
- [Spec Decode] Integrate Suffix Decoding from Arctic Inference (#25784) · 2c19d967
  Aurick Qiao authored Nov 03, 2025
```
Co-authored-by: Aurick Qiao <aurick.qiao@snowflake.com>
```
  2c19d967
- [Hybrid] Pass kernel block size to builders (#27753) · 18961c5e
  Thomas Parnell authored Nov 03, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  18961c5e
01 Nov, 2025 1 commit
- [Core] Async scheduling + structured outputs compatibility (#26866) · 0cdbe7b7
  Nick Hill authored Oct 31, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  0cdbe7b7
31 Oct, 2025 2 commits
- [Hybrid] A simpler algorithm to find kernel_block_size (#26476) · df334868
  Chen Zhang authored Oct 31, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  df334868
- [BugFix] Don’t compute reorder threshold when there are no attention groups (#27861) · 933cdea4
  Huamin Li authored Oct 31, 2025
  
  933cdea4
30 Oct, 2025 3 commits
- [Core][Bookkeeping] Update cu_num_accepted_tokens for all req_index (#27629) · 4574d48b
  Jialin Ouyang authored Oct 30, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  4574d48b
- [Model] Introduce Kimi Linear to vLLM (#27809) · 4e68cc9b
  Zhiyuan Li authored Oct 30, 2025
```
Signed-off-by: lizhiyuan <lizhiyuan@moonshot.cn>
Signed-off-by: Zhiyuan Li <uniartisan2017@gmail.com>
```
  4e68cc9b
- [BugFix] Handle unscheduled requests properly when async scheduling (#27756) · 2ce5c5d3
  Nick Hill authored Oct 29, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  2ce5c5d3
28 Oct, 2025 2 commits
- [AsyncScheduling] Make async overlap work with logprobs (#27615) · 4fe58953
  Nick Hill authored Oct 28, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  4fe58953
- [Core][Bookkeeping Optimization] Update against numpy view of is_token_ids tensor (#27618) · b46e4a06
  Jialin Ouyang authored Oct 28, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  b46e4a06
27 Oct, 2025 1 commit
- [Misc] Clean up more utils (#27567) · 6ebffafb
  Cyrus Leung authored Oct 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6ebffafb
26 Oct, 2025 1 commit

[Chore]:Extract math and argparse utilities to separate modules (#27188) · 71b1c8b6

Yeshwanth N authored Oct 26, 2025


Signed-off-by: Yeshwanth Surya <yeshsurya@gmail.com>
Signed-off-by: Yeshwanth N <yeshsurya@gmail.com>
Signed-off-by: yeshsurya <yeshsurya@gmail.com>

71b1c8b6

24 Oct, 2025 4 commits

[Log] Optimize Startup Log (#26740) · 52efc34e
Wentao Ye authored Oct 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
52efc34e
[Perf][Async Scheduling] Remove CPU->GPU sync in dummy_run (#27455) · 04024282
Lehua Ding authored Oct 25, 2025
```
Signed-off-by: Lehua Ding <lehuading@tencent.com>
```
04024282

[MISC] `cudagraph_capture_sizes` related improvements (#26016) · 284cc922

fhl2000 authored Oct 24, 2025

Signed-off-by: fhl <2410591650@qq.com>
Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

284cc922

[Bugfix][CI] Move resolving cudagraph_mode before initializing attn_metadata_builder (#27427) · 85fee74b
fhl2000 authored Oct 24, 2025
```
Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
```
85fee74b

23 Oct, 2025 2 commits
- [Chore] Separate out `vllm.utils.platform_utils.py` (#27374) · ca76486a
  Jonathan Chen authored Oct 23, 2025
```
Signed-off-by: Jonathan <chenleejonathan@gmail.com>
```
  ca76486a
- [V1][spec decode] return logprobs for spec decoding (#26060) · 6644796b
  Giancarlo Delfin authored Oct 22, 2025
```
Signed-off-by: Giancarlo Delfin <gdelfin@meta.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  6644796b
21 Oct, 2025 1 commit
- [Bugfix] skip cuda graph for drafter when running with eager (#26821) · 19748806
  Benjamin Chislett authored Oct 21, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  19748806
20 Oct, 2025 2 commits

Nemotron Nano V2 VL + EVS Video Support (#27107) · e93ff6c8

Eugene Khvedchenya authored Oct 20, 2025


Signed-off-by: Eugene Khvedchenia <ekhvedchenia@nvidia.com>
Signed-off-by: Natan Bagrov <nbagrov@nvidia.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Natan Bagrov <nbagrov@nvidia.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

e93ff6c8

[LoRA] LoRA cuda graph specialization (#25914) · b63f2143

Andy Lo authored Oct 20, 2025


Signed-off-by: Andy Lo <andy@mistral.ai>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

b63f2143

19 Oct, 2025 1 commit

[Bugfix] Fix error with penalties when speculative decoding and structural... · f6fdacd8

Sergei Skvortsov authored Oct 19, 2025


[Bugfix] Fix error with penalties when speculative decoding and structural output are enabled (#26586)
Signed-off-by: southfreebird <yvorott@gmail.com>