Commits · ea3370b428e1b192d29a4451d439f4ed0895f1f3 · OpenDAS / vllm_cscc

"vllm/vscode:/vscode.git/clone" did not exist on "2fa2a50bf950797cb59d48908d205c655ec02654"

28 Nov, 2025 2 commits
- [Perf] Optimize EAGLE prepare_inputs_padded with triton kernels (#28597) · 1986de13
  Benjamin Chislett authored Nov 28, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
```
  1986de13
- [Doc]: fixing typos in multiple files. (#29685) · fae69430
  Didier Durand authored Nov 28, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  fae69430
27 Nov, 2025 10 commits
- [BugFix] Fix new nightly failures (#29578) · be493e0b
  Lucas Wilkinson authored Nov 27, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  be493e0b
- [Model Runner V2][BugFix] Keep reference to GPU tensors in AsyncOutput (#29623) · ae0ce1be
  Woosuk Kwon authored Nov 27, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  ae0ce1be
- [Attention] Update attention imports (#29540) · fc1d8be3
  Matthew Bonanni authored Nov 27, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  fc1d8be3
- [Doc]: fixing typos in diverse files (#29492) · 66d3d542
  Didier Durand authored Nov 27, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  66d3d542
- [Bugfix] Fix pre-commit (#29601) · e6d4f3c2
  Cyrus Leung authored Nov 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e6d4f3c2
- [Frontend][torch.compile] CompilationConfig Overhaul (#20283): Set up -O infrastructure (#26847) · 0838b52e
  Morrison Turnansky authored Nov 27, 2025
```
Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: adabeyta <aabeyta@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Co-authored-by: adabeyta <aabeyta@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0838b52e
- [Model Runner V2] Implement multi-step Eagle with CUDA graph (#29559) · da3222f3
  Woosuk Kwon authored Nov 27, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  da3222f3
- [Model Runner V2] Refactor CudaGraphManager (#29583) · 11ea5ec1
  Woosuk Kwon authored Nov 26, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  11ea5ec1
- [Model Runner V2] Minor cleanup for build_attn_metadata (#29576) · ee80aee1
  Woosuk Kwon authored Nov 26, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  ee80aee1
- [Model Runner V2] Minor code cleanup (#29570) · 0aeb698b
  Woosuk Kwon authored Nov 26, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  0aeb698b
26 Nov, 2025 4 commits
- [TPU] add tpu_inference (#27277) · ba1fcd84
  Johnny Yang authored Nov 26, 2025
```
Signed-off-by: Johnny Yang <johnnyyang@google.com>
```
  ba1fcd84
- [Core] Refactor padding logic and pad for CUDA graphs before attention metadata building (#28579) · 56539cdd
  Lucas Wilkinson authored Nov 26, 2025
  
  56539cdd
- [Attention] Remove imports from `vllm/attention/__init__.py` (#29342) · 430dd4d9
  Matthew Bonanni authored Nov 26, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  430dd4d9
- dummy run corner case (#29433) · 12866af7
  Xieyang Xu authored Nov 25, 2025
  
  12866af7
25 Nov, 2025 7 commits

[BugFix] Fix initialization of draft model. (#29319) · de75b0bb

Andrey Khalyavin authored Nov 26, 2025


Signed-off-by: Andrey Khalyavin <halyavin@yandex-team.ru>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>

de75b0bb

[Core] Support logprobs with spec decode + async scheduling (#29223) · 4e57c658
Nick Hill authored Nov 25, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
4e57c658
[Bugfix] Fix overallocation in MM profiling (#29386) · c2c661af
Roger Wang authored Nov 25, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
c2c661af

[Core] Generalize Encoder-Decoder `seq_lens` computation to avoid Whisper... · 798e87db

Nicolò Lucchesi authored Nov 25, 2025


[Core] Generalize Encoder-Decoder `seq_lens` computation to avoid Whisper hardcoded logic   (#29268)
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>

798e87db

EAGLE Support DP>1 (#26086) · 12c007e2

Rémi Delacourt authored Nov 25, 2025


Signed-off-by: Rémi Delacourt <remi@mistral.ai>
Signed-off-by: Rémi Delacourt <54138269+Flechman@users.noreply.github.com>
Signed-off-by: remi <remi@mistral.ai>

12c007e2

[Model] Add HunyuanOCR support (#29327) · 92effb07

Isotr0py authored Nov 25, 2025


Signed-off-by: manayang <jackmanayang@gmail.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: sergeywang <sergeywang@tencent.com>
Co-authored-by: manayang <jackmanayang@gmail.com>
Co-authored-by: manayang <manayang@tencent.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

92effb07

[Spec Decode] Add support for EAGLE3 heads that do not use_aux_hidden_states (#27688) · 5f9679a4

Hanjie Qiu authored Nov 24, 2025


Signed-off-by: hjjq <hanjieq@nvidia.com>
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>

5f9679a4

24 Nov, 2025 6 commits
- [Model Runner V2] Simplify Eagle bookkeeping with num_rejected (#29347) · f32c7d6f
  Woosuk Kwon authored Nov 24, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  f32c7d6f
- [Model Runner V2] Add minor clarification comments for Eagle (#29332) · 97588c4d
  Woosuk Kwon authored Nov 24, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  97588c4d
- [Model Runner V2] Change Numba AoT to JIT (#29328) · cec418b5
  Woosuk Kwon authored Nov 24, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  cec418b5
- [Model Runner V2] Implement Single-step Eagle 1 (#29300) · cc313cb7
  Woosuk Kwon authored Nov 24, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  cc313cb7
- [EPLB] Optimize EPLB for Async Rearrange Experts (#22179) · 2601f18a
  WeiQing Chen authored Nov 24, 2025
```
Signed-off-by: David Chen <530634352@qq.com>
Co-authored-by: SunChenxiang123 <1291824390@qq.com>
```
  2601f18a
- [Doc]: fix typos in various files (#29230) · eca7a8fb
  Didier Durand authored Nov 24, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  eca7a8fb
23 Nov, 2025 5 commits
- [Model Runner V2] Add apply_temperature option to gumbel_sample (#29276) · 3e1ad406
  Woosuk Kwon authored Nov 23, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  3e1ad406
- [Model Runner V2] Optimize CUDA graph capture time (#29275) · 62d54ba4
  Woosuk Kwon authored Nov 23, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  62d54ba4
- [Model Runner V2] Support spec decoding [1/N] (#29274) · b004c004
  Woosuk Kwon authored Nov 23, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  b004c004
- [Model Runner V2] Change bookkeeping logic in preparation for spec decoding (#29194) · 7f12c82f
  Woosuk Kwon authored Nov 23, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  7f12c82f
- [Model Runner V2] Minor fix for cudagraph_utils (#29256) · 20ee418a
  Woosuk Kwon authored Nov 22, 2025
  
  20ee418a
22 Nov, 2025 6 commits
- Refactor: Move CUDA graph dispatch logic earlier (#27382) · df78aeef
  Yizhou authored Nov 23, 2025
```
Signed-off-by: Yizhou Liu <liu_yizhou@outlook.com>
```
  df78aeef
- [BugFix] Fix chunked prompt logprobs + preemption (#29071) · 7df331c6
  Nick Hill authored Nov 22, 2025
  
  7df331c6
- [BugFix] Fix returned logprobs with spec decode + prefill chunking (#29216) · d44a63c6
  Nick Hill authored Nov 22, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  d44a63c6
- [Attention] Refactor FA `block_size` limitations to hybrid models only (#29084) · 066209a0
  Nicolò Lucchesi authored Nov 22, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  066209a0
- [Model Runner V2] Limit cudagraph size to max decode batch size (#29221) · e9056056
  Woosuk Kwon authored Nov 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  e9056056
- [Bugfix] Fix block size in block_table with PCP (#29094) · 5c8f2adf
  Jie Luo authored Nov 22, 2025
```
Signed-off-by: Livinfly <luojie3m@gmail.com>
```
  5c8f2adf