Commits · 87185c88d54bd97c4c08f1fd3c5a8564e4924e2a · OpenDAS / vllm_cscc

25 Nov, 2025 4 commits

[Metrics] Scheduled removal of deprecated metrics (#29330) · 9cf4edae
Mark McLoughlin authored Nov 25, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
9cf4edae

[ROCm][MLA] enable fp8 MLA decode on ROCm (#28032) · cb7214d8

gbyu-amd authored Nov 25, 2025


Signed-off-by: guanbao <gyu@amd.com>
Signed-off-by: Guanbao Yu <gyu@amd.com>
Signed-off-by: gbyu-amd <Guanbao.Yu@amd.com>
Co-authored-by: guanbao <gyu@amd.com>

cb7214d8

[Perf][Deepseek] optimize gather_and_maybe_dequant_cache kernel's perf for... · 77e10c9c

Pleaplusone authored Nov 25, 2025


[Perf][Deepseek] optimize gather_and_maybe_dequant_cache kernel's perf for extremely long sequence (#28029)
Signed-off-by: ganyi <ygan@amd.com>

77e10c9c

[Spec Decode] Add support for EAGLE3 heads that do not use_aux_hidden_states (#27688) · 5f9679a4

Hanjie Qiu authored Nov 24, 2025


Signed-off-by: hjjq <hanjieq@nvidia.com>
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>

5f9679a4

24 Nov, 2025 9 commits
- [Hybrid Allocator] Better layer padding strategy for gpt-oss eagle (#29303) · 71df2a57
  Chen Zhang authored Nov 24, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  71df2a57
- [Model Runner V2] Simplify Eagle bookkeeping with num_rejected (#29347) · f32c7d6f
  Woosuk Kwon authored Nov 24, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  f32c7d6f
- [Model Runner V2] Add minor clarification comments for Eagle (#29332) · 97588c4d
  Woosuk Kwon authored Nov 24, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  97588c4d
- [Model Runner V2] Change Numba AoT to JIT (#29328) · cec418b5
  Woosuk Kwon authored Nov 24, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  cec418b5
- [Model Runner V2] Implement Single-step Eagle 1 (#29300) · cc313cb7
  Woosuk Kwon authored Nov 24, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  cc313cb7
- [EPLB] Optimize EPLB for Async Rearrange Experts (#22179) · 2601f18a
  WeiQing Chen authored Nov 24, 2025
```
Signed-off-by: David Chen <530634352@qq.com>
Co-authored-by: SunChenxiang123 <1291824390@qq.com>
```
  2601f18a
- [Doc]: fix typos in various files (#29230) · eca7a8fb
  Didier Durand authored Nov 24, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  eca7a8fb
- [Core] Deprecate `xformers` (#29262) · 0ff70821
  Roger Wang authored Nov 23, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  0ff70821
- [ROCm] Support for Whisper v1 with Aiter Unified Attention and Aiter Flash Attention (#28376) · 5253f427
  tongqiu authored Nov 24, 2025
```
Signed-off-by: apinge <Tong.Qiu2@amd.com>
```
  5253f427
23 Nov, 2025 5 commits
- [Model Runner V2] Add apply_temperature option to gumbel_sample (#29276) · 3e1ad406
  Woosuk Kwon authored Nov 23, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  3e1ad406
- [Model Runner V2] Optimize CUDA graph capture time (#29275) · 62d54ba4
  Woosuk Kwon authored Nov 23, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  62d54ba4
- [Model Runner V2] Support spec decoding [1/N] (#29274) · b004c004
  Woosuk Kwon authored Nov 23, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  b004c004
- [Model Runner V2] Change bookkeeping logic in preparation for spec decoding (#29194) · 7f12c82f
  Woosuk Kwon authored Nov 23, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  7f12c82f
- [Model Runner V2] Minor fix for cudagraph_utils (#29256) · 20ee418a
  Woosuk Kwon authored Nov 22, 2025
  
  20ee418a
22 Nov, 2025 10 commits
- Refactor: Move CUDA graph dispatch logic earlier (#27382) · df78aeef
  Yizhou authored Nov 23, 2025
```
Signed-off-by: Yizhou Liu <liu_yizhou@outlook.com>
```
  df78aeef
- [BugFix] Fix chunked prompt logprobs + preemption (#29071) · 7df331c6
  Nick Hill authored Nov 22, 2025
  
  7df331c6
- [perf][cpu] Accelerate paged attention GEMMs (QK, PV) on Arm CPUs with NEON (#29193) · 730bd353
  Fadi Arafeh authored Nov 22, 2025
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
  730bd353
- [BugFix] Fix returned logprobs with spec decode + prefill chunking (#29216) · d44a63c6
  Nick Hill authored Nov 22, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  d44a63c6
- [Attention] Refactor FA `block_size` limitations to hybrid models only (#29084) · 066209a0
  Nicolò Lucchesi authored Nov 22, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  066209a0
- [Misc] Further clean up chunked prefill and prefix caching init (#29186) · 5a480258
  Cyrus Leung authored Nov 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5a480258
- [Model Runner V2] Limit cudagraph size to max decode batch size (#29221) · e9056056
  Woosuk Kwon authored Nov 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  e9056056
- [Bugfix] Fix block size in block_table with PCP (#29094) · 5c8f2adf
  Jie Luo authored Nov 22, 2025
```
Signed-off-by: Livinfly <luojie3m@gmail.com>
```
  5c8f2adf
- [CI] Bug: Fix triton import issue (#29202) · 1d34eb11
  Wentao Ye authored Nov 21, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  1d34eb11
- [BugFix] Fix Eagle `IndexError: list index out of range` for even `num_speculative_tokens` (#29102) · 30d64662
  Lucas Wilkinson authored Nov 21, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  30d64662
21 Nov, 2025 12 commits
- [Model Runner V2] Optimize Gumbel Sampling Kernel (#29210) · e9af6ba6
  Woosuk Kwon authored Nov 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  e9af6ba6
- [KV Connector] Fix async connector prefix cache metrics (#28585) · c6fa3895
  Mark McLoughlin authored Nov 21, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  c6fa3895
- Default model load/config/tokenizer to `mistral` format if relevant files exist (#28659) · 57430fc9
  Julien Denize authored Nov 21, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  57430fc9
- [Chore] Fix pre-commit error after #25266 (#29190) · 1bed891f
  Woosuk Kwon authored Nov 21, 2025
  
  1bed891f
- [Log] Optimize startup log (#28948) · a42ab317
  Wentao Ye authored Nov 21, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  a42ab317
- GPU Model Runner V2 (#25266) · 30b44a15
  Woosuk Kwon authored Nov 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  30b44a15
- [Misc] Move dynamic seed initialization to `EngineArgs` (#29165) · d7219bcd
  Cyrus Leung authored Nov 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d7219bcd
- [Doc] Update plugin doc (#28532) · 4050bae4
  wangxiyuan authored Nov 21, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  4050bae4
- fix cross attention (#28346) · fc9f821d
  who who who authored Nov 21, 2025
```
Signed-off-by: fsx950223 <fsx950223@outlook.com>
```
  fc9f821d
- [Core] Align whisper closer to other multimodal models (#27292) · cca2d2cd
  Russell Bryant authored Nov 21, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  cca2d2cd
- Revert "[Redo] #26368 (#28771)" (#29121) · 30b9c677
  Jialin Ouyang authored Nov 20, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  30b9c677
- [V0 Deprecation] Remove `best_of` (#29090) · 56e96b37
  Cyrus Leung authored Nov 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  56e96b37