Commits · a28b94e6ef60b7f5aa1b97bc8d966a8d12cbc1da · OpenDAS / vllm_cscc

24 Jan, 2026 1 commit

[Performance] Split FlashAttn attention and cache update (#25954) · a28b94e6

ElizaWszola authored Jan 24, 2026


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Luka Govedič <luka.govedic@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Varun Sundar Rabindranath <varunsundar08@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <luka.govedic@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>

a28b94e6

23 Jan, 2026 2 commits

[cudagraphs] Refactor cudagraph capture loop (#32946) · 3a414595
Lucas Wilkinson authored Jan 23, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
3a414595

[V1][Hybrid] Mamba Prefix Caching with align mode (#30877) · 5206e5e2

Harry Huang authored Jan 24, 2026


Signed-off-by: huanghaoyan.hhy <huanghaoyan.hhy@alibaba-inc.com>
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>

5206e5e2

20 Jan, 2026 2 commits

[Misc] Remove pad_for_cudagraphs from config (#30143) · 22613408

Lucas Wilkinson authored Jan 20, 2026


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

22613408

[Model] Use context managers for encoder- and LM-only mode (#32605) · 4753f3bf
Cyrus Leung authored Jan 20, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
4753f3bf

19 Jan, 2026 2 commits
- feat: spec decode with draft models (#24322) · 4a5299c9
  Tomas Ruiz authored Jan 19, 2026
```
Signed-off-by: Tomas Ruiz <tomas.ruiz.te@gmail.com>
```
  4a5299c9
- [Core] Whisper support `torch.compile` (#30385) · 74c583bc
  Nicolò Lucchesi authored Jan 19, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  74c583bc
16 Jan, 2026 1 commit
- [Bugfix] Refactor to support DP parallel in R3 (#32306) · 03da3b52
  Hongxin Xu authored Jan 16, 2026
```
Signed-off-by: xhx1022 <1737006628@qq.com>
Co-authored-by: arlenxu <arlenxu@tencent.com>
```
  03da3b52
15 Jan, 2026 1 commit
- [2/N] Move cache factories to MM registry (#32382) · cbbae38f
  Cyrus Leung authored Jan 15, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  cbbae38f
14 Jan, 2026 2 commits
- [Refactor] Move top-level dummy data generation to registry (#32310) · 90db5b31
  Cyrus Leung authored Jan 14, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  90db5b31
- [misc] Remove is_torch_equal_or_newer(2.4) cases (#32296) · 79336380
  Angela Yi authored Jan 13, 2026
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  79336380
13 Jan, 2026 1 commit
- [6/N][Attention] Move utils to more appropriate locations (#32215) · 98f60e5a
  Matthew Bonanni authored Jan 13, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  98f60e5a
12 Jan, 2026 2 commits

[3/N][Attention] Move AttentionMetadata-related code from utils.py to backend.py (#32054) · 20228cb8
Matthew Bonanni authored Jan 12, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
20228cb8

[Feature] Support recording expert indices for rollout router replay (#28284) · 49e6b86c

Hongxin Xu authored Jan 12, 2026


Signed-off-by: xhx1022 <1737006628@qq.com>
Signed-off-by: Hongxin Xu <70438206+xhx1022@users.noreply.github.com>
Signed-off-by: arlenxu <arlenxu@tencent.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: arlenxu <arlenxu@tencent.com>

49e6b86c

11 Jan, 2026 1 commit
- [KVConnector] OffloadingConnector: Fix bug in handling of preemptions (#29870) · 4c16ba61
  Or Ozeri authored Jan 11, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  4c16ba61
09 Jan, 2026 4 commits
- [perf][async] support non cpu sync get logprob tensors for spec (#31336) · 97ba96fb
  zhrrr authored Jan 10, 2026
```
Signed-off-by: izhuhaoran <izhuhaoran@qq.com>
Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
```
  97ba96fb
- [1/N][Attention] Restructure attention: move files (#31916) · 2612ba92
  Matthew Bonanni authored Jan 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  2612ba92
- [Cleanup] Remove obsolete spec decoding compatibility logic (#32003) · 29ce4822
  Nick Hill authored Jan 08, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  29ce4822
- [Async][Feat] support apply penalty or bad_words for async + spec (#30495) · 8ff4a995
  zhrrr authored Jan 09, 2026
```
Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
Signed-off-by: izhuhaoran <izhuhaoran@qq.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
```
  8ff4a995
08 Jan, 2026 2 commits
- [Misc] Tidy up some spec decode logic in GPUModelRunner (#31591) · a3d909ad
  Nick Hill authored Jan 08, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  a3d909ad
- [BugFix] Fix spec decoding edge case bugs (#31944) · 287b37cd
  Nick Hill authored Jan 07, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  287b37cd
07 Jan, 2026 3 commits
- [refactor] refactor memory constants usage (#31865) · c907d221
  Ning Xie authored Jan 08, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  c907d221
- [Refactor] Clean up pooler modules (#31897) · b7036c87
  Cyrus Leung authored Jan 08, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b7036c87
- [Bugfix] Fix race condition in async-scheduling for vlm model (#31841) · efeaac92
  tianshu-Michael-yu authored Jan 06, 2026
```
Signed-off-by: Tianshu Yu <tianshuyu.formal@gmail.com>
```
  efeaac92
06 Jan, 2026 1 commit

[Perf] Async Scheduling + Speculative Decoding + Structured Outputs (#29821) · f7008ce1

Benjamin Chislett authored Jan 06, 2026


Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

f7008ce1

05 Jan, 2026 2 commits
- [Misc] Various code simplifications (#31666) · 43e3f8e4
  Nick Hill authored Jan 04, 2026
```
Signed-off-by: njhill <nickhill123@gmail.com>
```
  43e3f8e4
- [Minor] Small pooler output processing optimization (#31667) · da436f86
  Nick Hill authored Jan 04, 2026
```
Signed-off-by: njhill <nickhill123@gmail.com>
```
  da436f86
31 Dec, 2025 2 commits
- [BugFix] Fix async scheduling for pooling models (#31584) · 6c2cfb62
  Nick Hill authored Dec 31, 2025
```
Signed-off-by: njhill <nickhill123@gmail.com>
```
  6c2cfb62
- [Core] Remove unused `num_tokens` parameter from `_init_model_kwargs` (#31517) · b4bb5f31
  maang-h authored Dec 31, 2025
```
Signed-off-by: maang <maang_h@163.com>
```
  b4bb5f31
30 Dec, 2025 2 commits
- [Bugfix]Fix pooling model always disabled due to incorrect PP rank check (#31505) · 04147dcf
  vintipandey authored Dec 30, 2025
```
Signed-off-by: vintipandey <vinti.pandey@gmail.com>
```
  04147dcf
- [Minor] Various small code cleanups/simplifications (#31508) · 3b312fb7
  Nick Hill authored Dec 29, 2025
```
Signed-off-by: njhill <nickhill123@gmail.com>
```
  3b312fb7
28 Dec, 2025 1 commit
- [BugFix] Re-fix async multimodal cpu tensor race condition (#31373) · 094fcce2
  Nick Hill authored Dec 28, 2025
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Signed-off-by: njhill <nickhill123@gmail.com>
```
  094fcce2
26 Dec, 2025 1 commit

[Core] Initialize LoRA support for tower and connector in multi-modal models (#26674) · ce1eafd1

Jee Jee Li authored Dec 26, 2025


Signed-off-by: bk-201 <joy25810@foxmail.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: bk-201 <joy25810@foxmail.com>
Co-authored-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: Anexdeus <5142168@mail.ru>

ce1eafd1

24 Dec, 2025 2 commits
- [Chore][1/2] Drop `v0.14` deprecations (#31285) · 09dc7c69
  Cyrus Leung authored Dec 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  09dc7c69
- [Chore] Simplify logic of `_execute_mm_encoder` (#31222) · ca6a95ba
  Cyrus Leung authored Dec 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ca6a95ba
23 Dec, 2025 1 commit
- adapt voxtral (#31095) · 3faa8bee
  Patrick von Platen authored Dec 23, 2025
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
```
  3faa8bee
22 Dec, 2025 2 commits
- [SpecDecode] Simplified alternative padded-speculation acceptance rate fix (#29845) · de717476
  Lucas Wilkinson authored Dec 22, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  de717476
- [BugFix] skip language model in Encoder (#30242) · 8f8f469b
  dengyunyang authored Dec 22, 2025
```
Signed-off-by: dengyunyang <584797741@qq.com>
```
  8f8f469b
19 Dec, 2025 1 commit
- [BugFix] Fix TypeError: unhashable type: 'dict' when serving deepseek32 (#30924) · 5f6477d1
  Lucas Wilkinson authored Dec 19, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  5f6477d1
18 Dec, 2025 1 commit
- [BugFix] Fix spec decode + structured outputs + preemption edge case (#30916) · b0b77c46
  Nick Hill authored Dec 18, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  b0b77c46