Commits · 98f60e5acbcbbc9b6e7d6370c4e19128fc3b0b32 · OpenDAS / vllm_cscc

13 Jan, 2026 1 commit
- [6/N][Attention] Move utils to more appropriate locations (#32215) · 98f60e5a
  Matthew Bonanni authored Jan 13, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  98f60e5a
12 Jan, 2026 2 commits

[3/N][Attention] Move AttentionMetadata-related code from utils.py to backend.py (#32054) · 20228cb8
Matthew Bonanni authored Jan 12, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
20228cb8

[Feature] Support recording expert indices for rollout router replay (#28284) · 49e6b86c

Hongxin Xu authored Jan 12, 2026


Signed-off-by: xhx1022 <1737006628@qq.com>
Signed-off-by: Hongxin Xu <70438206+xhx1022@users.noreply.github.com>
Signed-off-by: arlenxu <arlenxu@tencent.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: arlenxu <arlenxu@tencent.com>

49e6b86c

11 Jan, 2026 1 commit
- [KVConnector] OffloadingConnector: Fix bug in handling of preemptions (#29870) · 4c16ba61
  Or Ozeri authored Jan 11, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  4c16ba61
09 Jan, 2026 4 commits
- [perf][async] support non cpu sync get logprob tensors for spec (#31336) · 97ba96fb
  zhrrr authored Jan 10, 2026
```
Signed-off-by: izhuhaoran <izhuhaoran@qq.com>
Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
```
  97ba96fb
- [1/N][Attention] Restructure attention: move files (#31916) · 2612ba92
  Matthew Bonanni authored Jan 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  2612ba92
- [Cleanup] Remove obsolete spec decoding compatibility logic (#32003) · 29ce4822
  Nick Hill authored Jan 08, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  29ce4822
- [Async][Feat] support apply penalty or bad_words for async + spec (#30495) · 8ff4a995
  zhrrr authored Jan 09, 2026
```
Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
Signed-off-by: izhuhaoran <izhuhaoran@qq.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
```
  8ff4a995
08 Jan, 2026 2 commits
- [Misc] Tidy up some spec decode logic in GPUModelRunner (#31591) · a3d909ad
  Nick Hill authored Jan 08, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  a3d909ad
- [BugFix] Fix spec decoding edge case bugs (#31944) · 287b37cd
  Nick Hill authored Jan 07, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  287b37cd
07 Jan, 2026 3 commits
- [refactor] refactor memory constants usage (#31865) · c907d221
  Ning Xie authored Jan 08, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  c907d221
- [Refactor] Clean up pooler modules (#31897) · b7036c87
  Cyrus Leung authored Jan 08, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b7036c87
- [Bugfix] Fix race condition in async-scheduling for vlm model (#31841) · efeaac92
  tianshu-Michael-yu authored Jan 06, 2026
```
Signed-off-by: Tianshu Yu <tianshuyu.formal@gmail.com>
```
  efeaac92
06 Jan, 2026 1 commit

[Perf] Async Scheduling + Speculative Decoding + Structured Outputs (#29821) · f7008ce1

Benjamin Chislett authored Jan 06, 2026


Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

f7008ce1

05 Jan, 2026 2 commits
- [Misc] Various code simplifications (#31666) · 43e3f8e4
  Nick Hill authored Jan 04, 2026
```
Signed-off-by: njhill <nickhill123@gmail.com>
```
  43e3f8e4
- [Minor] Small pooler output processing optimization (#31667) · da436f86
  Nick Hill authored Jan 04, 2026
```
Signed-off-by: njhill <nickhill123@gmail.com>
```
  da436f86
31 Dec, 2025 2 commits
- [BugFix] Fix async scheduling for pooling models (#31584) · 6c2cfb62
  Nick Hill authored Dec 31, 2025
```
Signed-off-by: njhill <nickhill123@gmail.com>
```
  6c2cfb62
- [Core] Remove unused `num_tokens` parameter from `_init_model_kwargs` (#31517) · b4bb5f31
  maang-h authored Dec 31, 2025
```
Signed-off-by: maang <maang_h@163.com>
```
  b4bb5f31
30 Dec, 2025 2 commits
- [Bugfix]Fix pooling model always disabled due to incorrect PP rank check (#31505) · 04147dcf
  vintipandey authored Dec 30, 2025
```
Signed-off-by: vintipandey <vinti.pandey@gmail.com>
```
  04147dcf
- [Minor] Various small code cleanups/simplifications (#31508) · 3b312fb7
  Nick Hill authored Dec 29, 2025
```
Signed-off-by: njhill <nickhill123@gmail.com>
```
  3b312fb7
28 Dec, 2025 1 commit
- [BugFix] Re-fix async multimodal cpu tensor race condition (#31373) · 094fcce2
  Nick Hill authored Dec 28, 2025
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Signed-off-by: njhill <nickhill123@gmail.com>
```
  094fcce2
26 Dec, 2025 1 commit

[Core] Initialize LoRA support for tower and connector in multi-modal models (#26674) · ce1eafd1

Jee Jee Li authored Dec 26, 2025


Signed-off-by: bk-201 <joy25810@foxmail.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: bk-201 <joy25810@foxmail.com>
Co-authored-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: Anexdeus <5142168@mail.ru>

ce1eafd1

24 Dec, 2025 2 commits
- [Chore][1/2] Drop `v0.14` deprecations (#31285) · 09dc7c69
  Cyrus Leung authored Dec 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  09dc7c69
- [Chore] Simplify logic of `_execute_mm_encoder` (#31222) · ca6a95ba
  Cyrus Leung authored Dec 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ca6a95ba
23 Dec, 2025 1 commit
- adapt voxtral (#31095) · 3faa8bee
  Patrick von Platen authored Dec 23, 2025
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
```
  3faa8bee
22 Dec, 2025 2 commits
- [SpecDecode] Simplified alternative padded-speculation acceptance rate fix (#29845) · de717476
  Lucas Wilkinson authored Dec 22, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  de717476
- [BugFix] skip language model in Encoder (#30242) · 8f8f469b
  dengyunyang authored Dec 22, 2025
```
Signed-off-by: dengyunyang <584797741@qq.com>
```
  8f8f469b
19 Dec, 2025 1 commit
- [BugFix] Fix TypeError: unhashable type: 'dict' when serving deepseek32 (#30924) · 5f6477d1
  Lucas Wilkinson authored Dec 19, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  5f6477d1
18 Dec, 2025 2 commits
- [BugFix] Fix spec decode + structured outputs + preemption edge case (#30916) · b0b77c46
  Nick Hill authored Dec 18, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  b0b77c46
- [Cleanup] Remove unused ModelRunner V1 `InputBatch.num_tokens` field (#30218) · 686cbaac
  Nick Hill authored Dec 18, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  686cbaac
17 Dec, 2025 1 commit
- [Fix] uniform decode batch check (#30747) · 6e9dbcc5
  Jialin Ouyang authored Dec 17, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  6e9dbcc5
16 Dec, 2025 3 commits
- [Core][MM] Optimize encoder cache manager by operating with embeddings only (#30475) · f5f51e59
  Roger Wang authored Dec 16, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Sun Kim <sunytokki@gmail.com>
```
  f5f51e59
- [Attention] Cache attention metadata builds across hybrid KV-cache groups (#29627) · 9fec0e13
  Lucas Wilkinson authored Dec 16, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Stanislaw Wozniak <stw@zurich.ibm.com>
```
  9fec0e13
- [feature] extend DBO to XBO (#30120) · b9ff4f2a
  jiangkuaixue123 authored Dec 16, 2025
```
Signed-off-by: jiangkuaixue123 <jiangxiaozhou111@163.com>
Co-authored-by: root <root@hk01dgx028.cm.cluster>
```
  b9ff4f2a
12 Dec, 2025 2 commits
- [Attention] Use sparse prefill kernel for fp8 kv-cache in DeepSeek-v3.2 (#27532) · 3e41992f
  Lucas Wilkinson authored Dec 12, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  3e41992f
- [Core] Refactor `_build_attention_metadata` (#29628) · 042da732
  Lucas Wilkinson authored Dec 11, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  042da732
11 Dec, 2025 2 commits

[BugFix][MM]support VLLM_RANDOMIZE_DP_DUMMY_INPUTS (#30472) · 90d6cf92

Xingyu Liu authored Dec 11, 2025


Signed-off-by: Xingyu Liu <charlotteliu12x@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

90d6cf92

[Misc][PCP&DCP] relocate PCP feature check (#30050) · a11f4a81

Qiu authored Dec 11, 2025


Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

a11f4a81

10 Dec, 2025 2 commits
- [Bugfix] fix confusing OOM errors during v1 init (#28051) · 8580919a
  shivampr authored Dec 10, 2025
```
Signed-off-by: Shivam <shivamprasad91@gmail.com>
Signed-off-by: shivampr <shivampr.dev@gmail.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
```
  8580919a
- [Core] Whisper enable `FULL_DECODE_ONLY` CudaGraph (#30072) · c756fb67
  Nicolò Lucchesi authored Dec 10, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  c756fb67