Commits · 8ff4a9956693450a37843bde88934ebcea440402 · OpenDAS / vllm_cscc

09 Jan, 2026 1 commit

[Async][Feat] support apply penalty or bad_words for async + spec (#30495) · 8ff4a995

zhrrr authored Jan 09, 2026


Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
Signed-off-by: izhuhaoran <izhuhaoran@qq.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

8ff4a995

08 Jan, 2026 2 commits
- [Misc] Tidy up some spec decode logic in GPUModelRunner (#31591) · a3d909ad
  Nick Hill authored Jan 08, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  a3d909ad
- [BugFix] Fix spec decoding edge case bugs (#31944) · 287b37cd
  Nick Hill authored Jan 07, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  287b37cd
07 Jan, 2026 3 commits
- [refactor] refactor memory constants usage (#31865) · c907d221
  Ning Xie authored Jan 08, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  c907d221
- [Refactor] Clean up pooler modules (#31897) · b7036c87
  Cyrus Leung authored Jan 08, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b7036c87
- [Bugfix] Fix race condition in async-scheduling for vlm model (#31841) · efeaac92
  tianshu-Michael-yu authored Jan 06, 2026
```
Signed-off-by: Tianshu Yu <tianshuyu.formal@gmail.com>
```
  efeaac92
06 Jan, 2026 1 commit

[Perf] Async Scheduling + Speculative Decoding + Structured Outputs (#29821) · f7008ce1

Benjamin Chislett authored Jan 06, 2026


Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

f7008ce1

05 Jan, 2026 2 commits
- [Misc] Various code simplifications (#31666) · 43e3f8e4
  Nick Hill authored Jan 04, 2026
```
Signed-off-by: njhill <nickhill123@gmail.com>
```
  43e3f8e4
- [Minor] Small pooler output processing optimization (#31667) · da436f86
  Nick Hill authored Jan 04, 2026
```
Signed-off-by: njhill <nickhill123@gmail.com>
```
  da436f86
31 Dec, 2025 2 commits
- [BugFix] Fix async scheduling for pooling models (#31584) · 6c2cfb62
  Nick Hill authored Dec 31, 2025
```
Signed-off-by: njhill <nickhill123@gmail.com>
```
  6c2cfb62
- [Core] Remove unused `num_tokens` parameter from `_init_model_kwargs` (#31517) · b4bb5f31
  maang-h authored Dec 31, 2025
```
Signed-off-by: maang <maang_h@163.com>
```
  b4bb5f31
30 Dec, 2025 2 commits
- [Bugfix]Fix pooling model always disabled due to incorrect PP rank check (#31505) · 04147dcf
  vintipandey authored Dec 30, 2025
```
Signed-off-by: vintipandey <vinti.pandey@gmail.com>
```
  04147dcf
- [Minor] Various small code cleanups/simplifications (#31508) · 3b312fb7
  Nick Hill authored Dec 29, 2025
```
Signed-off-by: njhill <nickhill123@gmail.com>
```
  3b312fb7
28 Dec, 2025 1 commit
- [BugFix] Re-fix async multimodal cpu tensor race condition (#31373) · 094fcce2
  Nick Hill authored Dec 28, 2025
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Signed-off-by: njhill <nickhill123@gmail.com>
```
  094fcce2
26 Dec, 2025 1 commit

[Core] Initialize LoRA support for tower and connector in multi-modal models (#26674) · ce1eafd1

Jee Jee Li authored Dec 26, 2025


Signed-off-by: bk-201 <joy25810@foxmail.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: bk-201 <joy25810@foxmail.com>
Co-authored-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: Anexdeus <5142168@mail.ru>

ce1eafd1

24 Dec, 2025 2 commits
- [Chore][1/2] Drop `v0.14` deprecations (#31285) · 09dc7c69
  Cyrus Leung authored Dec 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  09dc7c69
- [Chore] Simplify logic of `_execute_mm_encoder` (#31222) · ca6a95ba
  Cyrus Leung authored Dec 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ca6a95ba
23 Dec, 2025 1 commit
- adapt voxtral (#31095) · 3faa8bee
  Patrick von Platen authored Dec 23, 2025
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
```
  3faa8bee
22 Dec, 2025 2 commits
- [SpecDecode] Simplified alternative padded-speculation acceptance rate fix (#29845) · de717476
  Lucas Wilkinson authored Dec 22, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  de717476
- [BugFix] skip language model in Encoder (#30242) · 8f8f469b
  dengyunyang authored Dec 22, 2025
```
Signed-off-by: dengyunyang <584797741@qq.com>
```
  8f8f469b
19 Dec, 2025 1 commit
- [BugFix] Fix TypeError: unhashable type: 'dict' when serving deepseek32 (#30924) · 5f6477d1
  Lucas Wilkinson authored Dec 19, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  5f6477d1
18 Dec, 2025 2 commits
- [BugFix] Fix spec decode + structured outputs + preemption edge case (#30916) · b0b77c46
  Nick Hill authored Dec 18, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  b0b77c46
- [Cleanup] Remove unused ModelRunner V1 `InputBatch.num_tokens` field (#30218) · 686cbaac
  Nick Hill authored Dec 18, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  686cbaac
17 Dec, 2025 1 commit
- [Fix] uniform decode batch check (#30747) · 6e9dbcc5
  Jialin Ouyang authored Dec 17, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  6e9dbcc5
16 Dec, 2025 3 commits
- [Core][MM] Optimize encoder cache manager by operating with embeddings only (#30475) · f5f51e59
  Roger Wang authored Dec 16, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Sun Kim <sunytokki@gmail.com>
```
  f5f51e59
- [Attention] Cache attention metadata builds across hybrid KV-cache groups (#29627) · 9fec0e13
  Lucas Wilkinson authored Dec 16, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Stanislaw Wozniak <stw@zurich.ibm.com>
```
  9fec0e13
- [feature] extend DBO to XBO (#30120) · b9ff4f2a
  jiangkuaixue123 authored Dec 16, 2025
```
Signed-off-by: jiangkuaixue123 <jiangxiaozhou111@163.com>
Co-authored-by: root <root@hk01dgx028.cm.cluster>
```
  b9ff4f2a
12 Dec, 2025 2 commits
- [Attention] Use sparse prefill kernel for fp8 kv-cache in DeepSeek-v3.2 (#27532) · 3e41992f
  Lucas Wilkinson authored Dec 12, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  3e41992f
- [Core] Refactor `_build_attention_metadata` (#29628) · 042da732
  Lucas Wilkinson authored Dec 11, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  042da732
11 Dec, 2025 2 commits

[BugFix][MM]support VLLM_RANDOMIZE_DP_DUMMY_INPUTS (#30472) · 90d6cf92

Xingyu Liu authored Dec 11, 2025


Signed-off-by: Xingyu Liu <charlotteliu12x@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

90d6cf92

[Misc][PCP&DCP] relocate PCP feature check (#30050) · a11f4a81

Qiu authored Dec 11, 2025


Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

a11f4a81

10 Dec, 2025 4 commits

[Bugfix] fix confusing OOM errors during v1 init (#28051) · 8580919a

shivampr authored Dec 10, 2025


Signed-off-by: Shivam <shivamprasad91@gmail.com>
Signed-off-by: shivampr <shivampr.dev@gmail.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>

8580919a

[Core] Whisper enable `FULL_DECODE_ONLY` CudaGraph (#30072) · c756fb67
Nicolò Lucchesi authored Dec 10, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
c756fb67

Fix typos in comments across multiple files (#30345) · 3bdd4266

Wilson Wu authored Dec 10, 2025


Signed-off-by: Wilson Wu <iwilsonwu@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

3bdd4266

[Attention] Make seq_lens_cpu optional in CommonAttentionMetadata to enable... · abe93bce

Lucas Wilkinson authored Dec 09, 2025


[Attention] Make seq_lens_cpu optional in CommonAttentionMetadata to enable true async spec-decode (#29624)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>

abe93bce

09 Dec, 2025 2 commits

[BugFix] Fix DeepSeek-R1 hang with DP and MTP (#30119) · 95501a70

Lucas Wilkinson authored Dec 09, 2025


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

95501a70

[BugFix] Fix `assert batch_descriptor.num_tokens == num_tokens_padded` (#30173) · 56037dfa
Lucas Wilkinson authored Dec 09, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
56037dfa

07 Dec, 2025 3 commits
- [v1] Add PrefixLM support to FlexAttention backend (#27938) · b952f4d3
  Isotr0py authored Dec 07, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  b952f4d3
- Revert "[Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145)" (#30199) · e83b7e37
  Cyrus Leung authored Dec 07, 2025
  
  e83b7e37
- [Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145) · 27f4c2fd
  Cyrus Leung authored Dec 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  27f4c2fd