Commits · 48312e579a6de16b3d15a40796ef165ed141c8dc · OpenDAS / vllm_cscc

07 Feb, 2026 1 commit
- [Misc] Make `PlaceholderRange.get_num_embeds` a method (#34035) · 48312e57
  Cyrus Leung authored Feb 07, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  48312e57
06 Feb, 2026 1 commit
- [Refactor] Consolidate sequence normalization and enc-dec parsing (#33928) · cd8b405b
  Cyrus Leung authored Feb 06, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  cd8b405b
05 Feb, 2026 1 commit

[Refactor] Move `task` outside of `PoolingParams.verify` (#33796) · 038914b7

Cyrus Leung authored Feb 05, 2026


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

038914b7

02 Feb, 2026 1 commit
- [Refactor] Move profiling methods to MM budget (#33559) · d7e17aaa
  Cyrus Leung authored Feb 02, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d7e17aaa
01 Feb, 2026 3 commits
- [Redo] #33110 with threading limit (#33502) · 21997f45
  Cyrus Leung authored Feb 01, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: YunzhuLu <lucia.yunzhu@gmail.com>
```
  21997f45
- [Critical] Revert #33110 (#33500) · b6bb2842
  Cyrus Leung authored Feb 01, 2026
  
  b6bb2842
- [Refactor] Make Renderer an abstract class (#33479) · a358e4df
  Cyrus Leung authored Feb 01, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a358e4df
31 Jan, 2026 2 commits
- [Refactor] Move MM data parsing outside processor (#33408) · 88c3e114
  Cyrus Leung authored Feb 01, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  88c3e114
- [Bugfix] Early-reject requests with MM data longer than encode cache capacity (#33110) · 27cb2f67
  YunzhuLu authored Feb 01, 2026
```
Signed-off-by: YunzhuLu <lucia.yunzhu@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  27cb2f67
26 Jan, 2026 1 commit
- [Refactor] Use data parser for matching data items to multi-modal UUIDs (#32955) · 11b55687
  Cyrus Leung authored Jan 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  11b55687
24 Jan, 2026 1 commit

[Feature] add session based streaming input support to v1 (#28973) · 91601ff4

Joshua Deng authored Jan 24, 2026


Signed-off-by: Joshua Deng <joshuakdeng@gmail.com>
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

91601ff4

22 Jan, 2026 1 commit
- [Frontend] Introduce Renderer for processing chat messages (using `ModelConfig`) (#30200) · d117a4d1
  Cyrus Leung authored Jan 22, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d117a4d1
20 Jan, 2026 1 commit
- [Core] Cleanup shm based object store on engine shutdown (#32429) · 8be263c3
  Walter Beller-Morales authored Jan 20, 2026
```
Signed-off-by: walterbm <walter.beller.morales@gmail.com>
```
  8be263c3
15 Jan, 2026 2 commits
- [2/N] Move cache factories to MM registry (#32382) · cbbae38f
  Cyrus Leung authored Jan 15, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  cbbae38f
- [Bugfix] Strengthen the check of X-data-parallel-rank in Hybrid LB mode (#32314) · 1e584823
  dtc authored Jan 15, 2026
```
Signed-off-by: Tianchen Ding <dtcccc@linux.alibaba.com>
```
  1e584823
14 Jan, 2026 1 commit
- [1/N] Reorganize multimodal processing code (#32327) · 9ea07b41
  Cyrus Leung authored Jan 14, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9ea07b41
13 Jan, 2026 2 commits
- [Refactor] Remove `get_encoder_dummy_data` (#32241) · eb28e806
  Cyrus Leung authored Jan 13, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  eb28e806
- [BugFix] Fix engine crash caused by chat tools + response_format (#32127) · c6bb5b56
  Nick Hill authored Jan 12, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  c6bb5b56
12 Jan, 2026 1 commit
- [Misc] Set default torch num threads for input processing (#31879) · 16abe6b8
  Roger Wang authored Jan 12, 2026
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  16abe6b8
09 Jan, 2026 2 commits

[Async][Feat] support apply penalty or bad_words for async + spec (#30495) · 8ff4a995

zhrrr authored Jan 09, 2026


Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
Signed-off-by: izhuhaoran <izhuhaoran@qq.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

8ff4a995

[BugFix] Add spec-decode-incompatible request param validation (#31982) · 11cec296
Nick Hill authored Jan 08, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
11cec296

08 Jan, 2026 1 commit
- [Fix] Enable mm_processor_cache with vision LoRA (#31927) · d3235cb5
  prashanth058 authored Jan 08, 2026
```
Signed-off-by: prashanth058 <prashanth.dannamaneni@uipath.com>
```
  d3235cb5
07 Jan, 2026 1 commit
- [OpenAI] Extend VLLMValidationError to additional validation parameters (#31870) · 1ab055ef
  R3hankhan authored Jan 07, 2026
```
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
```
  1ab055ef
06 Jan, 2026 1 commit

[Perf] Async Scheduling + Speculative Decoding + Structured Outputs (#29821) · f7008ce1

Benjamin Chislett authored Jan 06, 2026


Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

f7008ce1

02 Jan, 2026 1 commit

Add Multimodal Processor Benchmark (#29105) · 1f5b7c41

Reagan Lee authored Jan 01, 2026


Signed-off-by: Reagan Lee <reaganjlee@gmail.com>
Signed-off-by: Reagan <reaganjlee@gmail.com>

1f5b7c41

30 Dec, 2025 1 commit
- [Minor] Various small code cleanups/simplifications (#31508) · 3b312fb7
  Nick Hill authored Dec 29, 2025
```
Signed-off-by: njhill <nickhill123@gmail.com>
```
  3b312fb7
26 Dec, 2025 1 commit

[Core] Initialize LoRA support for tower and connector in multi-modal models (#26674) · ce1eafd1

Jee Jee Li authored Dec 26, 2025


Signed-off-by: bk-201 <joy25810@foxmail.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: bk-201 <joy25810@foxmail.com>
Co-authored-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: Anexdeus <5142168@mail.ru>

ce1eafd1

23 Dec, 2025 1 commit

[Core] Add a random suffix to frontend-provided request IDs (#27987) · f7900686

Mark McLoughlin authored Dec 23, 2025


Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

f7900686

18 Dec, 2025 1 commit

[ROCm][Bugfix] fix(structured_output): Skip guidance backend for schemas with... · be2ad5f9

Andreas Karatzas authored Dec 18, 2025


[ROCm][Bugfix] fix(structured_output): Skip guidance backend for schemas with patternProperties (#30730)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>

be2ad5f9

13 Dec, 2025 2 commits
- [Chore] Adjust tokenizer import to avoid circular imports (#30601) · 64251f48
  Cyrus Leung authored Dec 13, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  64251f48
- [Bugfix] Dictionary MM embeddings for online chat (#30507) · b09806e2
  Cyrus Leung authored Dec 13, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b09806e2
10 Dec, 2025 1 commit
- {Deprecation] Remove tokenizer setter (#30400) · e72d65b9
  Cyrus Leung authored Dec 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e72d65b9
07 Dec, 2025 2 commits
- Revert "[Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145)" (#30199) · e83b7e37
  Cyrus Leung authored Dec 07, 2025
  
  e83b7e37
- [Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145) · 27f4c2fd
  Cyrus Leung authored Dec 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  27f4c2fd
29 Nov, 2025 1 commit
- [Misc] Refactor tokenizer interface (#29693) · 34a98427
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  34a98427
28 Nov, 2025 1 commit
- [Chore] Rename `Processor` to `InputProcessor` (#29682) · 8d9338fa
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8d9338fa
21 Nov, 2025 2 commits

Default model load/config/tokenizer to `mistral` format if relevant files exist (#28659) · 57430fc9

Julien Denize authored Nov 21, 2025


Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

57430fc9

[V0 Deprecation] Remove `best_of` (#29090) · 56e96b37
Cyrus Leung authored Nov 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
56e96b37

17 Nov, 2025 1 commit

[Core] Async Scheduling X Spec Decoding Compatibility (#24799) · d8874c61

Ronald authored Nov 18, 2025


Signed-off-by: Ronald1995 <ronaldautomobile@163.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>

d8874c61

15 Nov, 2025 1 commit
- Allow Gemma3 to take image embeddings (#28483) · cb15ee28
  tingtinggithub authored Nov 15, 2025
```
Signed-off-by: tingtinggithub <streamttt@gmail.com>
```
  cb15ee28