Commits · e729cc823d313aa7623ecadefe4305ea241c3dce · OpenDAS / vllm_cscc

18 Apr, 2026 1 commit

[Frontend] Preserve structured output special tokens in offline LLM.chat (#39352) · 38907e43

Luciano Martins authored Apr 18, 2026

Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>

38907e43

16 Apr, 2026 2 commits

[Bugfix] Fix LLM priority normalization for single-string prompts (#40011) · a302a8fd
daiyu1111 authored Apr 16, 2026
```
Signed-off-by: daiyu1111 <2356690121@qq.com>
```
a302a8fd

[Frontend][last/5] Improve pooling entrypoints | clean up. (#39675) · 4e8c3f1c

wang.yuqi authored Apr 16, 2026

Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

4e8c3f1c

09 Apr, 2026 1 commit
- [Frontend][4/n] Improve pooling entrypoints | pooling. (#39153) · 66c079ae
  wang.yuqi authored Apr 09, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  66c079ae
03 Apr, 2026 1 commit
- [Frontend] new online quantization frontend (#38138) · 7b1a7423
  Vasiliy Kuznetsov authored Apr 03, 2026
```
Signed-off-by: Vasiliy Kuznetsov <vasiliy@meta.com>
```
  7b1a7423
02 Apr, 2026 1 commit
- [Frontend] Re-enable running MaxSim on GPU (#38620) · a9b4f07b
  wang.yuqi authored Apr 03, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  a9b4f07b
31 Mar, 2026 1 commit
- [Frontend][3/n] Improve pooling entrypoints | scoring. (#28631) · d9d21eb8
  wang.yuqi authored Mar 31, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  d9d21eb8
25 Mar, 2026 2 commits
- [Misc] Reorganize inputs (#35182) · ba2f0acc
  Cyrus Leung authored Mar 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ba2f0acc
- [Mypy] Better fixes for the `mypy` issues in `vllm/config` (#37902) · d215d1ef
  Harry Mellor authored Mar 25, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d215d1ef
24 Mar, 2026 1 commit

[Deprecate] Deprecate pooling multi task support. (#37956) · 1b6cb920

wang.yuqi authored Mar 24, 2026


Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

1b6cb920

20 Mar, 2026 1 commit
- [Model] Deprecate the score task (this will not affect users). (#37537) · ed359c49
  wang.yuqi authored Mar 20, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  ed359c49
10 Mar, 2026 1 commit
- [Model] Consolidate score logic by introduce score_type (#36479) · a3189a08
  wang.yuqi authored Mar 10, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  a3189a08
09 Mar, 2026 1 commit
- [Frontend][2/n] Improve pooling entrypoints | embed. (#36110) · fff3711a
  wang.yuqi authored Mar 09, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
```
  fff3711a
07 Mar, 2026 1 commit
- [V0 Deprecation] Remove unused swap_space parameter (#36216) · 00b814ba
  lif authored Mar 07, 2026
```
Signed-off-by: majiayu000 <1835304752@qq.com>
Co-authored-by: mcelrath
```
  00b814ba
06 Mar, 2026 1 commit

[Frontend] Add Support for MM Encoder/Decoder Beam Search (Offline) (#36153) · 10f4db4d

Alex Brooks authored Mar 06, 2026


Signed-off-by: Alex Brooks <albrooks@redhat.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

10f4db4d

03 Mar, 2026 1 commit

[Frontend][1/n] Improve pooling entrypoints | classify. (#35604) · ea463978

wang.yuqi authored Mar 03, 2026


Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

ea463978

28 Feb, 2026 1 commit

[Deprecation] Deprecate code in 0.17 as scheduled (#35441) · e113a301

Wentao Ye authored Feb 28, 2026


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

e113a301

26 Feb, 2026 1 commit

[offloader] v2: Hide weight onloading latency via prefetching (#29941) · 6831650c

Ming Yang authored Feb 25, 2026


Signed-off-by: Ming Yang <minos.future@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

6831650c

25 Feb, 2026 1 commit
- [Core] Cleanup engine pause/sleep logic (#34528) · dbf0da81
  Nick Hill authored Feb 24, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  dbf0da81
23 Feb, 2026 1 commit
- [Feature] Lazy import for the "mistral" tokenizer module. (#34651) · 54e2f83d
  Neil Schemenauer authored Feb 23, 2026
```
Signed-off-by: Neil Schemenauer <nas@arctrix.com>
```
  54e2f83d
21 Feb, 2026 1 commit

[Frontend] Support multimodal inputs for late-interaction scoring (ColQwen3) +... · 5719a4e4

Kata Coder authored Feb 21, 2026


[Frontend] Support multimodal inputs for late-interaction scoring (ColQwen3) + NewModel: nvidia/nemotron-colembed (#34574)
Signed-off-by: craftsangjae <craftsangjae@gmail.com>

5719a4e4

20 Feb, 2026 1 commit
- [Refactor] Implement output type check in LLM (#34794) · ac900c89
  Cyrus Leung authored Feb 20, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ac900c89
18 Feb, 2026 2 commits

[Bugfix] Fix lora tests (#34834) · 61cf0876

Cyrus Leung authored Feb 19, 2026


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

61cf0876

[Renderer] Deprecate code paths for old input processing (#34775) · a766b303
Cyrus Leung authored Feb 18, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
a766b303

17 Feb, 2026 1 commit
- [Renderer] Move InputPreprocessor into Renderer (2/2) (#34560) · 574fe752
  Cyrus Leung authored Feb 17, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  574fe752
16 Feb, 2026 1 commit
- (bugfix): Fixed encode in LLM entrypoint for IOProcessr plugin prompts (#34618) · 6930becd
  Christian Pinto authored Feb 16, 2026
```
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
```
  6930becd
14 Feb, 2026 1 commit

[Renderer] Move InputPreprocessor into Renderer (1/2) (#34510) · 73391a1b

Cyrus Leung authored Feb 15, 2026


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

73391a1b

13 Feb, 2026 3 commits

[Refactor] Call renderer for online IO processor request (#34490) · ec090c24

Cyrus Leung authored Feb 13, 2026

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

ec090c24

[Core] Profiler improvements and lazy initialization (#33198) · 4453ba8d

Jaewon authored Feb 12, 2026


Signed-off-by: Jaewon Lee <jaewon@meta.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>

4453ba8d

[Core] Add sleep level 0 mode with enqueue/wait pattern (#33195) · aa181c92

Jaewon authored Feb 12, 2026


Signed-off-by: Jaewon Lee <jaewon@meta.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>

aa181c92

12 Feb, 2026 1 commit
- [Refactor] Pass Renderer to Input Processor (#34329) · b96f7314
  Cyrus Leung authored Feb 12, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b96f7314
11 Feb, 2026 1 commit
- [Plugin] Simplify IO Processor Plugin interface (#34236) · c9a1923b
  Cyrus Leung authored Feb 11, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c9a1923b
07 Feb, 2026 1 commit
- [Renderer] Define `render_cmpl` and `render_chat` (#34039) · edb359cc
  Cyrus Leung authored Feb 07, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  edb359cc
06 Feb, 2026 2 commits
- [Refactor] Consolidate sequence normalization and enc-dec parsing (#33928) · cd8b405b
  Cyrus Leung authored Feb 06, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  cd8b405b
- [Docs] Improve documentation (#33799) · 6e7b1c4b
  SorenDreano authored Feb 06, 2026
```
Co-authored-by: Soren Dreano <soren@numind.ai>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  6e7b1c4b
05 Feb, 2026 3 commits

[Feat][RL][1/2] Native Weight Syncing API: NCCL (#31943) · c1858b7e

Aaron Hao authored Feb 05, 2026


Signed-off-by: ahao-anyscale <ahao@anyscale.com>
Signed-off-by: Aaron Hao <ahao@anyscale.com>
Co-authored-by: SumanthRH <sumanthrh99@gmail.com>

c1858b7e

[Refactor] Move `task` outside of `PoolingParams.verify` (#33796) · 038914b7

Cyrus Leung authored Feb 05, 2026


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

038914b7

feat: Add ColBERT late interaction model support (#33686) · 439afa4e

Ilya Boytsov authored Feb 05, 2026


Signed-off-by: Ilya Boytsov <ilyaboytsov1805@gmail.com>
Signed-off-by: Ilya Boytsov <boytsovpanamera@mail.ru>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

439afa4e

04 Feb, 2026 2 commits
- [Bugfix] Fix `normalize` still being passed to `PoolerConfig` (#33794) · 80f921ba
  Cyrus Leung authored Feb 04, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  80f921ba
- [Frontend][4/n] Make pooling entrypoints request schema consensus | ScoreRequest (#33060) · 1b8fe6f7
  wang.yuqi authored Feb 04, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  1b8fe6f7