Commits · 6831650c40ac3a34f049e285d9ad6b87daddbe00 · OpenDAS / vllm_cscc

26 Feb, 2026 1 commit

[offloader] v2: Hide weight onloading latency via prefetching (#29941) · 6831650c

Ming Yang authored Feb 25, 2026


Signed-off-by: Ming Yang <minos.future@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

6831650c

25 Feb, 2026 1 commit
- [Core] Cleanup engine pause/sleep logic (#34528) · dbf0da81
  Nick Hill authored Feb 24, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  dbf0da81
23 Feb, 2026 1 commit
- [Feature] Lazy import for the "mistral" tokenizer module. (#34651) · 54e2f83d
  Neil Schemenauer authored Feb 23, 2026
```
Signed-off-by: Neil Schemenauer <nas@arctrix.com>
```
  54e2f83d
21 Feb, 2026 1 commit

[Frontend] Support multimodal inputs for late-interaction scoring (ColQwen3) +... · 5719a4e4

Kata Coder authored Feb 21, 2026


[Frontend] Support multimodal inputs for late-interaction scoring (ColQwen3) + NewModel: nvidia/nemotron-colembed (#34574)
Signed-off-by: craftsangjae <craftsangjae@gmail.com>

5719a4e4

20 Feb, 2026 1 commit
- [Refactor] Implement output type check in LLM (#34794) · ac900c89
  Cyrus Leung authored Feb 20, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ac900c89
18 Feb, 2026 2 commits

[Bugfix] Fix lora tests (#34834) · 61cf0876

Cyrus Leung authored Feb 19, 2026


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

61cf0876

[Renderer] Deprecate code paths for old input processing (#34775) · a766b303
Cyrus Leung authored Feb 18, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
a766b303

17 Feb, 2026 1 commit
- [Renderer] Move InputPreprocessor into Renderer (2/2) (#34560) · 574fe752
  Cyrus Leung authored Feb 17, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  574fe752
16 Feb, 2026 1 commit
- (bugfix): Fixed encode in LLM entrypoint for IOProcessr plugin prompts (#34618) · 6930becd
  Christian Pinto authored Feb 16, 2026
```
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
```
  6930becd
14 Feb, 2026 1 commit

[Renderer] Move InputPreprocessor into Renderer (1/2) (#34510) · 73391a1b

Cyrus Leung authored Feb 15, 2026


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

73391a1b

13 Feb, 2026 3 commits

[Refactor] Call renderer for online IO processor request (#34490) · ec090c24

Cyrus Leung authored Feb 13, 2026

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

ec090c24

[Core] Profiler improvements and lazy initialization (#33198) · 4453ba8d

Jaewon authored Feb 12, 2026


Signed-off-by: Jaewon Lee <jaewon@meta.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>

4453ba8d

[Core] Add sleep level 0 mode with enqueue/wait pattern (#33195) · aa181c92

Jaewon authored Feb 12, 2026


Signed-off-by: Jaewon Lee <jaewon@meta.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>

aa181c92

12 Feb, 2026 1 commit
- [Refactor] Pass Renderer to Input Processor (#34329) · b96f7314
  Cyrus Leung authored Feb 12, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b96f7314
11 Feb, 2026 1 commit
- [Plugin] Simplify IO Processor Plugin interface (#34236) · c9a1923b
  Cyrus Leung authored Feb 11, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c9a1923b
07 Feb, 2026 1 commit
- [Renderer] Define `render_cmpl` and `render_chat` (#34039) · edb359cc
  Cyrus Leung authored Feb 07, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  edb359cc
06 Feb, 2026 2 commits
- [Refactor] Consolidate sequence normalization and enc-dec parsing (#33928) · cd8b405b
  Cyrus Leung authored Feb 06, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  cd8b405b
- [Docs] Improve documentation (#33799) · 6e7b1c4b
  SorenDreano authored Feb 06, 2026
```
Co-authored-by: Soren Dreano <soren@numind.ai>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  6e7b1c4b
05 Feb, 2026 3 commits

[Feat][RL][1/2] Native Weight Syncing API: NCCL (#31943) · c1858b7e

Aaron Hao authored Feb 05, 2026


Signed-off-by: ahao-anyscale <ahao@anyscale.com>
Signed-off-by: Aaron Hao <ahao@anyscale.com>
Co-authored-by: SumanthRH <sumanthrh99@gmail.com>

c1858b7e

[Refactor] Move `task` outside of `PoolingParams.verify` (#33796) · 038914b7

Cyrus Leung authored Feb 05, 2026


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

038914b7

feat: Add ColBERT late interaction model support (#33686) · 439afa4e

Ilya Boytsov authored Feb 05, 2026


Signed-off-by: Ilya Boytsov <ilyaboytsov1805@gmail.com>
Signed-off-by: Ilya Boytsov <boytsovpanamera@mail.ru>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

439afa4e

04 Feb, 2026 2 commits
- [Bugfix] Fix `normalize` still being passed to `PoolerConfig` (#33794) · 80f921ba
  Cyrus Leung authored Feb 04, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  80f921ba
- [Frontend][4/n] Make pooling entrypoints request schema consensus | ScoreRequest (#33060) · 1b8fe6f7
  wang.yuqi authored Feb 04, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  1b8fe6f7
31 Jan, 2026 1 commit
- [Frontend] Use new Renderer for Completions and Tokenize API (#32863) · f0a1c845
  Cyrus Leung authored Jan 31, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f0a1c845
26 Jan, 2026 1 commit
- [Refactor] Use data parser for matching data items to multi-modal UUIDs (#32955) · 11b55687
  Cyrus Leung authored Jan 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  11b55687
22 Jan, 2026 1 commit
- [Frontend] Introduce Renderer for processing chat messages (using `ModelConfig`) (#30200) · d117a4d1
  Cyrus Leung authored Jan 22, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d117a4d1
16 Jan, 2026 1 commit
- [Frontend][1/n] Make pooling entrypoints request schema consensus | CompletionRequest (#32395) · 4ae77dfd
  wang.yuqi authored Jan 16, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  4ae77dfd
12 Jan, 2026 1 commit

[Feature] Support recording expert indices for rollout router replay (#28284) · 49e6b86c

Hongxin Xu authored Jan 12, 2026


Signed-off-by: xhx1022 <1737006628@qq.com>
Signed-off-by: Hongxin Xu <70438206+xhx1022@users.noreply.github.com>
Signed-off-by: arlenxu <arlenxu@tencent.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: arlenxu <arlenxu@tencent.com>

49e6b86c

10 Jan, 2026 1 commit
- [Refactor] Separate sequence and token pooling types (#32026) · 583a90e0
  Cyrus Leung authored Jan 10, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  583a90e0
09 Jan, 2026 1 commit
- [UX] Add vLLM model inspection view (#29450) · d5ec6c05
  Michael Goin authored Jan 09, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  d5ec6c05
24 Dec, 2025 1 commit
- [Perf] Add skip_clone to SamplingParams for internal request handling (#31041) · bc5ef333
  Michael Goin authored Dec 24, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  bc5ef333
23 Dec, 2025 2 commits

[Core] Add a random suffix to frontend-provided request IDs (#27987) · f7900686

Mark McLoughlin authored Dec 23, 2025


Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

f7900686

[Frontend] Support using chat template as custom score template for reranking models (#30550) · 23daef54

Jakub Zakrzewski authored Dec 23, 2025


Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>