Commits · 0a208d1f549a5e35605af5b01685d64cd727b73b · OpenDAS / vllm_cscc

06 Mar, 2026 1 commit

[BugFix] Fix engine hanging after KV cache initialization failure (#35478) · 0a208d1f

Shiyan Deng authored Mar 05, 2026


Signed-off-by: Shiyan Deng <dsy842974287@meta.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>

0a208d1f

05 Mar, 2026 1 commit

[Bugfix][CI] fix typos (#34934) · 6a895197

Jiayi Yan authored Mar 06, 2026

Signed-off-by: 1195343015 <1195343015@qq.com>
Signed-off-by: Jiayi Yan <66017932+1195343015@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6a895197

04 Mar, 2026 5 commits
- [CI] Bump `mypy` version (#34950) · 17dc9c7f
  Harry Mellor authored Mar 04, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  17dc9c7f
- [Frontend] Add vllm launch command for GPU-less preprocessing serving (#34551) · bc6be89d
  Hyunkyun Moon authored Mar 05, 2026
```
Signed-off-by: HyunKyun Moon <mhg5303@gmail.com>
```
  bc6be89d
- [BugFix] Fix implicit and incorrect assumption on ECConnector is_producer (#34783) · 6aa6ad89
  Qi Wang authored Mar 04, 2026
```
Signed-off-by: Qi Wang <qiwa@nvidia.com>
```
  6aa6ad89
- [Bugfix] Improve engine ready timeout error message (#35616) · 097eb544
  lailoo authored Mar 04, 2026
```
Signed-off-by: damaozi <1811866786@qq.com>
```
  097eb544
- [Bugfix] Fix coord_socket assertion in DPEngineCoreProc for offline DP mode (#35916) · f22ff295
  Jaewon authored Mar 03, 2026
```
Signed-off-by: Jaewon Lee <jaewon@meta.com>
```
  f22ff295
03 Mar, 2026 1 commit
- [Core] Add optional flags to check for repetitive token patterns in engine output (#35451) · 25e02647
  aykoppol authored Mar 02, 2026
```
Signed-off-by: aykoppol <aykoppol+git@gmail.com>
```
  25e02647
28 Feb, 2026 3 commits

[Deprecation] Deprecate code in 0.17 as scheduled (#35441) · e113a301

Wentao Ye authored Feb 28, 2026


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

e113a301

add io_process_plugin for sparse embedding (#34214) · 8e75d885

Augusto Yao authored Feb 28, 2026


Signed-off-by: augusto.yjh <augusto.yjh@antgroup.com>
Signed-off-by: Augusto Yao <augusto.yjh@antgroup.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

8e75d885

[1/N] Elastic EP Milestone 2 (#34861) · dea26833

Itay Alroy authored Feb 28, 2026


Signed-off-by: Yongji Wu <wuyongji317@gmail.com>
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: Ron Tourgeman <rtourgeman@nvidia.com>
Co-authored-by: Yongji Wu <wuyongji317@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Ron Tourgeman <rtourgeman@nvidia.com>

dea26833

26 Feb, 2026 1 commit
- [Refactor] Remove dead or duplicate func utils or variables (#35318) · 05972ea7
  Wentao Ye authored Feb 26, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  05972ea7
25 Feb, 2026 1 commit
- [Core] Cleanup engine pause/sleep logic (#34528) · dbf0da81
  Nick Hill authored Feb 24, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  dbf0da81
24 Feb, 2026 1 commit
- [Frontend] Always pass `supported_tasks` to validation (#35186) · 761e63e5
  Cyrus Leung authored Feb 24, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  761e63e5
21 Feb, 2026 1 commit
- Support prompt_embeds for pooling requests in output processor (#34904) · 59c62332
  Li authored Feb 20, 2026
```
Signed-off-by: Li Zhang <lzhanga@amazon.com>
Co-authored-by: Li Zhang <lzhanga@amazon.com>
```
  59c62332
20 Feb, 2026 3 commits
- [CI] Revert PRs 34818 and 33600 (#34979) · aaefc58e
  Lucas Wilkinson authored Feb 20, 2026
  
  aaefc58e
- [Refactor] Implement output type check in LLM (#34794) · ac900c89
  Cyrus Leung authored Feb 20, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ac900c89
- [Core] Fix state names in pause_scheduler() (#34840) · 76df6072
  Mark McLoughlin authored Feb 20, 2026
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  76df6072
19 Feb, 2026 1 commit

[Bugfix] Fix Basic Models Test (#34818) · 662205d3

Matthew Bonanni authored Feb 19, 2026


Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

662205d3

18 Feb, 2026 1 commit
- [Renderer] Deprecate code paths for old input processing (#34775) · a766b303
  Cyrus Leung authored Feb 18, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a766b303
17 Feb, 2026 1 commit
- [Renderer] Move InputPreprocessor into Renderer (2/2) (#34560) · 574fe752
  Cyrus Leung authored Feb 17, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  574fe752
15 Feb, 2026 1 commit

[KV Connector] Add temporary, off-by-default... · 79c7e092

Seiji Eicher authored Feb 14, 2026


[KV Connector] Add temporary, off-by-default `VLLM_DISABLE_REQUEST_ID_RANDOMIZATION` workaround (#34415)
Signed-off-by: Seiji Eicher <seiji@anyscale.com>

79c7e092

14 Feb, 2026 1 commit

[Renderer] Move InputPreprocessor into Renderer (1/2) (#34510) · 73391a1b

Cyrus Leung authored Feb 15, 2026


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

73391a1b

13 Feb, 2026 5 commits

[Core] Move pause and resume functions into engine (#34125) · dddbff46

Aaron Hao authored Feb 13, 2026


Signed-off-by: ahao-anyscale <ahao@anyscale.com>
Signed-off-by: Aaron Hao <ahao@anyscale.com>
Signed-off-by: hao-aaron <ahao@anyscale.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

dddbff46

[Refactor] Pass full VllmConfig to Renderer (#34485) · 2f308214
Cyrus Leung authored Feb 13, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
2f308214
[Refactor] Simplify BOS/EOS token handling (#34435) · ea5ff3a1
Cyrus Leung authored Feb 13, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
ea5ff3a1

[Core] Profiler improvements and lazy initialization (#33198) · 4453ba8d

Jaewon authored Feb 12, 2026


Signed-off-by: Jaewon Lee <jaewon@meta.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>

4453ba8d

[Core] Add sleep level 0 mode with enqueue/wait pattern (#33195) · aa181c92

Jaewon authored Feb 12, 2026


Signed-off-by: Jaewon Lee <jaewon@meta.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>

aa181c92

12 Feb, 2026 3 commits
- [BUG] Reset running requests when clearing cache for pause/resume (#34382) · 7b5a8b4a
  Aaron Hao authored Feb 12, 2026
```
Signed-off-by: hao-aaron <ahao@anyscale.com>
```
  7b5a8b4a
- [Refactor] Pass Renderer to Input Processor (#34329) · b96f7314
  Cyrus Leung authored Feb 12, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b96f7314
- [Refactor] Move validation to params definitions (#34362) · ced2a92f
  Cyrus Leung authored Feb 12, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ced2a92f
11 Feb, 2026 3 commits
- [Docs] Reduce time spent generating API docs (#34255) · 40b8f553
  Harry Mellor authored Feb 11, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  40b8f553
- [Frontend] Exploit tokenizers "new stream" in FastIncrementalDetokenizer (#34217) · e09546cf
  Nick Hill authored Feb 11, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  e09546cf
- [Misc] Clean up validation logic in input processor (#34144) · b5dcb372
  Cyrus Leung authored Feb 11, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b5dcb372
10 Feb, 2026 1 commit

[Perf] Optimize detokenizer python logic (#32975) · e1060a71

Wentao Ye authored Feb 10, 2026


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

e1060a71

09 Feb, 2026 1 commit

[Tiny] Rename encoder budget file to more specific name (#34103) · 7c233dbb

Reagan Lee authored Feb 08, 2026


Signed-off-by: Reagan Lee <“reaganjlee@gmail.com”>
Co-authored-by: Reagan Lee <“reaganjlee@gmail.com”>

7c233dbb

07 Feb, 2026 2 commits

[Misc] Make `PlaceholderRange.get_num_embeds` a method (#34035) · 48312e57
Cyrus Leung authored Feb 07, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
48312e57

[Feat][RL] Pause and Resume with keep requests for single engine (#32351) · 89a385d7

Aaron Hao authored Feb 06, 2026


Signed-off-by: ahao-anyscale <ahao@anyscale.com>
Signed-off-by: Aaron Hao <ahao@anyscale.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

89a385d7

06 Feb, 2026 2 commits
- [Refactor] Consolidate sequence normalization and enc-dec parsing (#33928) · cd8b405b
  Cyrus Leung authored Feb 06, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  cd8b405b
- [Feature] OTEL tracing during loading (#31162) · 325ab6b0
  emricksini-h authored Feb 06, 2026
  
  325ab6b0