Commits · 8de5261e69af81aaf7f68d420b69199653cd1882 · OpenDAS / vllm_cscc

21 Mar, 2026 1 commit

Add tensor IPC transfer mechanism for multimodal data (#32104) · 80b70884

Brandon Pelfrey authored Mar 21, 2026


Signed-off-by: Brandon Pelfrey <bpelfrey@nvidia.com>
Signed-off-by: Brandon Pelfrey <brandonpelfrey@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

80b70884

20 Mar, 2026 2 commits
- elastic_ep: Fix issues with repeated scale up/down cycles (#37131) · c57d38d6
  Itay Alroy authored Mar 21, 2026
```
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
Co-authored-by: Ron Tourgeman <rtourgeman@nvidia.com>
```
  c57d38d6
- Fix DP coordinator ZMQ port TOCTOU (#37452) · ca1ac1a4
  Itay Alroy authored Mar 20, 2026
```
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
```
  ca1ac1a4
19 Mar, 2026 1 commit
- [bug] Fix deadlock with pause resume and collective_rpc (#37024) · 6accb21f
  Aaron Hao authored Mar 18, 2026
```
Signed-off-by: hao-aaron <ahao@anyscale.com>
```
  6accb21f
18 Mar, 2026 1 commit
- elastic_ep: Fix stateless group port races (#36330) · de1a86b7
  Itay Alroy authored Mar 18, 2026
```
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
```
  de1a86b7
13 Mar, 2026 3 commits

[BugFix] Fix "DP Coordinator receives unexpected..." messages (#37008) · 54a6db82
Nick Hill authored Mar 13, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
54a6db82

[Frontend][Core] Re-add shutdown timeout - allowing in-flight requests to finish (#36666) · 7afe0faa

Mark McLoughlin authored Mar 13, 2026


Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

7afe0faa

[2/N] Elastic EP Milestone 2: Integrating NIXL-EP (#35627) · d5af196c

Itay Alroy authored Mar 13, 2026


Signed-off-by: Itay Alroy <ialroy@nvidia.com>
Co-authored-by: Yongji Wu <wuyongji317@gmail.com>
Co-authored-by: Ron Tourgeman <rtourgeman@nvidia.com>

d5af196c

12 Mar, 2026 2 commits
- [Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145) · 53ec16a7
  Kunshang Ji authored Mar 12, 2026
```
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  53ec16a7
- [BugFix] Fix multiple/duplicate stdout prefixes (#36822) · 36735fd7
  Nick Hill authored Mar 11, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  36735fd7
11 Mar, 2026 2 commits
- [Refactor] Remove dead code in KV connector (#36424) · 35bdca54
  Wentao Ye authored Mar 11, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  35bdca54
- [Bugfix] Surface exceptions from non-blocking execute_model in UniProcExecutor... · fa0d353a
  fangyuchu authored Mar 11, 2026
```
[Bugfix] Surface exceptions from non-blocking execute_model in UniProcExecutor to avoid DP deadlocks (#35194)
Signed-off-by: fangyuchu <fangyuchu@qq.com>
```
  fa0d353a
10 Mar, 2026 5 commits
- [Core] Simplify core kv-cache blocks initialization logic (#36521) · 65b2f405
  Nick Hill authored Mar 10, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  65b2f405
- [CI] Bump `mypy` version to 1.19.1 (#36104) · f83b933b
  Harry Mellor authored Mar 10, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  f83b933b
- [Misc] fix typo: homogenous-> homogeneous (2 lines change) (#36508) · 409c4e63
  SoluMilken authored Mar 10, 2026
```
Signed-off-by: SoluMilken <ypiheyn.imm02g@g2.nctu.edu.tw>
```
  409c4e63
- [Frontend][Core] Revert "Add shutdown timeout" (#34730 and #36270) (#36628) · 23486039
  Mark McLoughlin authored Mar 10, 2026
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  23486039
- [Perf] Compute maxsim in worker side, reducing redundant copies, 2.7% E2E... · 7279374f
  Wentao Ye authored Mar 09, 2026
```
[Perf] Compute maxsim in worker side, reducing redundant copies, 2.7% E2E throughput improvement (#36159)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  7279374f
09 Mar, 2026 2 commits
- Reapply [Attention] Refactor `check_and_update_config` (#35122) · 77a73458
  Matthew Bonanni authored Mar 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  77a73458
- [Deprecation][1/2] Remove items deprecated in v0.18 (#36470) · f96c3ab0
  Cyrus Leung authored Mar 09, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f96c3ab0
08 Mar, 2026 1 commit
- [Frontend] Add GPU-less render serving path (`vllm launch render`) (#36166) · 4497431d
  Sage authored Mar 08, 2026
  
  4497431d
07 Mar, 2026 1 commit

[Core] Fix benign error log during normal shutdown (#36270) · 6a18d878

Nick Hill authored Mar 06, 2026


Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>

6a18d878

06 Mar, 2026 3 commits
- Revert "[BugFix] Fix engine hanging after KV cache initialization fai… (#36262) · 26bd43b5
  Nick Hill authored Mar 06, 2026
  
  26bd43b5
- [Frontend][Core] Add shutdown timeout - allowing in-flight requests to finish (#34730) · 27066d1b
  Mark McLoughlin authored Mar 06, 2026
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com>
```
  27066d1b
- [BugFix] Fix engine hanging after KV cache initialization failure (#35478) · 0a208d1f
  Shiyan Deng authored Mar 05, 2026
```
Signed-off-by: Shiyan Deng <dsy842974287@meta.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
```
  0a208d1f
05 Mar, 2026 1 commit

[Bugfix][CI] fix typos (#34934) · 6a895197

Jiayi Yan authored Mar 06, 2026

Signed-off-by: 1195343015 <1195343015@qq.com>
Signed-off-by: Jiayi Yan <66017932+1195343015@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6a895197

04 Mar, 2026 5 commits
- [CI] Bump `mypy` version (#34950) · 17dc9c7f
  Harry Mellor authored Mar 04, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  17dc9c7f
- [Frontend] Add vllm launch command for GPU-less preprocessing serving (#34551) · bc6be89d
  Hyunkyun Moon authored Mar 05, 2026
```
Signed-off-by: HyunKyun Moon <mhg5303@gmail.com>
```
  bc6be89d
- [BugFix] Fix implicit and incorrect assumption on ECConnector is_producer (#34783) · 6aa6ad89
  Qi Wang authored Mar 04, 2026
```
Signed-off-by: Qi Wang <qiwa@nvidia.com>
```
  6aa6ad89
- [Bugfix] Improve engine ready timeout error message (#35616) · 097eb544
  lailoo authored Mar 04, 2026
```
Signed-off-by: damaozi <1811866786@qq.com>
```
  097eb544
- [Bugfix] Fix coord_socket assertion in DPEngineCoreProc for offline DP mode (#35916) · f22ff295
  Jaewon authored Mar 03, 2026
```
Signed-off-by: Jaewon Lee <jaewon@meta.com>
```
  f22ff295
03 Mar, 2026 1 commit
- [Core] Add optional flags to check for repetitive token patterns in engine output (#35451) · 25e02647
  aykoppol authored Mar 02, 2026
```
Signed-off-by: aykoppol <aykoppol+git@gmail.com>
```
  25e02647
28 Feb, 2026 3 commits

[Deprecation] Deprecate code in 0.17 as scheduled (#35441) · e113a301

Wentao Ye authored Feb 28, 2026


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

e113a301

add io_process_plugin for sparse embedding (#34214) · 8e75d885

Augusto Yao authored Feb 28, 2026


Signed-off-by: augusto.yjh <augusto.yjh@antgroup.com>
Signed-off-by: Augusto Yao <augusto.yjh@antgroup.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

8e75d885

[1/N] Elastic EP Milestone 2 (#34861) · dea26833

Itay Alroy authored Feb 28, 2026


Signed-off-by: Yongji Wu <wuyongji317@gmail.com>
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: Ron Tourgeman <rtourgeman@nvidia.com>
Co-authored-by: Yongji Wu <wuyongji317@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Ron Tourgeman <rtourgeman@nvidia.com>

dea26833

26 Feb, 2026 1 commit
- [Refactor] Remove dead or duplicate func utils or variables (#35318) · 05972ea7
  Wentao Ye authored Feb 26, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  05972ea7
25 Feb, 2026 1 commit
- [Core] Cleanup engine pause/sleep logic (#34528) · dbf0da81
  Nick Hill authored Feb 24, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  dbf0da81
24 Feb, 2026 1 commit
- [Frontend] Always pass `supported_tasks` to validation (#35186) · 761e63e5
  Cyrus Leung authored Feb 24, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  761e63e5
21 Feb, 2026 1 commit
- Support prompt_embeds for pooling requests in output processor (#34904) · 59c62332
  Li authored Feb 20, 2026
```
Signed-off-by: Li Zhang <lzhanga@amazon.com>
Co-authored-by: Li Zhang <lzhanga@amazon.com>
```
  59c62332
20 Feb, 2026 2 commits
- [CI] Revert PRs 34818 and 33600 (#34979) · aaefc58e
  Lucas Wilkinson authored Feb 20, 2026
  
  aaefc58e
- [Refactor] Implement output type check in LLM (#34794) · ac900c89
  Cyrus Leung authored Feb 20, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ac900c89