Commits · 82531edbfb6b33e1c8667dea15c8622f011dcef0 · OpenDAS / vllm_cscc

14 Apr, 2026 1 commit
- Measure encoder compile time seperate from llm backbone (#39240) · c08f3b2a
  Lucas Kabela authored Apr 14, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  c08f3b2a
08 Apr, 2026 1 commit

[Feature] NUMA binding support for GPU workers (#38635) · 75e01a39

Shengqi Chen authored Apr 09, 2026


Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
Co-authored-by: Jason Li <jasonlizhengjian@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

75e01a39

06 Apr, 2026 1 commit
- [Refactor] Remove unused dead code (#38842) · 4ae218c1
  Wentao Ye authored Apr 06, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  4ae218c1
03 Apr, 2026 1 commit
- [CPU] Replace OMP initialization (#36487) · abebd932
  Anton Ivanov authored Apr 03, 2026
```
Signed-off-by: Anton Ivanov <anton.ivanov@cambridgegreys.com>
```
  abebd932
01 Apr, 2026 3 commits
- [BugFix] Fix precommit breakage due to conflicting in-flight merges (#38759) · 6241521d
  Nick Hill authored Apr 01, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  6241521d
- [Feat][Executor] Introduce RayExecutorV2 (#36836) · de5e6c44
  Jeffrey Wang authored Apr 01, 2026
```
Signed-off-by: Jeffrey Wang <jeffreywang@anyscale.com>
```
  de5e6c44
- [Refactor] Simplify FutureWrapper in MultiprocExecutor (#38644) · cb268e4e
  yzong-rh authored Apr 01, 2026
```
Signed-off-by: Yifan <yzong@redhat.com>
Signed-off-by: Yifan Zong <yzong@redhat.com>
```
  cb268e4e
31 Mar, 2026 1 commit

replace cuda_device_count_stateless() to current_platform.device_count() (#37841) · 4dfad17e

wliao2 authored Mar 31, 2026


Signed-off-by: Liao, Wei <wei.liao@intel.com>
Signed-off-by: wliao2 <wei.liao@intel.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>

4dfad17e

20 Mar, 2026 1 commit
- elastic_ep: Fix issues with repeated scale up/down cycles (#37131) · c57d38d6
  Itay Alroy authored Mar 21, 2026
```
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
Co-authored-by: Ron Tourgeman <rtourgeman@nvidia.com>
```
  c57d38d6
18 Mar, 2026 3 commits
- [bugfix][async scheduling] fix extra cuda context in device 0 with EP/DP (#37449) · 70b81c4f
  youkaichao authored Mar 19, 2026
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  70b81c4f
- [Log] Reduce duplicate log (#37313) · c373b5c0
  Wentao Ye authored Mar 18, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c373b5c0
- [Hardware][TPU] Add supports_async_scheduling() method to Executor interface... · a0dd1995
  gxd3 authored Mar 17, 2026
```
[Hardware][TPU] Add supports_async_scheduling() method to Executor interface so that it can be extended for Executor implementations. (#36924)
Signed-off-by: Guangxiang Du <gxd@google.com>
```
  a0dd1995
11 Mar, 2026 1 commit

[Bugfix] Surface exceptions from non-blocking execute_model in UniProcExecutor... · fa0d353a

fangyuchu authored Mar 11, 2026


[Bugfix] Surface exceptions from non-blocking execute_model in UniProcExecutor to avoid DP deadlocks (#35194)
Signed-off-by: fangyuchu <fangyuchu@qq.com>

fa0d353a

10 Mar, 2026 1 commit
- [CI] Bump `mypy` version to 1.19.1 (#36104) · f83b933b
  Harry Mellor authored Mar 10, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  f83b933b
09 Mar, 2026 1 commit
- Reapply [Attention] Refactor `check_and_update_config` (#35122) · 77a73458
  Matthew Bonanni authored Mar 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  77a73458
06 Mar, 2026 2 commits

[Bugfix] Quickfix followups to busy loop removal in #28053 (#36068) · 6b625a88

Travis Johnson authored Mar 06, 2026


Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

6b625a88

[Bugfix] Fix inner_dp_world initialization order for multi-node TP (#35892) · 86e1060b

Yongye Zhu authored Mar 06, 2026


Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

86e1060b

05 Mar, 2026 1 commit
- [Core] Move ray-specific WorkerWrapperBase methods to RayWorkerWrapper (#35328) · 16c472ab
  Nick Hill authored Mar 04, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  16c472ab
04 Mar, 2026 2 commits

[BugFix] Fix implicit and incorrect assumption on ECConnector is_producer (#34783) · 6aa6ad89
Qi Wang authored Mar 04, 2026
```
Signed-off-by: Qi Wang <qiwa@nvidia.com>
```
6aa6ad89

[Core] Remove busy loop from idle buffer readers (#28053) · 6f0dd938

Joe Runde authored Mar 04, 2026


Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Travis Johnson <tsjohnso@us.ibm.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

6f0dd938

28 Feb, 2026 3 commits

[Fix] Avoid sending image input to other PP ranks (#35405) · 49b9ae32

emricksini-h authored Feb 28, 2026


Signed-off-by: emricksini-h <emrick.birivoutin@hcompany.ai>
Co-authored-by: Roger Wang <hey@rogerw.io>

49b9ae32

[Bugfix] Propagate compilation_time from workers to main process for TP>1 (#35503) · 7b346ba8
Huy Do authored Feb 27, 2026
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
7b346ba8

[1/N] Elastic EP Milestone 2 (#34861) · dea26833

Itay Alroy authored Feb 28, 2026


Signed-off-by: Yongji Wu <wuyongji317@gmail.com>
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: Ron Tourgeman <rtourgeman@nvidia.com>
Co-authored-by: Yongji Wu <wuyongji317@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Ron Tourgeman <rtourgeman@nvidia.com>

dea26833

27 Feb, 2026 1 commit
- [Core]Extract is_last_rank in Ray for tpu to override (#33012) · 06be5356
  Chenyaaang authored Feb 26, 2026
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
  06be5356
26 Feb, 2026 1 commit
- [Bugfix] Fix MessageQueue connect_ip for cross-node data parallelism (#35429) · 0f2f24c8
  Lucia Fang authored Feb 26, 2026
```
Signed-off-by: Lu Fang <fanglu@fb.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
```
  0f2f24c8
20 Feb, 2026 1 commit
- [CI] Revert PRs 34818 and 33600 (#34979) · aaefc58e
  Lucas Wilkinson authored Feb 20, 2026
  
  aaefc58e
19 Feb, 2026 1 commit

[Bugfix] Fix Basic Models Test (#34818) · 662205d3

Matthew Bonanni authored Feb 19, 2026


Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

662205d3

17 Feb, 2026 1 commit
- [Ray] Propagate third-party env vars to Ray workers via prefix matching (#34383) · c464b573
  kourosh hakhamaneshi authored Feb 17, 2026
```
Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
```
  c464b573
13 Feb, 2026 1 commit

[Core] Profiler improvements and lazy initialization (#33198) · 4453ba8d

Jaewon authored Feb 12, 2026


Signed-off-by: Jaewon Lee <jaewon@meta.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>

4453ba8d

06 Feb, 2026 1 commit
- [Feature] OTEL tracing during loading (#31162) · 325ab6b0
  emricksini-h authored Feb 06, 2026
  
  325ab6b0
04 Feb, 2026 1 commit
- [rocm][ray] Fix: Unify Ray device visibility handling across CUDA and ROCm (#33308) · 2f6d17cb
  kourosh hakhamaneshi authored Feb 04, 2026
```
Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>
```
  2f6d17cb
31 Jan, 2026 1 commit
- Support clear mm and encoder cache (#33452) · 22d9a056
  jma99_2333 authored Jan 31, 2026
```
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  22d9a056
24 Jan, 2026 1 commit
- [Core][Bugfix] allow graceful worker termination (#32965) · 7e1f10d5
  Joe Runde authored Jan 23, 2026
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  7e1f10d5
16 Jan, 2026 1 commit
- [TPU][Core] Enable Pipeline Parallelism on TPU backend (#28506) · 484e22bc
  Chenyaaang authored Jan 16, 2026
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
  484e22bc
15 Jan, 2026 1 commit
- [Feature] Support async scheduling + PP (#32359) · b34474bf
  Wentao Ye authored Jan 15, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  b34474bf
07 Jan, 2026 1 commit
- [Chore] Try remove `init_cached_hf_modules` (#31786) · aafd4d23
  Cyrus Leung authored Jan 07, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  aafd4d23
31 Dec, 2025 1 commit
- [BugFix] Fix async scheduling for pooling models (#31584) · 6c2cfb62
  Nick Hill authored Dec 31, 2025
```
Signed-off-by: njhill <nickhill123@gmail.com>
```
  6c2cfb62
30 Dec, 2025 1 commit
- [Minor] Various small code cleanups/simplifications (#31508) · 3b312fb7
  Nick Hill authored Dec 29, 2025
```
Signed-off-by: njhill <nickhill123@gmail.com>
```
  3b312fb7
13 Dec, 2025 2 commits

[Logs] Optimize startup logs 4 (#29903) · 6e78ed6b

Wentao Ye authored Dec 13, 2025

Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

6e78ed6b

[Doc] Add documents for multi-node distributed serving with MP backend (#30509) · 7c16f3fb
Isotr0py authored Dec 14, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
7c16f3fb