Commits · a5b84f1cbfeb4030fd7fab4a91d4264b356e20b0 · OpenDAS / vllm_cscc · GitLab

12 Sep, 2025 1 commit
- [Core] Shared memory based object store for Multimodal data caching and IPC (#20452) · a5b84f1c
  dongluw authored Sep 12, 2025
```
Signed-off-by: donglu <donglu@cohere.com>
```
  a5b84f1c
09 Sep, 2025 1 commit
- [Misc] Improve Worker process title and logging prefix (#22205) · 0cdd2136
  22quinn authored Sep 08, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  0cdd2136
08 Sep, 2025 1 commit
- [P/D] Add a shutdown method to the Connector API (#22699) · 61aa4b29
  Chauncey authored Sep 08, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  61aa4b29
06 Sep, 2025 1 commit
- [Perf][V1] Fully overlap model execution (#23569) · cee182b2
  Benjamin Chislett authored Sep 05, 2025
```
Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
```
  cee182b2
05 Sep, 2025 1 commit
- [RFC] allow cancelation after shutdown in blocking collective_rpc (#23390) · 9dfbeb41
  Shiyan Deng authored Sep 05, 2025
```
Signed-off-by: Shiyan Deng <dsy842974287@meta.com>
```
  9dfbeb41
29 Aug, 2025 1 commit
- [BugFix] Async scheduling and PP compatibility with DP (#23770) · d90d8eb6
  Nick Hill authored Aug 29, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  d90d8eb6
27 Aug, 2025 1 commit
- [Docs] Fix warnings in `mkdocs build` (continued) (#23743) · 4e4d017b
  Hyogeun Oh (오효근) authored Aug 28, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
Signed-off-by: Hyogeun Oh (오효근) <ohg3417@gmail.com>
```
  4e4d017b
22 Aug, 2025 1 commit
- [Core] Support custom executor qualname (#23314) · 480bdf5a
  22quinn authored Aug 21, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  480bdf5a
19 Aug, 2025 1 commit
- [Spec Decode] Make `propose_draft_token_ids` non-blocking for lower TTFT (#23041) · c9b38be8
  Woosuk Kwon authored Aug 18, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  c9b38be8
03 Aug, 2025 1 commit
- [executor] feat: add supports_pp attr to executors (#21786) · 24d1dffb
  H authored Aug 03, 2025
```
Signed-off-by: Haibin Lin <haibin.lin@bytedance.com>
```
  24d1dffb
01 Aug, 2025 1 commit
- [Bugfix] Add log prefix in non-dp mode engine core (#21889) · e6680f9e
  wuhang authored Aug 01, 2025
```
Signed-off-by: wuhang <wuhang6@huawei.com>
```
  e6680f9e
29 Jul, 2025 1 commit
- [Misc] Rework process titles (#21780) · 7234fe26
  Nick Hill authored Jul 29, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  7234fe26
28 Jul, 2025 1 commit
- [Bugfix]check health for engine core process exiting unexpectedly (#21728) · bccc43c0
  wuhang authored Jul 28, 2025
```
Signed-off-by: wuhang <wuhang6@huawei.com>
```
  bccc43c0
24 Jul, 2025 1 commit
- [Feat] Allow custom naming of vLLM processes (#21445) · 6da00785
  Chauncey authored Jul 24, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  6da00785
19 Jul, 2025 2 commits
- [BugFix] Make PD work with Ray (#21072) · 9f414a12
  kourosh hakhamaneshi authored Jul 19, 2025
```
Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>
```
  9f414a12
- Elastic Expert Parallel Initial Support (#20775) · 21793722
  Rui Qiao authored Jul 18, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  21793722
17 Jul, 2025 1 commit
- [V1] [KVConnector] Fix MultiprocExecutor worker output aggregation (#21048) · 4fcef49e
  David Ben-David authored Jul 17, 2025
```
Signed-off-by: David Ben-David <davidb@pliops.com>
Co-authored-by: David Ben-David <davidb@pliops.com>
```
  4fcef49e
15 Jul, 2025 2 commits

[Bug Fix] get_distributed_init_method should get the ip from get_ip i… (#20889) · 10be2094

Chen LI authored Jul 15, 2025


Signed-off-by: Chen Li <lcpingping@gmail.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>

10be2094

Implement Async Scheduling (#19970) · d4d30940
Woosuk Kwon authored Jul 14, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
d4d30940

10 Jul, 2025 2 commits
- [KVConnector] Always call connector `clear_metadata()` at end of step (#20756) · 574ad60d
  Nick Hill authored Jul 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: David Ben-David <sdavidbd@gmail.com>
```
  574ad60d
- [KVConnector] Aggregate finished requests on the scheduler (#19555) · cc876d0f
  Or Ozeri authored Jul 10, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  cc876d0f
23 Jun, 2025 1 commit
- [Misc] Configurable timeout for execute_model RPC calls via env var (#19544) · f39ab2d4
  jinqinn authored Jun 23, 2025
```
Signed-off-by: jinqinn <goodqinjin@163.com>
```
  f39ab2d4
08 Jun, 2025 1 commit
- [Multi Modal] Add an env var for message queue max chunk bytes (#19242) · cda10fa3
  jennyyyyzhen authored Jun 08, 2025
```
Signed-off-by: yZhen <yZhen@fb.com>
Co-authored-by: yZhen <yZhen@fb.com>
```
  cda10fa3
03 Jun, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
23 May, 2025 1 commit
- [BugFix] Increase TP execute_model timeout (#18558) · 93ecb813
  Nick Hill authored May 22, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  93ecb813
22 May, 2025 1 commit
- Intialize io_thread_pool attribute in the beginning. (#18331) · acb54ca8
  Rabi Mishra authored May 22, 2025
```
Signed-off-by: rabi <ramishra@redhat.com>
```
  acb54ca8
07 May, 2025 1 commit
- [BugFix] Avoid secondary missing `MultiprocExecutor.workers` error (#17811) · ed5272cf
  Nick Hill authored May 07, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  ed5272cf
06 May, 2025 1 commit

[V1][PP] Support PP for MultiprocExecutor (#14219) · a6fed020

Li, Jiang authored May 06, 2025


Signed-off-by: jiang1.li <jiang1.li@intel.com>
Signed-off-by: jiang.li <jiang1.li@intel.com>

a6fed020

22 Apr, 2025 1 commit
- [BugFix] Remove default multiproc executor `collective_rpc` timeout (#17000) · 5175b884
  Nick Hill authored Apr 22, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  5175b884
17 Apr, 2025 1 commit

[V1][Frontend] Improve Shutdown And Logs (#11737) · 2b05b8ce

Robert Shaw authored Apr 16, 2025


Signed-off-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Signed-off-by: Andrew Feldman <afeldman@neuralmagic.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Andrew Feldman <afeldman@neuralmagic.com>
Co-authored-by: afeldman-nm <156691304+afeldman-nm@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

2b05b8ce

09 Apr, 2025 1 commit
- [BugFix] fix some typos found by typos. (#16314) · 04149cce
  yihong authored Apr 09, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  04149cce
08 Apr, 2025 1 commit
- [core] do not send error across process (#16174) · a865bc1c
  youkaichao authored Apr 08, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  a865bc1c
27 Mar, 2025 1 commit
- [V1] AsyncLLM data parallel (#13923) · 15dac210
  Nick Hill authored Mar 27, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  15dac210
21 Mar, 2025 1 commit
- [v1] Refactor KVCacheConfig (#14079) · 93a00d7d
  Chen Zhang authored Mar 21, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  93a00d7d
20 Mar, 2025 1 commit
- [Attention] Flash Attention 3 - fp8 (#14570) · a597a575
  Mickaël Seznec authored Mar 20, 2025
```
Signed-off-by: Mickael Seznec <mickael@mistral.ai>
```
  a597a575
03 Mar, 2025 1 commit
- Update deprecated Python 3.8 typing (#13971) · cf069aa8
  Harry Mellor authored Mar 03, 2025
  
  cf069aa8
01 Mar, 2025 1 commit
- [Bugfix][V1][Minor] Fix shutting_down flag checking in V1 MultiprocExecutor (#14053) · 02296f42
  Li, Jiang authored Mar 01, 2025
  
  02296f42
23 Feb, 2025 1 commit
- [v1] torchrun compatibility (#13642) · eb24dc4a
  youkaichao authored Feb 23, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  eb24dc4a
22 Feb, 2025 1 commit
- [core] set up data parallel communication (#13591) · 3e472d88
  youkaichao authored Feb 22, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  3e472d88
18 Feb, 2025 1 commit
- [V1][PP] Enable true PP with Ray executor (#13472) · 4fb8142a
  Woosuk Kwon authored Feb 18, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  4fb8142a