Commits · 6c2cfb62ffb81b1ec3c39d2501d1e51ed6e76a4e · OpenDAS / vllm_cscc

31 Dec, 2025 1 commit
- [BugFix] Fix async scheduling for pooling models (#31584) · 6c2cfb62
  Nick Hill authored Dec 31, 2025
```
Signed-off-by: njhill <nickhill123@gmail.com>
```
  6c2cfb62
30 Dec, 2025 1 commit
- [Minor] Various small code cleanups/simplifications (#31508) · 3b312fb7
  Nick Hill authored Dec 29, 2025
```
Signed-off-by: njhill <nickhill123@gmail.com>
```
  3b312fb7
13 Dec, 2025 2 commits

[Logs] Optimize startup logs 4 (#29903) · 6e78ed6b

Wentao Ye authored Dec 13, 2025

Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

6e78ed6b

[Doc] Add documents for multi-node distributed serving with MP backend (#30509) · 7c16f3fb
Isotr0py authored Dec 14, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
7c16f3fb

12 Dec, 2025 1 commit
- [CI] Fix mypy for vllm/v1/executor (#30517) · 02a58803
  Wentao Ye authored Dec 12, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  02a58803
19 Nov, 2025 1 commit

[Feature] Prefill Context Parallel (PCP) basic support (#28718) · 2fd893b4

Qiu authored Nov 20, 2025


Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Signed-off-by: FENP <yuanyongjie.yyj@antgroup.com>
Signed-off-by: LookAround <lixushi@huawei.com>
Signed-off-by: Jingchun Gao <gaojingchun1@huawei.com>
Signed-off-by: zhenwenqi2024 <zhenwenqi_2022@qq.com>
Co-authored-by: FENP <yuanyongjie.yyj@antgroup.com>
Co-authored-by: LookAround <lixushi@huawei.com>
Co-authored-by: Jingchun Gao <gaojingchun1@huawei.com>
Co-authored-by: zhenwenqi2024 <zhenwenqi_2022@qq.com>
Co-authored-by: Jingchun Gao <63247409+gjc0824@users.noreply.github.com>

2fd893b4

18 Nov, 2025 1 commit
- [BugFix] Fix PP/async scheduling with pooling models (#28899) · 43936849
  Nick Hill authored Nov 18, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  43936849
17 Nov, 2025 1 commit
- [BugFix] Fix PP performance and PP kv connector output regression (#28768) · 7765e5ba
  Nick Hill authored Nov 17, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  7765e5ba
16 Nov, 2025 1 commit

[V1] Support MP Executor for multi node distributed inference (#23691) · b316ac65

Lucia Fang authored Nov 16, 2025


Signed-off-by: Lu Fang <fanglu@fb.com>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Signed-off-by: Lucia Fang <fanglu@fb.com>
Signed-off-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

b316ac65

14 Nov, 2025 1 commit

[DCP] Support Decode Context Parallel (DCP) for GQA with Flashinfer (#25438) · 4516d44b

Jingchun Gao authored Nov 14, 2025


Signed-off-by: gaojc <1055866782@qq.com>
Signed-off-by: Jingchun Gao <gaojingchun1@huawei.com>
Signed-off-by: Jingchun Gao <63247409+gjc0824@users.noreply.github.com>
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Co-authored-by: gaojingchun (A) <g00955623@china.huawei.com>
Co-authored-by: Jingchun Gao <gaojingchun1@huawei.com>
Co-authored-by: QiuChunshuo <qiuchunshuo@huawei.com>

4516d44b

11 Nov, 2025 1 commit
- [Misc] Cleanup Executor interface (#28441) · d4902ba5
  wangxiyuan authored Nov 12, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  d4902ba5
09 Nov, 2025 1 commit
- [Core] Simplify async KV output aggregation (#28327) · 289eb6c5
  Nick Hill authored Nov 09, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  289eb6c5
07 Nov, 2025 2 commits
- [PerfFix] Avoid separate thread for MP executor shm spin (take 2) (#28319) · 67a2da89
  Nick Hill authored Nov 07, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  67a2da89
- Revert "[PerfFix] Avoid separate thread for MP executor shm spin (#28012)" (#28289) · 68a72a5c
  Nicolò Lucchesi authored Nov 07, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  68a72a5c
04 Nov, 2025 1 commit
- [PerfFix] Avoid separate thread for MP executor shm spin (#28012) · c9f66da8
  Nick Hill authored Nov 04, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  c9f66da8
01 Nov, 2025 2 commits
- [V0 deprecation] Remove VLLM_USE_V1 usage in platform and v1 module (#27798) · 30a14b03
  wangxiyuan authored Nov 01, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  30a14b03
- [Core] Async scheduling + structured outputs compatibility (#26866) · 0cdbe7b7
  Nick Hill authored Oct 31, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  0cdbe7b7
31 Oct, 2025 1 commit

[Bugfix] Missing NIXL metadata for handshake initialization if instance spans multi-node (#26338) · d6517be3

GuanLuo authored Nov 01, 2025


Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>

d6517be3

30 Oct, 2025 2 commits
- [BugFix] Fix broken import in initialize_ray_cluster() (#27838) · c9791f18
  Nick Hill authored Oct 30, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  c9791f18
- [Bugfix] Improve GPU validation logging in Ray fallback scenarios (#25775) · 74374386
  Sairam Pillai authored Oct 30, 2025
```
Signed-off-by: Sairam Pillai <sairam.pillai61@gmail.com>
```
  74374386
27 Oct, 2025 1 commit
- [Misc] Clean up more utils (#27567) · 6ebffafb
  Cyrus Leung authored Oct 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6ebffafb
22 Oct, 2025 2 commits
- [Chore] Separate out system utilities from vllm.utils (#27201) · a0003b56
  dongbo910220 authored Oct 23, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  a0003b56
- [P/D] Dynamic `kv_output_aggregator` collect size (#26734) · 4dfdb821
  Nicolò Lucchesi authored Oct 22, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  4dfdb821
21 Oct, 2025 1 commit
- [V0 Deprecation] Remove V0 executors (#27142) · 647214f3
  Nick Hill authored Oct 21, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  647214f3
19 Oct, 2025 1 commit

[Chore] Separate out `vllm.utils.network_utils` (#27164) · 7a6c8c3f

iAmir97 authored Oct 19, 2025


Signed-off-by: iAmir97 <Amir.balwel@embeddedllm.com>
Co-authored-by: iAmir97 <Amir.balwel@embeddedllm.com>

7a6c8c3f

17 Oct, 2025 1 commit
- [Chore] Separate out `vllm.utils.importlib` (#27022) · 4d4d6bad
  Cyrus Leung authored Oct 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4d4d6bad
14 Oct, 2025 1 commit
- [Perf] Cache vllm.env.__getattr__ result to avoid recomputation (#26146) · 380f1752
  Jialin Ouyang authored Oct 14, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  380f1752
12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
10 Oct, 2025 1 commit
- [Metrics] Log multi-modal cache stats and fix reset (#26285) · ad430a67
  Cyrus Leung authored Oct 10, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ad430a67
05 Oct, 2025 1 commit
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
29 Sep, 2025 1 commit
- [V0 Deprecation] Remove `vllm.worker` and update according imports (#25901) · 6a113d9a
  Aaron Pham authored Sep 29, 2025
  
  6a113d9a
26 Sep, 2025 1 commit
- [Misc] Don't log shm dequeue delay warning on worker side (#25720) · 8b77328f
  Nick Hill authored Sep 25, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  8b77328f
21 Sep, 2025 1 commit
- [V0 Deprecation] Remove V0 MP executor (#25329) · 7ed82d19
  Woosuk Kwon authored Sep 20, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  7ed82d19
15 Sep, 2025 1 commit

[P/D]`kv_output_aggregator` support P TP > D TP (#23917) · 8de261b0

Chao Lei authored Sep 15, 2025


Signed-off-by: LCAIZJ <leichao139636@163.com>
Co-authored-by: leichao.lc <leichao.lc@antgroup.com>

8de261b0

12 Sep, 2025 3 commits
- [Core] Support async scheduling with uniproc executor (#24219) · 4fdd6f5c
  Nick Hill authored Sep 12, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Ronald1995 <ronaldautomobile@163.com>
Co-authored-by: Ronald1995 <ronaldautomobile@163.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  4fdd6f5c
- [Bugfix] Fix incompatibility between #20452 and #24548 (#24754) · 010acc6e
  Cyrus Leung authored Sep 13, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  010acc6e
- [Core] Shared memory based object store for Multimodal data caching and IPC (#20452) · a5b84f1c
  dongluw authored Sep 12, 2025
```
Signed-off-by: donglu <donglu@cohere.com>
```
  a5b84f1c
09 Sep, 2025 1 commit
- [Misc] Improve Worker process title and logging prefix (#22205) · 0cdd2136
  22quinn authored Sep 08, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  0cdd2136
08 Sep, 2025 1 commit
- [P/D] Add a shutdown method to the Connector API (#22699) · 61aa4b29
  Chauncey authored Sep 08, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  61aa4b29
06 Sep, 2025 1 commit
- [Perf][V1] Fully overlap model execution (#23569) · cee182b2
  Benjamin Chislett authored Sep 05, 2025
```
Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
```
  cee182b2