Commits · 7c0cf3bcd0867b5420e6ad4f2ff6b2b25e73b022 · OpenDAS / vllm_cscc

19 Mar, 2026 1 commit
- Cap the number of API servers to 1 when using Elastic EP. (#37466) · 7c0cf3bc
  Sage Moore authored Mar 19, 2026
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  7c0cf3bc
16 Mar, 2026 1 commit
- [Bugfix] Fix render server crash for quantized models on CPU-only hosts (#37215) · 0fefd00e
  Sage authored Mar 16, 2026
```
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
```
  0fefd00e
13 Mar, 2026 1 commit

[Frontend][Core] Re-add shutdown timeout - allowing in-flight requests to finish (#36666) · 7afe0faa

Mark McLoughlin authored Mar 13, 2026


Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

7afe0faa

12 Mar, 2026 1 commit
- [BugFix] Fix multiple/duplicate stdout prefixes (#36822) · 36735fd7
  Nick Hill authored Mar 11, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  36735fd7
10 Mar, 2026 3 commits

[Frontend][Core] Revert "Add shutdown timeout" (#34730 and #36270) (#36628) · 23486039
Mark McLoughlin authored Mar 10, 2026
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
23486039

feat(grpc): extract gRPC servicer into smg-grpc-servicer package, add --grpc... · 507ddbe9

Chang Su authored Mar 10, 2026

feat(grpc): extract gRPC servicer into smg-grpc-servicer package, add --grpc flag to vllm serve (#36169)
Signed-off-by: Chang Su <chang.s.su@oracle.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

507ddbe9

[Perf] Compute maxsim in worker side, reducing redundant copies, 2.7% E2E... · 7279374f

Wentao Ye authored Mar 09, 2026


[Perf] Compute maxsim in worker side, reducing redundant copies, 2.7% E2E throughput improvement (#36159)
Signed-off-by: yewentao256 <zhyanwentao@126.com>

7279374f

08 Mar, 2026 1 commit
- [Frontend] Add GPU-less render serving path (`vllm launch render`) (#36166) · 4497431d
  Sage authored Mar 08, 2026
  
  4497431d
06 Mar, 2026 1 commit
- [Frontend][Core] Add shutdown timeout - allowing in-flight requests to finish (#34730) · 27066d1b
  Mark McLoughlin authored Mar 06, 2026
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com>
```
  27066d1b
04 Mar, 2026 1 commit
- [Frontend] Add vllm launch command for GPU-less preprocessing serving (#34551) · bc6be89d
  Hyunkyun Moon authored Mar 05, 2026
```
Signed-off-by: HyunKyun Moon <mhg5303@gmail.com>
```
  bc6be89d
03 Mar, 2026 1 commit

[Refactor] Fix maxsim cuda platform and add cli to control it (#35427) · c21d0039

Wentao Ye authored Mar 02, 2026


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

c21d0039

28 Feb, 2026 1 commit

[1/N] Elastic EP Milestone 2 (#34861) · dea26833

Itay Alroy authored Feb 28, 2026


Signed-off-by: Yongji Wu <wuyongji317@gmail.com>
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: Ron Tourgeman <rtourgeman@nvidia.com>
Co-authored-by: Yongji Wu <wuyongji317@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Ron Tourgeman <rtourgeman@nvidia.com>

dea26833

10 Feb, 2026 1 commit
- [UX nit] Fix non-default api_server_count message (#34152) · 1f5febb4
  Michael Goin authored Feb 10, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  1f5febb4
22 Jan, 2026 1 commit
- [UX] Default api_server_count to dp_size if not specified (#32525) · 803e3f3f
  Tyler Michael Smith authored Jan 22, 2026
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  803e3f3f
15 Jan, 2026 1 commit
- [Bugfix] Strengthen the check of X-data-parallel-rank in Hybrid LB mode (#32314) · 1e584823
  dtc authored Jan 15, 2026
```
Signed-off-by: Tianchen Ding <dtcccc@linux.alibaba.com>
```
  1e584823
02 Jan, 2026 1 commit

Add Multimodal Processor Benchmark (#29105) · 1f5b7c41

Reagan Lee authored Jan 01, 2026


Signed-off-by: Reagan Lee <reaganjlee@gmail.com>
Signed-off-by: Reagan <reaganjlee@gmail.com>

1f5b7c41

24 Dec, 2025 1 commit
- [cli] complete vllm cli help message (#31226) · 5d930896
  Ning Xie authored Dec 24, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  5d930896
14 Dec, 2025 1 commit
- [Misc] Add a script to benchmark compilation time (#29919) · a8ec4865
  Bin Bao authored Dec 14, 2025
```
Signed-off-by: Bin Bao <binbao@meta.com>
```
  a8ec4865
03 Dec, 2025 1 commit
- [Docs] Discuss api key limitations in security guide (#29922) · b08025a8
  Russell Bryant authored Dec 02, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  b08025a8
16 Nov, 2025 1 commit

[V1] Support MP Executor for multi node distributed inference (#23691) · b316ac65

Lucia Fang authored Nov 16, 2025


Signed-off-by: Lu Fang <fanglu@fb.com>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Signed-off-by: Lucia Fang <fanglu@fb.com>
Signed-off-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

b316ac65

07 Nov, 2025 1 commit
- [CLI] add --max-tokens to `vllm complete` (#28109) · e0d6b4a8
  Iceber Gu authored Nov 07, 2025
```
Signed-off-by: Iceber Gu <caiwei95@hotmail.com>
```
  e0d6b4a8
05 Nov, 2025 1 commit
- [V0 deprecation] Remove VLLM_USE_V1 usage in most modules (#27955) · 428bc7bf
  wangxiyuan authored Nov 05, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  428bc7bf
29 Oct, 2025 1 commit

[Frontend] Add `vllm bench sweep` to CLI (#27639) · ecca3fee

Cyrus Leung authored Oct 29, 2025

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

ecca3fee

27 Oct, 2025 1 commit
- [Misc] Clean up utils (#27552) · 7c2bdb83
  Cyrus Leung authored Oct 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7c2bdb83
26 Oct, 2025 1 commit

[Chore]:Extract math and argparse utilities to separate modules (#27188) · 71b1c8b6

Yeshwanth N authored Oct 26, 2025


Signed-off-by: Yeshwanth Surya <yeshsurya@gmail.com>
Signed-off-by: Yeshwanth N <yeshsurya@gmail.com>
Signed-off-by: yeshsurya <yeshsurya@gmail.com>

71b1c8b6

22 Oct, 2025 1 commit
- [Chore] Separate out system utilities from vllm.utils (#27201) · a0003b56
  dongbo910220 authored Oct 23, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  a0003b56
21 Oct, 2025 1 commit
- [V0 Deprecation] Remove V0 executors (#27142) · 647214f3
  Nick Hill authored Oct 21, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  647214f3
19 Oct, 2025 1 commit

[Chore] Separate out `vllm.utils.network_utils` (#27164) · 7a6c8c3f

iAmir97 authored Oct 19, 2025


Signed-off-by: iAmir97 <Amir.balwel@embeddedllm.com>
Co-authored-by: iAmir97 <Amir.balwel@embeddedllm.com>

7a6c8c3f

12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
08 Oct, 2025 1 commit

[Bugfix] Fix `vllm bench ...` on CPU-only head nodes (#25283) · 76afe4ed

Aydin Abiar authored Oct 08, 2025

Signed-off-by: Aydin Abiar <aydin@anyscale.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Aydin Abiar <aydin@anyscale.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

76afe4ed

05 Oct, 2025 1 commit
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
24 Sep, 2025 1 commit
- Improve `--help` for enhanced user experience (#24903) · e7f27ea6
  Harry Mellor authored Sep 25, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e7f27ea6
19 Sep, 2025 1 commit
- [Frontend] Pass API server count to each process (#23717) · 6c117cff
  Cyrus Leung authored Sep 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6c117cff
18 Sep, 2025 1 commit
- [CLI] Use streaming in CLI chat and completion commands (#23769) · e111d5b0
  Simon Mo authored Sep 17, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  e111d5b0
11 Aug, 2025 1 commit
- [Docs] Add comprehensive CLI reference for all large `vllm` subcommands (#22601) · bc1d02ac
  Harry Mellor authored Aug 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  bc1d02ac
07 Aug, 2025 2 commits
- [Frontend] Use engine argument to control MM cache size (#22441) · 139d1557
  Cyrus Leung authored Aug 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  139d1557
- [Core] Store only the keys for multi-modal data in P0 (#22198) · 766bc816
  Cyrus Leung authored Aug 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  766bc816
01 Aug, 2025 3 commits
- [BugFix] Don't change title of top-level process (#22032) · 3146519a
  Nick Hill authored Aug 01, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  3146519a
- [Bugfix] Add log prefix in non-dp mode engine core (#21889) · e6680f9e
  wuhang authored Aug 01, 2025
```
Signed-off-by: wuhang <wuhang6@huawei.com>
```
  e6680f9e
- [Bugfix] Disable multi-modal preprocessor cache for DP (#21896) · b4e081cb
  Cyrus Leung authored Aug 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b4e081cb