Commits · c7d2a554baf8694503e6865b5df300650b6c6b6b · OpenDAS / vllm_cscc

29 Oct, 2025 1 commit
- [Core] Exposing engine sleep & wake_up state as prometheus metrics (#24176) · 1da3309a
  Braulio Dumba authored Oct 29, 2025
```
Signed-off-by: Braulio Dumba <Braulio.Dumba@ibm.com>
```
  1da3309a
28 Oct, 2025 1 commit
- [Misc] Separate out `utils.counter` and move `utils.Device` to engine (#27588) · f58d9b64
  Cyrus Leung authored Oct 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f58d9b64
26 Oct, 2025 1 commit

[Chore]:Extract math and argparse utilities to separate modules (#27188) · 71b1c8b6

Yeshwanth N authored Oct 26, 2025


Signed-off-by: Yeshwanth Surya <yeshsurya@gmail.com>
Signed-off-by: Yeshwanth N <yeshsurya@gmail.com>
Signed-off-by: yeshsurya <yeshsurya@gmail.com>

71b1c8b6

21 Oct, 2025 1 commit
- [V0 Deprecation] Remove V0 executors (#27142) · 647214f3
  Nick Hill authored Oct 21, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  647214f3
19 Oct, 2025 1 commit
- [Misc] Move utils to avoid conflicts with stdlib, and move tests (#27169) · d31f7844
  Cyrus Leung authored Oct 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d31f7844
18 Oct, 2025 1 commit
- [V1][Metrics][Plugin] Add plugin support for custom `StatLoggerBase` implementations (#22456) · 83e760c5
  Tova Movshovitz authored Oct 19, 2025
```
Signed-off-by: tovam <tovam@pliops.com>
```
  83e760c5
16 Oct, 2025 2 commits
- [Chore] Separate out `vllm.utils.collections` (#26990) · d2740faf
  Cyrus Leung authored Oct 16, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d2740faf
- [Chore] Rename `utils` submodules (#26920) · f6cdc9a0
  Cyrus Leung authored Oct 16, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f6cdc9a0
15 Oct, 2025 3 commits
- [Chore] Separate out `vllm.utils.async_utils` (#26913) · 828523ad
  Cyrus Leung authored Oct 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  828523ad
- [Chore] Separate out `vllm.utils.func` (#26904) · 136a17fe
  Cyrus Leung authored Oct 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  136a17fe
- [Core][Easy] Use envs.__getattr__ for all Unify to environment variable access (#26810) · 07ca70af
  Jialin Ouyang authored Oct 14, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  07ca70af
14 Oct, 2025 1 commit
- [Misc][DP] support customized aggregated logger for dp (#24354) · 8317f723
  Lucia Fang authored Oct 13, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
```
  8317f723
12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
10 Oct, 2025 1 commit
- [Metrics] Log multi-modal cache stats and fix reset (#26285) · ad430a67
  Cyrus Leung authored Oct 10, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ad430a67
09 Oct, 2025 1 commit
- [Bugfix] Fix SHM cache initialization (#26427) · 4bdf7ac5
  Cyrus Leung authored Oct 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4bdf7ac5
06 Oct, 2025 1 commit
- [Frontend] Consolidate tokenizer init code (#26276) · 391612e7
  Cyrus Leung authored Oct 06, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  391612e7
05 Oct, 2025 1 commit
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
03 Oct, 2025 2 commits

[Renderer] Move Processor out of AsyncLLM (#24138) · 812b7f54

Yang Liu authored Oct 03, 2025


Signed-off-by: Yang <lymailforjob@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

812b7f54

[Input] Remove unused `prompt` field (#26097) · 0ad9951c
Cyrus Leung authored Oct 03, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
0ad9951c

02 Oct, 2025 1 commit
- [Misc] Make handling of SamplingParams clearer in n>1 case (#26032) · 169313b9
  Nick Hill authored Oct 01, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  169313b9
01 Oct, 2025 1 commit
- [Bugfix] Apply same sampling parameters for both `n=1` and `n>1` (#26005) · 3b7c20a6
  Kenichi Maehashi authored Oct 01, 2025
```
Signed-off-by: Kenichi Maehashi <maehashi@preferred.jp>
```
  3b7c20a6
21 Sep, 2025 1 commit

[V0 Deprecation] Remove V0 core (#25321) · c99db8c8

Woosuk Kwon authored Sep 20, 2025


Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

c99db8c8

18 Sep, 2025 1 commit

[Chore] Cleanup guided namespace, move to structured outputs config (#22772) · 29283e89

Aaron Pham authored Sep 18, 2025

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

29283e89

17 Sep, 2025 1 commit
- [Core] Remove tokenizer group in vLLM (#24078) · 6c47f6bf
  Zhuohan Li authored Sep 17, 2025
```
Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
```
  6c47f6bf
12 Sep, 2025 2 commits

[UX] Remove AsyncLLM torch profiler disabled log (#24609) · 9d2a4460
Michael Goin authored Sep 12, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
9d2a4460

[V1] feat:add engine v1 tracing (#20372) · 40b6c912

RichardoMu authored Sep 12, 2025


Signed-off-by: Mu Huai <tianbowen.tbw@antgroup.com>
Signed-off-by: Ye Zhang <zhysishu@gmail.com>
Signed-off-by: RichardoMu <44485717+RichardoMrMu@users.noreply.github.com>
Signed-off-by: simon-mo <simon.mo@hey.com>
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: Mu Huai <tianbowen.tbw@antgroup.com>
Co-authored-by: Ye Zhang <zhysishu@gmail.com>
Co-authored-by: Benjamin Bartels <benjamin@bartels.dev>
Co-authored-by: simon-mo <simon.mo@hey.com>
Co-authored-by: 瑜琮 <ly186375@antfin.com>
Co-authored-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>

40b6c912

08 Sep, 2025 1 commit
- [Bugfix] Disable the statslogger if the api_server_count is greater than 1 (#22227) · e680723e
  Chauncey authored Sep 09, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  e680723e
04 Sep, 2025 1 commit

[Misc] Have AsyncLLM `custom_stat_loggers` extend default logger list (#20952) · 60b755cb

Seiji Eicher authored Sep 04, 2025


Signed-off-by: Seiji Eicher <seiji@anyscale.com>
Signed-off-by: Seiji Eicher <58963096+eicherseiji@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

60b755cb

29 Aug, 2025 1 commit
- Fix(async): Add support for truncate_prompt_tokens in AsyncLLM (#23800) · 05d839c1
  Raghavan authored Aug 29, 2025
  
  05d839c1
28 Aug, 2025 1 commit
- [V1] Enable prefill optimization for Gemma3n (#22628) · cb293f6a
  Yong Hoon Shin authored Aug 28, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  cb293f6a
27 Aug, 2025 1 commit
- [Core] Use key-only cache for `BaseMultiModalProcessor` (#23018) · 69244e67
  Cyrus Leung authored Aug 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  69244e67
20 Aug, 2025 1 commit
- [Core] Add torch profiler CPU traces for AsyncLLM. (#21794) · e58c5a97
  Chenheli Hua authored Aug 19, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
  e58c5a97
16 Aug, 2025 1 commit
- [Misc] Support passing multiple request ids at once to `AsyncLLM.abort()` (#22944) · ad0297d1
  Nick Hill authored Aug 15, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  ad0297d1
14 Aug, 2025 1 commit

[Bugfix] Add reset prefix cache for online serving (#22726) · 7655dc3e

iAmir97 authored Aug 14, 2025

Signed-off-by: iAmir97 <Amir.balwel@embeddedllm.com>
Signed-off-by: iAmir97 <71513472+iAmir97@users.noreply.github.com>
Co-authored-by: iAmir97 <Amir.balwel@embeddedllm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

7655dc3e

08 Aug, 2025 2 commits
- [BugFix] Don't cancel asyncio tasks directly from destructors (#22476) · ccdae737
  Nick Hill authored Aug 08, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  ccdae737
- [CI/Build] Fix multimodal tests (#22491) · 1712543d
  Cyrus Leung authored Aug 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1712543d
02 Aug, 2025 1 commit
- [BugFix] Improve internal DP load balancing (#21617) · 8d524ce7
  Nick Hill authored Aug 02, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  8d524ce7
01 Aug, 2025 1 commit
- Deprecate `--disable-log-requests` and replace with `--enable-log-requests` (#21739) · 2d7b09b9
  Harry Mellor authored Aug 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2d7b09b9
25 Jul, 2025 1 commit
- [V1] Get supported tasks from model runner instead of model config (#21585) · 46d81d69
  Cyrus Leung authored Jul 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  46d81d69
24 Jul, 2025 1 commit

[DP] Internal Load Balancing Per Node [`one-pod-per-node`] (#21238) · d5b981f8

Robert Shaw authored Jul 23, 2025


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

d5b981f8