Commits · 38d8096760cd8f42fb65fc0ba2b9fb11f98d8ac3 · OpenDAS / vllm_cscc

12 Sep, 2025 1 commit

[V1] feat:add engine v1 tracing (#20372) · 40b6c912

RichardoMu authored Sep 12, 2025


Signed-off-by: Mu Huai <tianbowen.tbw@antgroup.com>
Signed-off-by: Ye Zhang <zhysishu@gmail.com>
Signed-off-by: RichardoMu <44485717+RichardoMrMu@users.noreply.github.com>
Signed-off-by: simon-mo <simon.mo@hey.com>
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: Mu Huai <tianbowen.tbw@antgroup.com>
Co-authored-by: Ye Zhang <zhysishu@gmail.com>
Co-authored-by: Benjamin Bartels <benjamin@bartels.dev>
Co-authored-by: simon-mo <simon.mo@hey.com>
Co-authored-by: 瑜琮 <ly186375@antfin.com>
Co-authored-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>

40b6c912

10 Sep, 2025 3 commits
- [v1] Add Whisper model support (encoder-decoder) (#21088) · 37e8182b
  Russell Bryant authored Sep 10, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
```
  37e8182b
- [Core] Simplify and unify mm uuid handling & auto-generated mm hash overrides processing. (#24271) · 009d689b
  Chenheli Hua authored Sep 09, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
  009d689b
- [BugFix] Fix async core engine client finalizer (#24540) · f88e8401
  Nick Hill authored Sep 09, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  f88e8401
09 Sep, 2025 2 commits

[Bugfix] Handle the edge case in detokenizer where processed tokens contain... · 922d3b40

d.transposed authored Sep 09, 2025


[Bugfix] Handle the edge case in detokenizer where processed tokens contain both `stop` str and `eos` token (#23938)
Signed-off-by: dtransposed <damian.bogunowicz@gmail.com>

922d3b40

[Misc] Improve Worker process title and logging prefix (#22205) · 0cdd2136
22quinn authored Sep 08, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
0cdd2136

08 Sep, 2025 2 commits

[Bugfix] Disable the statslogger if the api_server_count is greater than 1 (#22227) · e680723e
Chauncey authored Sep 09, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
e680723e

[Sampler] Support returning all prompt logprobs (#23868) · b3d7e3c8

Xingyu Liu authored Sep 07, 2025


Signed-off-by: Xingyu Liu <charlotteliu12x@gmail.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

b3d7e3c8

06 Sep, 2025 2 commits
- [Bugfix] Catch and log invalid token ids in detokenizer (#24351) · 6432739e
  Nick Hill authored Sep 05, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  6432739e
- [Doc]: fix typos in Python comments (#24294) · 35bf1938
  Didier Durand authored Sep 06, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  35bf1938
04 Sep, 2025 3 commits

[Misc] Have AsyncLLM `custom_stat_loggers` extend default logger list (#20952) · 60b755cb

Seiji Eicher authored Sep 04, 2025


Signed-off-by: Seiji Eicher <seiji@anyscale.com>
Signed-off-by: Seiji Eicher <58963096+eicherseiji@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

60b755cb

[Perf] Freeze core engine proc heap after init (#24008) · e41a0fa3
Nick Hill authored Sep 04, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
e41a0fa3

[Bugfix] Fix Incremental Detokenization with `tokenizers == 0.22.0` (#24159) · 2c301ee2

Fanli Lin authored Sep 04, 2025

Signed-off-by: Fanli Lin <fanli.lin@intel.com>
Signed-off-by: Fanli Lin <fanli0116@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

2c301ee2

03 Sep, 2025 1 commit
- [Bugfix][DP] DP distribution does not require ray[default] (#23822) · a43a3f17
  Kebe authored Sep 04, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  a43a3f17
01 Sep, 2025 1 commit
- [Chore][V0 Deprecation] Move LogProb to a separate file (#24055) · 56853702
  Woosuk Kwon authored Sep 01, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  56853702
31 Aug, 2025 2 commits
- vllm fix check on max vocab size (#22471) · 81eea3d3
  Xiaodong Wang authored Aug 31, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.me>
```
  81eea3d3
- [Core][Multimodal] Allow passing `multi_modal_uuids` as multimodal identifiers. (#23394) · 749be00a
  Roger Wang authored Aug 30, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  749be00a
29 Aug, 2025 3 commits
- [BugFix] Async scheduling and PP compatibility with DP (#23770) · d90d8eb6
  Nick Hill authored Aug 29, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  d90d8eb6
- [Multimodal] Consolidate mm inputs into MultiModalFeatureSpec (#23779) · 69f46359
  Flora Feng authored Aug 29, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  69f46359
- Fix(async): Add support for truncate_prompt_tokens in AsyncLLM (#23800) · 05d839c1
  Raghavan authored Aug 29, 2025
  
  05d839c1
28 Aug, 2025 1 commit
- [V1] Enable prefill optimization for Gemma3n (#22628) · cb293f6a
  Yong Hoon Shin authored Aug 28, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  cb293f6a
27 Aug, 2025 4 commits
- [Multimodal] Generate mm_hash based on request metadata when caching is turned off (#23690) · 8bf6266a
  Roger Wang authored Aug 27, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  8bf6266a
- [Misc] Remove unnecessary `_send_reconfig_message()` in `core_client.py` (#23127) · a403d0fa
  Nick Hill authored Aug 27, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  a403d0fa
- [XPU] Fix OOM issue for data parallel with Ray backend (#22500) · 8f0d7eae
  Fanli Lin authored Aug 27, 2025
```
Signed-off-by: Fanli Lin <fanli.lin@intel.com>
Signed-off-by: Fanli Lin <fanli0116@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  8f0d7eae
- [Core] Use key-only cache for `BaseMultiModalProcessor` (#23018) · 69244e67
  Cyrus Leung authored Aug 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  69244e67
25 Aug, 2025 1 commit

Frontend: Adding LM Format Enforcer support to V1 engine (#22564) · 39971db3

Noam Gat authored Aug 25, 2025


Signed-off-by: Noam Gat <noamgat@gmail.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>