Commits · a2981c42720a34b5abf59c4c14df701f8105d4cd · OpenDAS / vllm_cscc

30 Oct, 2025 1 commit
- [EP/DP][API Server] Enable DP-aware routing in OpenAI API requests (#24945) · a2981c42
  cong-meta authored Oct 30, 2025
```
Co-authored-by: Cong Chen <prowindy@gmail.com>
```
  a2981c42
19 Oct, 2025 1 commit
- [Misc] Move utils to avoid conflicts with stdlib, and move tests (#27169) · d31f7844
  Cyrus Leung authored Oct 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d31f7844
16 Oct, 2025 2 commits
- [Chore] Separate out `vllm.utils.collections` (#26990) · d2740faf
  Cyrus Leung authored Oct 16, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d2740faf
- [Chore] Rename `utils` submodules (#26920) · f6cdc9a0
  Cyrus Leung authored Oct 16, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f6cdc9a0
15 Oct, 2025 2 commits
- [Chore] Separate out `vllm.utils.async_utils` (#26913) · 828523ad
  Cyrus Leung authored Oct 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  828523ad
- [Chore] Separate out `vllm.utils.func` (#26904) · 136a17fe
  Cyrus Leung authored Oct 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  136a17fe
14 Oct, 2025 1 commit

[Bugfix][FE]: Always include usage with `--enable-force-include-usage ` (#20983) · fd85c9f4

Max Wittig authored Oct 14, 2025

Signed-off-by: Max Wittig <max.wittig@siemens.com>
Signed-off-by: Antoine Auger <antoineauger@users.noreply.github.com>
Co-authored-by: Antoine Auger <antoineauger@users.noreply.github.com>

fd85c9f4

12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
11 Oct, 2025 1 commit
- [Refactor]Reduce duplicate code in serving_chat (#26627) · d0bed837
  Chauncey authored Oct 11, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  d0bed837
10 Oct, 2025 1 commit
- [Metrics] Log multi-modal cache stats and fix reset (#26285) · ad430a67
  Cyrus Leung authored Oct 10, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ad430a67
09 Oct, 2025 1 commit
- [Bugfix] Fix SHM cache initialization (#26427) · 4bdf7ac5
  Cyrus Leung authored Oct 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4bdf7ac5
06 Oct, 2025 1 commit
- [Frontend] Consolidate tokenizer init code (#26276) · 391612e7
  Cyrus Leung authored Oct 06, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  391612e7
05 Oct, 2025 2 commits
- Remove all references to `yapf` as it's no longer used (#26251) · 4e256cad
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4e256cad
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
04 Oct, 2025 2 commits
- [Frontend] Cache chat template kwargs resolution (#26227) · a42d2df7
  Isotr0py authored Oct 04, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  a42d2df7
- [BugFix] Use async Mistral Tokenizer in Chat Completions (#26134) · ea25a76c
  Ben Browning authored Oct 03, 2025
```
Signed-off-by: Ben Browning <bbrownin@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  ea25a76c
03 Oct, 2025 2 commits

[Renderer] Move Processor out of LLMEngine (#26165) · d78fda7c
Cyrus Leung authored Oct 03, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
d78fda7c

[Renderer] Move Processor out of AsyncLLM (#24138) · 812b7f54

Yang Liu authored Oct 03, 2025


Signed-off-by: Yang <lymailforjob@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

812b7f54

18 Sep, 2025 1 commit
- [Docs] Fix warnings in mkdocs build (continued) (#25163) · b419937c
  Hyogeun Oh (오효근) authored Sep 19, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
```
  b419937c
11 Sep, 2025 1 commit
- Fix model name included in responses (#24663) · c1eda615
  Harry Mellor authored Sep 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c1eda615
10 Sep, 2025 1 commit
- Consolidate rendering parameters into RenderConfig dataclass (#24543) · 77f62613
  Flora Feng authored Sep 10, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  77f62613
09 Sep, 2025 1 commit
- Extend renderer with embedding support and integrate completion endpoint (#24405) · 15cb047e
  Flora Feng authored Sep 09, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  15cb047e
08 Sep, 2025 1 commit

[Frontend] User-provided uuids for medias in chat. (RFC #22044) (#23449) · 01dfb5e9

Chenheli Hua authored Sep 08, 2025


Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: Roger Wang <hey@rogerw.me>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

01dfb5e9

07 Sep, 2025 1 commit
- Add renderer-based prompt processing for embedding and classification endpoints (#24356) · 0661cb9d
  Flora Feng authored Sep 07, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  0661cb9d
04 Sep, 2025 1 commit
- [Refactor] Introduce basic Renderer for completion-style request (#24010) · 712b273f
  Flora Feng authored Sep 03, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  712b273f
02 Sep, 2025 1 commit
- Run ruff format on a few files. (#24075) · f399182e
  Chenheli Hua authored Sep 02, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
  f399182e
01 Sep, 2025 2 commits

[Chore][V0 Deprecation] Move LogProb to a separate file (#24055) · 56853702
Woosuk Kwon authored Sep 01, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
56853702

[Misc] IO Processor plugins for pooling models (#22820) · 1cb39dbc

Christian Pinto authored Sep 01, 2025


Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>

1cb39dbc

31 Aug, 2025 1 commit
- [Core][Multimodal] Allow passing `multi_modal_uuids` as multimodal identifiers. (#23394) · 749be00a
  Roger Wang authored Aug 30, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  749be00a
30 Aug, 2025 1 commit

Fix wrong truncate_prompt_tokens type hint (#22761) · 5b8077b8

Gabriel Marinho authored Aug 30, 2025

Signed-off-by: Gabriel Marinho <gmarinho@ibm.com>
Signed-off-by: Gabriel Marinho <104592062+gmarinho2@users.noreply.github.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>

5b8077b8

29 Aug, 2025 1 commit

[RL][BugFix] Fix missing tokenizer error for token-in-token-out (#23904) · 4d7fe40f

22quinn authored Aug 29, 2025


Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

4d7fe40f

27 Aug, 2025 1 commit
- [Frontend] Add --log-error-stack to print stack trace for error response (#22960) · 32102644
  Chen Zhang authored Aug 26, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  32102644
16 Aug, 2025 1 commit

[BugFix] Add support for loading prompt embeds tensors serialized on... · 78863f8c

Andrew Sansom authored Aug 16, 2025


[BugFix] Add support for loading prompt embeds tensors serialized on unavailable devices and sparse tensors (#22962)
Signed-off-by: Andrew Sansom <andrew@protopia.ai>

78863f8c

13 Aug, 2025 1 commit

[Misc] clear and separate error messages for input too long and input +... · da270519

Roger Wang authored Aug 13, 2025


[Misc] clear and separate error messages for input too long and input + max-tokens too long (#22803)
Signed-off-by: Roger Wang <hey@rogerw.me>

da270519

08 Aug, 2025 1 commit
- [PERF] Use pybase64 to more quickly decode prompt embeddings (#22469) · e2c8f1ed
  Andrew Sansom authored Aug 07, 2025
```
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
```
  e2c8f1ed
07 Aug, 2025 1 commit
- [Frontend] Update OpenAI error response to upstream format (#22099) · 37066185
  Moritz Sanft authored Aug 07, 2025
```
Signed-off-by: Moritz Sanft <58110325+msanft@users.noreply.github.com>
```
  37066185
06 Aug, 2025 1 commit

[gpt-oss] Add loop for built-in tool call (#22374) · ec7cb192

Woosuk Kwon authored Aug 06, 2025


Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>
Co-authored-by: simon-mo <xmo@berkeley.edu>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Hongxia Yang <62075498+hongxiayang@users.noreply.github.com>
Co-authored-by: Minseok Lee <47620120+minseokl@users.noreply.github.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>

ec7cb192

26 Jul, 2025 1 commit

[Bugfix] Fix isinstance check for tensor types in _load_prompt_embeds to use... · 2f6e6b33

Alexandre JUAN authored Jul 26, 2025


[Bugfix] Fix isinstance check for tensor types in _load_prompt_embeds to use dtype comparison (#21612)
Signed-off-by: Alexandre Juan <a.juan@netheos.net>

2f6e6b33

25 Jul, 2025 1 commit

Add support for Prithvi in Online serving mode (#21518) · e189b50f

mgazz authored Jul 25, 2025


Signed-off-by: Michele Gazzetti <michele.gazzetti1@ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

e189b50f

23 Jul, 2025 1 commit
- [V0 Deprecation] Remove Prompt Adapters (#20588) · 82ec66f5
  Michael Goin authored Jul 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  82ec66f5