Commits · a2981c42720a34b5abf59c4c14df701f8105d4cd · OpenDAS / vllm_cscc

30 Oct, 2025 1 commit
- [EP/DP][API Server] Enable DP-aware routing in OpenAI API requests (#24945) · a2981c42
  cong-meta authored Oct 30, 2025
```
Co-authored-by: Cong Chen <prowindy@gmail.com>
```
  a2981c42
27 Oct, 2025 1 commit

[Bugfix] Fixed when return_token_ids=False, the first event still contains... · a4fc2189

Chauncey authored Oct 27, 2025


[Bugfix] Fixed when return_token_ids=False, the first event still contains prompt_token_ids. (#27561)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>

a4fc2189

19 Oct, 2025 1 commit
- [Misc] Move utils to avoid conflicts with stdlib, and move tests (#27169) · d31f7844
  Cyrus Leung authored Oct 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d31f7844
16 Oct, 2025 2 commits
- [Chore] Separate out `vllm.utils.collections` (#26990) · d2740faf
  Cyrus Leung authored Oct 16, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d2740faf
- [Chore] Rename `utils` submodules (#26920) · f6cdc9a0
  Cyrus Leung authored Oct 16, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f6cdc9a0
15 Oct, 2025 1 commit
- [Chore] Separate out `vllm.utils.async_utils` (#26913) · 828523ad
  Cyrus Leung authored Oct 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  828523ad
14 Oct, 2025 1 commit

[Bugfix][FE]: Always include usage with `--enable-force-include-usage ` (#20983) · fd85c9f4

Max Wittig authored Oct 14, 2025

Signed-off-by: Max Wittig <max.wittig@siemens.com>
Signed-off-by: Antoine Auger <antoineauger@users.noreply.github.com>
Co-authored-by: Antoine Auger <antoineauger@users.noreply.github.com>

fd85c9f4

12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
09 Oct, 2025 1 commit
- [Bugfix] Fix SHM cache initialization (#26427) · 4bdf7ac5
  Cyrus Leung authored Oct 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4bdf7ac5
05 Oct, 2025 3 commits
- Remove all references to `yapf` as it's no longer used (#26251) · 4e256cad
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4e256cad
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
- [Bugfix] Allow `--skip-tokenizer-init` with `echo and return_token_ids` (#26238) · a964e5e6
  Cyrus Leung authored Oct 05, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a964e5e6
04 Oct, 2025 1 commit
- [Renderer] Clean up renderer code (#26216) · 119f0063
  Cyrus Leung authored Oct 05, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  119f0063
03 Oct, 2025 1 commit

[Renderer] Move Processor out of AsyncLLM (#24138) · 812b7f54

Yang Liu authored Oct 03, 2025


Signed-off-by: Yang <lymailforjob@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

812b7f54

18 Sep, 2025 1 commit
- Mark prompt logprobs as incompatible with prompt embeds at API level (#25077) · bec060fd
  Andrew Sansom authored Sep 17, 2025
```
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
```
  bec060fd
17 Sep, 2025 1 commit
- [Core] Remove tokenizer group in vLLM (#24078) · 6c47f6bf
  Zhuohan Li authored Sep 17, 2025
```
Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
```
  6c47f6bf
11 Sep, 2025 1 commit
- Fix model name included in responses (#24663) · c1eda615
  Harry Mellor authored Sep 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c1eda615
10 Sep, 2025 1 commit
- Consolidate rendering parameters into RenderConfig dataclass (#24543) · 77f62613
  Flora Feng authored Sep 10, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  77f62613
09 Sep, 2025 1 commit
- Extend renderer with embedding support and integrate completion endpoint (#24405) · 15cb047e
  Flora Feng authored Sep 09, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  15cb047e
01 Sep, 2025 1 commit
- [Chore][V0 Deprecation] Move LogProb to a separate file (#24055) · 56853702
  Woosuk Kwon authored Sep 01, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  56853702
30 Aug, 2025 1 commit

Fix wrong truncate_prompt_tokens type hint (#22761) · 5b8077b8

Gabriel Marinho authored Aug 30, 2025

Signed-off-by: Gabriel Marinho <gmarinho@ibm.com>
Signed-off-by: Gabriel Marinho <104592062+gmarinho2@users.noreply.github.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>

5b8077b8

29 Aug, 2025 1 commit

[RL][BugFix] Fix missing tokenizer error for token-in-token-out (#23904) · 4d7fe40f

22quinn authored Aug 29, 2025


Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

4d7fe40f

27 Aug, 2025 1 commit
- [Frontend] Add --log-error-stack to print stack trace for error response (#22960) · 32102644
  Chen Zhang authored Aug 26, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  32102644
19 Aug, 2025 1 commit

Add return_token_ids parameter to OpenAI API endpoints (#22587) · 24f4d1a2

Yuge Zhang authored Aug 20, 2025


Signed-off-by: Yuge Zhang <scottyugochang@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>

24f4d1a2

25 Jul, 2025 1 commit

[Frontend] Add request_id to the Request object so they can be controlled... · 9fe98d42

kourosh hakhamaneshi authored Jul 25, 2025


[Frontend] Add request_id to the Request object so they can be controlled better via external load balancers (#21009)
Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>

9fe98d42

23 Jul, 2025 1 commit
- [V0 Deprecation] Remove Prompt Adapters (#20588) · 82ec66f5
  Michael Goin authored Jul 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  82ec66f5
17 Jul, 2025 1 commit
- [Bugfix]: Fix final_res_batch list index out of range error (#21055) · fdc5b43d
  Chauncey authored Jul 17, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  fdc5b43d
15 Jul, 2025 1 commit
- [Frontend] Support cache_salt in /v1/completions and /v1/responses (#20981) · 19c86306
  Marko Rosenmueller authored Jul 15, 2025
```
Signed-off-by: Marko Rosenmueller <5467316+dr75@users.noreply.github.com>
```
  19c86306
04 Jul, 2025 1 commit
- [Platform] Add custom default max tokens (#18557) · a4113b03
  Gabriel Marinho authored Jul 03, 2025
```
Signed-off-by: Gabriel Marinho <gmarinho@ibm.com>
```
  a4113b03
01 Jul, 2025 1 commit
- [Bugfix] Fix include prompt in stream response when echo=true (#15233) · e28533a1
  fyuan1316 authored Jul 01, 2025
```
Signed-off-by: Yuan Fang <yuanfang@alauda.io>
```
  e28533a1
25 Jun, 2025 1 commit
- [Feat][CLI] enforce-include-usage (#19695) · f59fc60f
  Max Wittig authored Jun 25, 2025
```
Signed-off-by: Max Wittig <max.wittig@siemens.com>
```
  f59fc60f
03 Jun, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
28 May, 2025 1 commit
- [Core] Add Lora Support to Beam Search (#18346) · 321331b8
  Alex Brooks authored May 28, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  321331b8
19 May, 2025 1 commit

Feature/vllm/input embedding completion api (#17590) · 221cfc2f

Nan Qin authored May 18, 2025


Signed-off-by: Andrew Sansom <andrew@protopia.ai>
Signed-off-by: Nan2018 <nan@protopia.ai>
Co-authored-by: 临景 <linjing.yx@alibaba-inc.com>
Co-authored-by: Bryce1010 <bryceyx@gmail.com>
Co-authored-by: Andrew Sansom <andrew@protopia.ai>
Co-authored-by: Andrew Sansom <qthequartermasterman@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

221cfc2f

12 May, 2025 1 commit

[P/D] NIXL Integration (#17751) · d1911020

Robert Shaw authored May 12, 2025


Signed-off-by: ApostaC <yihua98@uchicago.edu>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
Signed-off-by: Robert Shaw <rshaw@neuralmagic.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Brent Salisbury <bsalisbu@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: ApostaC <yihua98@uchicago.edu>
Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Brent Salisbury <bsalisbu@redhat.com>