Commits · 3c8740aacb2b288390c986c169993ed2d97363f8 · OpenDAS / vllm_cscc

19 Jan, 2026 1 commit

[Frontend] Add render endpoints for prompt preprocessing (#32473) · 3c8740aa

Hyunkyun Moon authored Jan 19, 2026

Signed-off-by: HyunKyun Moon <mhg5303@gmail.com>
Signed-off-by: Hyunkyun Moon <mhg5303@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

3c8740aa

15 Jan, 2026 1 commit
- [Refactor] [10/N] to simplify the vLLM openai completion serving architecture (#32369) · 4c1c501a
  Chauncey authored Jan 15, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  4c1c501a
13 Jan, 2026 1 commit
- [Refactor] [6/N] to simplify the vLLM openai chat_completion serving architecture (#32240) · fefce498
  Chauncey authored Jan 13, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  fefce498
07 Jan, 2026 1 commit
- [OpenAI] Extend VLLMValidationError to additional validation parameters (#31870) · 1ab055ef
  R3hankhan authored Jan 07, 2026
```
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
```
  1ab055ef
23 Dec, 2025 1 commit
- [OpenAI] Add parameter metadata to validation errors (#30134) · 769f27e7
  R3hankhan authored Dec 23, 2025
```
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
```
  769f27e7
18 Dec, 2025 1 commit
- [Bugfix] fix DP-aware routing in OpenAI API requests (#29002) · 500f26e6
  inkcherry authored Dec 19, 2025
```
Signed-off-by: inkcherry <mingzhi.liu@amd.com>
```
  500f26e6
10 Dec, 2025 1 commit

[P/D] KV Load Failure Recovery/Abort Configuration (#26813) · a9e4106f

Will Eaton authored Dec 10, 2025


Signed-off-by: Will Eaton <weaton@redhat.com>
Signed-off-by: Will Eaton <me@wseaton.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: chaunceyjiang <chaunceyjiang@gmail.com>

a9e4106f

07 Dec, 2025 2 commits
- Revert "[Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145)" (#30199) · e83b7e37
  Cyrus Leung authored Dec 07, 2025
  
  e83b7e37
- [Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145) · 27f4c2fd
  Cyrus Leung authored Dec 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  27f4c2fd
29 Nov, 2025 1 commit
- [Misc] Refactor tokenizer interface (#29693) · 34a98427
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  34a98427
21 Nov, 2025 1 commit
- [V0 Deprecation] Remove `best_of` (#29090) · 56e96b37
  Cyrus Leung authored Nov 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  56e96b37
20 Nov, 2025 1 commit
- [Bugfix] - Add Trace Headers to Beam Search Path (#29100) · 4d01b642
  Software Developer authored Nov 20, 2025
```
Signed-off-by: dsuhinin <suhinin.dmitriy@gmail.com>
```
  4d01b642
05 Nov, 2025 1 commit
- [Bugfix] Validate custom logits processor xargs for online serving (#27560) · 3f5a4b64
  Isotr0py authored Nov 06, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  3f5a4b64
30 Oct, 2025 1 commit
- [EP/DP][API Server] Enable DP-aware routing in OpenAI API requests (#24945) · a2981c42
  cong-meta authored Oct 30, 2025
```
Co-authored-by: Cong Chen <prowindy@gmail.com>
```
  a2981c42
27 Oct, 2025 1 commit

[Bugfix] Fixed when return_token_ids=False, the first event still contains... · a4fc2189

Chauncey authored Oct 27, 2025


[Bugfix] Fixed when return_token_ids=False, the first event still contains prompt_token_ids. (#27561)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>

a4fc2189

19 Oct, 2025 1 commit
- [Misc] Move utils to avoid conflicts with stdlib, and move tests (#27169) · d31f7844
  Cyrus Leung authored Oct 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d31f7844
16 Oct, 2025 2 commits
- [Chore] Separate out `vllm.utils.collections` (#26990) · d2740faf
  Cyrus Leung authored Oct 16, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d2740faf
- [Chore] Rename `utils` submodules (#26920) · f6cdc9a0
  Cyrus Leung authored Oct 16, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f6cdc9a0
15 Oct, 2025 1 commit
- [Chore] Separate out `vllm.utils.async_utils` (#26913) · 828523ad
  Cyrus Leung authored Oct 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  828523ad
14 Oct, 2025 1 commit

[Bugfix][FE]: Always include usage with `--enable-force-include-usage ` (#20983) · fd85c9f4

Max Wittig authored Oct 14, 2025

Signed-off-by: Max Wittig <max.wittig@siemens.com>
Signed-off-by: Antoine Auger <antoineauger@users.noreply.github.com>
Co-authored-by: Antoine Auger <antoineauger@users.noreply.github.com>

fd85c9f4

12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
09 Oct, 2025 1 commit
- [Bugfix] Fix SHM cache initialization (#26427) · 4bdf7ac5
  Cyrus Leung authored Oct 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4bdf7ac5
05 Oct, 2025 3 commits
- Remove all references to `yapf` as it's no longer used (#26251) · 4e256cad
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4e256cad
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
- [Bugfix] Allow `--skip-tokenizer-init` with `echo and return_token_ids` (#26238) · a964e5e6
  Cyrus Leung authored Oct 05, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a964e5e6
04 Oct, 2025 1 commit
- [Renderer] Clean up renderer code (#26216) · 119f0063
  Cyrus Leung authored Oct 05, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  119f0063
03 Oct, 2025 1 commit

[Renderer] Move Processor out of AsyncLLM (#24138) · 812b7f54

Yang Liu authored Oct 03, 2025


Signed-off-by: Yang <lymailforjob@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

812b7f54

18 Sep, 2025 1 commit
- Mark prompt logprobs as incompatible with prompt embeds at API level (#25077) · bec060fd
  Andrew Sansom authored Sep 17, 2025
```
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
```
  bec060fd
17 Sep, 2025 1 commit
- [Core] Remove tokenizer group in vLLM (#24078) · 6c47f6bf
  Zhuohan Li authored Sep 17, 2025
```
Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
```
  6c47f6bf
11 Sep, 2025 1 commit
- Fix model name included in responses (#24663) · c1eda615
  Harry Mellor authored Sep 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c1eda615
10 Sep, 2025 1 commit
- Consolidate rendering parameters into RenderConfig dataclass (#24543) · 77f62613
  Flora Feng authored Sep 10, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  77f62613
09 Sep, 2025 1 commit
- Extend renderer with embedding support and integrate completion endpoint (#24405) · 15cb047e
  Flora Feng authored Sep 09, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  15cb047e
01 Sep, 2025 1 commit
- [Chore][V0 Deprecation] Move LogProb to a separate file (#24055) · 56853702
  Woosuk Kwon authored Sep 01, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  56853702
30 Aug, 2025 1 commit

Fix wrong truncate_prompt_tokens type hint (#22761) · 5b8077b8

Gabriel Marinho authored Aug 30, 2025

Signed-off-by: Gabriel Marinho <gmarinho@ibm.com>
Signed-off-by: Gabriel Marinho <104592062+gmarinho2@users.noreply.github.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>

5b8077b8

29 Aug, 2025 1 commit

[RL][BugFix] Fix missing tokenizer error for token-in-token-out (#23904) · 4d7fe40f

22quinn authored Aug 29, 2025


Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

4d7fe40f

27 Aug, 2025 1 commit
- [Frontend] Add --log-error-stack to print stack trace for error response (#22960) · 32102644
  Chen Zhang authored Aug 26, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  32102644
19 Aug, 2025 1 commit

Add return_token_ids parameter to OpenAI API endpoints (#22587) · 24f4d1a2

Yuge Zhang authored Aug 20, 2025


Signed-off-by: Yuge Zhang <scottyugochang@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>

24f4d1a2

25 Jul, 2025 1 commit

[Frontend] Add request_id to the Request object so they can be controlled... · 9fe98d42

kourosh hakhamaneshi authored Jul 25, 2025


[Frontend] Add request_id to the Request object so they can be controlled better via external load balancers (#21009)
Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>

9fe98d42

23 Jul, 2025 1 commit
- [V0 Deprecation] Remove Prompt Adapters (#20588) · 82ec66f5
  Michael Goin authored Jul 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  82ec66f5
17 Jul, 2025 1 commit
- [Bugfix]: Fix final_res_batch list index out of range error (#21055) · fdc5b43d
  Chauncey authored Jul 17, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  fdc5b43d