Commits · 6abb0454adb531de0b081bbf65ccf907e4bd560d · OpenDAS / vllm_cscc

05 Feb, 2026 1 commit
- [Perf] Optimize the performance of structured output + reasoning (#33557) · 6abb0454
  Chauncey authored Feb 05, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  6abb0454
04 Feb, 2026 2 commits
- [Perf] Optimize chat completion streaming performance (#33782) · f67ee8b8
  Chauncey authored Feb 04, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  f67ee8b8
- [1/N] Initial Implementation of Parser for ResponsesAPI (#32712) · e1bf04b6
  Andrew Xia authored Feb 03, 2026
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  e1bf04b6
02 Feb, 2026 1 commit
- [Chore] Remove redundant input parsing methods (#33542) · a502831d
  Cyrus Leung authored Feb 02, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a502831d
31 Jan, 2026 1 commit
- [Frontend] Use new Renderer for Completions and Tokenize API (#32863) · f0a1c845
  Cyrus Leung authored Jan 31, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f0a1c845
30 Jan, 2026 1 commit
- Remove deprecated `reasoning_content` message field (#33402) · c5113f60
  Harry Mellor authored Jan 30, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c5113f60
29 Jan, 2026 1 commit
- Fix tool call indexing double-counting (#33141) · 39037d25
  wangln19 authored Jan 29, 2026
```
Signed-off-by: wanglinian <wanglinian@stu.pku.edu.cn>
```
  39037d25
27 Jan, 2026 2 commits

[Frontend] Cleanup serving engine (#33103) · e0b005d9
Cyrus Leung authored Jan 27, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
e0b005d9

fix: preserve native tool call ID in multi-turn tool calling (#32768) · 2d705343

wangln19 authored Jan 27, 2026


Signed-off-by: wanglinian <wanglinian@stu.pku.edu.cn>
Signed-off-by: wangln19 <96399074+wangln19@users.noreply.github.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Isotr0py <2037008807@qq.com>

2d705343

24 Jan, 2026 1 commit
- [UX] Deduplicate sampling parameter startup logs (#32953) · 51931c5c
  Cyrus Leung authored Jan 24, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  51931c5c
22 Jan, 2026 1 commit
- [Frontend] Introduce Renderer for processing chat messages (using `ModelConfig`) (#30200) · d117a4d1
  Cyrus Leung authored Jan 22, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d117a4d1
19 Jan, 2026 1 commit

[Frontend] Add render endpoints for prompt preprocessing (#32473) · 3c8740aa

Hyunkyun Moon authored Jan 19, 2026

Signed-off-by: HyunKyun Moon <mhg5303@gmail.com>
Signed-off-by: Hyunkyun Moon <mhg5303@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

3c8740aa

15 Jan, 2026 1 commit
- [Refactor] [10/N] to simplify the vLLM openai completion serving architecture (#32369) · 4c1c501a
  Chauncey authored Jan 15, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  4c1c501a
14 Jan, 2026 1 commit

[MODEL] Fix handling of multiple channels for gpt-oss with speculative decoding (#26291) · d084e9fc

Aleksandr Samarin authored Jan 14, 2026


Signed-off-by: Aleksandr Samarin <astrlrd@nebius.com>
Signed-off-by: southfreebird <yvorott@gmail.com>
Co-authored-by: southfreebird <yvorott@gmail.com>

d084e9fc

13 Jan, 2026 2 commits
- [Refactor] [6/N] to simplify the vLLM openai chat_completion serving architecture (#32240) · fefce498
  Chauncey authored Jan 13, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  fefce498
- [Frontend] Add `reasoning_effort` to `OpenAIServing._preprocess_chat()` (#31956) · 60b77e14
  Sanghoon Yoon authored Jan 13, 2026
```
Signed-off-by: Sanghoon Yoon <seanyoon@kakao.com>
```
  60b77e14
09 Jan, 2026 1 commit
- Rename --exclude-log-deltas to --enable-log-deltas (#32020) · ac9f9330
  Kevin Šuc authored Jan 09, 2026
```
Signed-off-by: Catacomba <kevinsuc16@gmail.com>
```
  ac9f9330
08 Jan, 2026 1 commit
- [OpenAI] Fix tool_choice=required streaming when output has trailing extra data (#31610) · 7645bc52
  Mary authored Jan 08, 2026
```
Signed-off-by: maylikenoother <ogedengbemary19@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  7645bc52
05 Jan, 2026 2 commits

[Frontend] [Doc] Exclude log deltas feature (#30322) · 79ed460d

Kevin Šuc authored Jan 05, 2026


Signed-off-by: Catacomba <kevinsuc16@gmail.com>
Signed-off-by: Kevin Šuc <kevinsuc16@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

79ed460d

[Frontend] [Bugfix] respect server-level default chat template kwargs in reasoning parser (#31581) · e2701cc5
cjackal authored Jan 05, 2026
```
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
e2701cc5

30 Dec, 2025 1 commit
- feat(frontend): add --default-chat-template-kwargs CLI argument (#31343) · dc837bc2
  Hojin Yang authored Dec 30, 2025
```
Signed-off-by: effortprogrammer <yhjhoward7@gmail.com>
```
  dc837bc2
29 Dec, 2025 1 commit
- [Bugfix] Preserve tool call id/type/name in streaming finish chunk (#31438) · 9c884faa
  amittell authored Dec 29, 2025
```
Signed-off-by: amittell <mittell@me.com>
Signed-off-by: Alex Mittell <mittell@me.com>
```
  9c884faa
23 Dec, 2025 1 commit
- [OpenAI] Add parameter metadata to validation errors (#30134) · 769f27e7
  R3hankhan authored Dec 23, 2025
```
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
```
  769f27e7
22 Dec, 2025 1 commit
- [gpt-oss] Fix harmony parser in streaming responses (#30205) · bd6d5a74
  AlonKejzman authored Dec 22, 2025
```
Signed-off-by: AlonKejzman <alonkeizman@gmail.com>
```
  bd6d5a74
21 Dec, 2025 1 commit

[BugFix]fix gpt-oss v1/completions response bug (#30608) · 3e92b2b7

汪志鹏 authored Dec 21, 2025


Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: bbrowning <bbrownin@redhat.com>

3e92b2b7

19 Dec, 2025 3 commits

[Frontend][Bug] allow tool calls in analysis channel (#28139) · 45594967

Marko Rosenmueller authored Dec 19, 2025


Signed-off-by: Marko Rosenmueller <5467316+dr75@users.noreply.github.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>

45594967

[Bugfix] Add validation for tool requests when tool_parser is unavailable (#30613) · 086b9633
lif authored Dec 19, 2025
```
Signed-off-by: majiayu000 <1835304752@qq.com>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
```
086b9633

[Bugfix] Fix tool_choice="none" being ignored by GPT-OSS/harmony models (#30867) · 6a09612b

PlatinumGod authored Dec 19, 2025


Signed-off-by: yujiepu <pyjapple@gmail.com>
Signed-off-by: PlatinumGod <pyjapple@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>

6a09612b

18 Dec, 2025 2 commits
- [Bugfix] fix DP-aware routing in OpenAI API requests (#29002) · 500f26e6
  inkcherry authored Dec 19, 2025
```
Signed-off-by: inkcherry <mingzhi.liu@amd.com>
```
  500f26e6
- feat(api): Eager chat template warmup to eliminate first-request latency (#30700) · 05a83dc6
  Nathan Price authored Dec 17, 2025
```
Signed-off-by: Nathan Price <nathan@abridge.com>
```
  05a83dc6
15 Dec, 2025 2 commits
- [Bugfix] Fix missing first token in tool calls during reasoning-to-tool transition (#30671) · 17fec3af
  mondaylord authored Dec 16, 2025
```
Signed-off-by: mondaylord <20212010046@fudan.edu.cn>
```
  17fec3af
- [Refactor] [2/N] Move tool parsers into the vLLM main directory (#30675) · 2a1776b7
  Chauncey authored Dec 15, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  2a1776b7
14 Dec, 2025 1 commit
- [Chore] Remove redundant `RequestPrompt` (#30612) · dcb31196
  Cyrus Leung authored Dec 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  dcb31196
12 Dec, 2025 1 commit
- [Bugfix] Multiple fixes for gpt-oss Chat Completion prompting (#28729) · 8f8fda26
  Ben Browning authored Dec 11, 2025
```
Signed-off-by: Ben Browning <bbrownin@redhat.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  8f8fda26
10 Dec, 2025 1 commit

[P/D] KV Load Failure Recovery/Abort Configuration (#26813) · a9e4106f

Will Eaton authored Dec 10, 2025


Signed-off-by: Will Eaton <weaton@redhat.com>
Signed-off-by: Will Eaton <me@wseaton.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: chaunceyjiang <chaunceyjiang@gmail.com>

a9e4106f

06 Dec, 2025 1 commit
- [ez] move harmony utils to parser folder (#30117) · 421125d0
  Andrew Xia authored Dec 06, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  421125d0
04 Dec, 2025 1 commit

[Bugfix] Missing tokens in `return_token_ids` when tool parsers is enabled in... · 48a5fff6

Peng-YM authored Dec 05, 2025


[Bugfix] Missing tokens in `return_token_ids` when tool parsers is enabled in streaming mode (#29074)
Signed-off-by: Peng-YM <1048217874pengym@gmail.com>

48a5fff6

29 Nov, 2025 1 commit
- [Misc] Refactor tokenizer interface (#29693) · 34a98427
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  34a98427
25 Nov, 2025 2 commits
- [Frontend] Respect Chat Completion parallel_tool_calls param (#26233) · e1dd706c
  Ben Browning authored Nov 25, 2025
```
Signed-off-by: Ben Browning <bbrownin@redhat.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  e1dd706c
- [BugFix] Fix duplicate id tool-call race condition (#29355) · a178a0b4
  Nick Hill authored Nov 24, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  a178a0b4