Commits · 3b312fb792d200ba4b1c3b4bf5ad06a46cd2fa1e · OpenDAS / vllm_cscc

30 Dec, 2025 2 commits
- [Minor] Various small code cleanups/simplifications (#31508) · 3b312fb7
  Nick Hill authored Dec 29, 2025
```
Signed-off-by: njhill <nickhill123@gmail.com>
```
  3b312fb7
- feat(frontend): add --default-chat-template-kwargs CLI argument (#31343) · dc837bc2
  Hojin Yang authored Dec 30, 2025
```
Signed-off-by: effortprogrammer <yhjhoward7@gmail.com>
```
  dc837bc2
29 Dec, 2025 2 commits

[Feature] Add offline FastAPI documentation support for air-gapped environments (#30184) · b3a2bdf1

RickyChen / 陳昭儒 authored Dec 30, 2025

Signed-off-by: rickychen-infinirc <ricky.chen@infinirc.com>
Signed-off-by: RickyChen / 陳昭儒 <ricky.chen@infinirc.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

b3a2bdf1

[Bugfix] Preserve tool call id/type/name in streaming finish chunk (#31438) · 9c884faa
amittell authored Dec 29, 2025
```
Signed-off-by: amittell <mittell@me.com>
Signed-off-by: Alex Mittell <mittell@me.com>
```
9c884faa

24 Dec, 2025 2 commits
- [Perf] Add skip_clone to SamplingParams for internal request handling (#31041) · bc5ef333
  Michael Goin authored Dec 24, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  bc5ef333
- [Chore][1/2] Drop `v0.14` deprecations (#31285) · 09dc7c69
  Cyrus Leung authored Dec 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  09dc7c69
23 Dec, 2025 2 commits

[OpenAI] Add parameter metadata to validation errors (#30134) · 769f27e7
R3hankhan authored Dec 23, 2025
```
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
```
769f27e7

[Frontend] Support using chat template as custom score template for reranking models (#30550) · 23daef54

Jakub Zakrzewski authored Dec 23, 2025


Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

23daef54

22 Dec, 2025 1 commit
- [gpt-oss] Fix harmony parser in streaming responses (#30205) · bd6d5a74
  AlonKejzman authored Dec 22, 2025
```
Signed-off-by: AlonKejzman <alonkeizman@gmail.com>
```
  bd6d5a74
21 Dec, 2025 1 commit

[BugFix]fix gpt-oss v1/completions response bug (#30608) · 3e92b2b7

汪志鹏 authored Dec 21, 2025


Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: bbrowning <bbrownin@redhat.com>

3e92b2b7

19 Dec, 2025 3 commits

[Frontend][Bug] allow tool calls in analysis channel (#28139) · 45594967

Marko Rosenmueller authored Dec 19, 2025


Signed-off-by: Marko Rosenmueller <5467316+dr75@users.noreply.github.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>

45594967

[Bugfix] Add validation for tool requests when tool_parser is unavailable (#30613) · 086b9633
lif authored Dec 19, 2025
```
Signed-off-by: majiayu000 <1835304752@qq.com>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
```
086b9633

[Bugfix] Fix tool_choice="none" being ignored by GPT-OSS/harmony models (#30867) · 6a09612b

PlatinumGod authored Dec 19, 2025


Signed-off-by: yujiepu <pyjapple@gmail.com>
Signed-off-by: PlatinumGod <pyjapple@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>

6a09612b

18 Dec, 2025 3 commits
- [Bugfix] fix DP-aware routing in OpenAI API requests (#29002) · 500f26e6
  inkcherry authored Dec 19, 2025
```
Signed-off-by: inkcherry <mingzhi.liu@amd.com>
```
  500f26e6
- fix: add warmup for audio preprocessing (#30706) · fc2ae6d6
  Nathan Price authored Dec 18, 2025
```
Signed-off-by: Nathan Price <nathan@abridge.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  fc2ae6d6
- feat(api): Eager chat template warmup to eliminate first-request latency (#30700) · 05a83dc6
  Nathan Price authored Dec 17, 2025
```
Signed-off-by: Nathan Price <nathan@abridge.com>
```
  05a83dc6
17 Dec, 2025 2 commits
- [Refactor] [4/N] Move VLLM_SERVER_DEV endpoints into the serve directory (#30749) · 9ad5b217
  Chauncey authored Dec 17, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  9ad5b217
- [Doc][ResponsesAPI] add documentation (#30840) · 4c054d89
  Andrew Xia authored Dec 17, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  4c054d89
16 Dec, 2025 3 commits
- [Frontend] Add `max-completion-token` option to transcription/translation endpoints (#30769) · ca702a14
  Nicolò Lucchesi authored Dec 16, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  ca702a14
- [responsesAPI][8] input/output messages for ResponsesParser (#30158) · 0d0c929f
  Andrew Xia authored Dec 16, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Signed-off-by: Andrew Xia <axia@meta.com>
Co-authored-by: Andrew Xia <axia@fb.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  0d0c929f
- [Bugfix] fix streaming final output for non harmony (#30237) · bbd850e5
  penfree authored Dec 16, 2025
```
Signed-off-by: penfree <qiupengfei@baidu.com>
Co-authored-by: penfree <qiupengfei@baidu.com>
```
  bbd850e5
15 Dec, 2025 3 commits
- [Bugfix] Fix missing first token in tool calls during reasoning-to-tool transition (#30671) · 17fec3af
  mondaylord authored Dec 16, 2025
```
Signed-off-by: mondaylord <20212010046@fudan.edu.cn>
```
  17fec3af
- [Refactor] [2/N] Move tool parsers into the vLLM main directory (#30675) · 2a1776b7
  Chauncey authored Dec 15, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  2a1776b7
- [Bugfix] Fix deepseek_v32 tokenizer_mode (#30658) · a524d1ba
  Jee Jee Li authored Dec 15, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  a524d1ba
14 Dec, 2025 3 commits

[responsesAPI]add extra body parameters (#30532) · 9ccbf6b6
RioS authored Dec 15, 2025
```
Signed-off-by: Ri0S <aa248424@gmail.com>
```
9ccbf6b6

[Doc]: fixing typos in various files (#30540) · 1a55cfaf

Didier Durand authored Dec 14, 2025

Signed-off-by: Didier Durand <durand.didier@gmail.com>
Signed-off-by: Didier Durand <2927957+didier-durand@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

1a55cfaf

[Chore] Remove redundant `RequestPrompt` (#30612) · dcb31196
Cyrus Leung authored Dec 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
dcb31196

13 Dec, 2025 1 commit
- [Chore] Adjust tokenizer import to avoid circular imports (#30601) · 64251f48
  Cyrus Leung authored Dec 13, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  64251f48
12 Dec, 2025 1 commit
- [Bugfix] Multiple fixes for gpt-oss Chat Completion prompting (#28729) · 8f8fda26
  Ben Browning authored Dec 11, 2025
```
Signed-off-by: Ben Browning <bbrownin@redhat.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  8f8fda26
11 Dec, 2025 1 commit
- Fix typo of endpoint name in CLI args docs (#30473) · 853611bb
  Kenichi Maehashi authored Dec 11, 2025
```
Signed-off-by: Kenichi Maehashi <maehashi@preferred.jp>
```
  853611bb
10 Dec, 2025 2 commits

[P/D] KV Load Failure Recovery/Abort Configuration (#26813) · a9e4106f

Will Eaton authored Dec 10, 2025


Signed-off-by: Will Eaton <weaton@redhat.com>
Signed-off-by: Will Eaton <me@wseaton.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: chaunceyjiang <chaunceyjiang@gmail.com>

a9e4106f

[responsesAPI][6] Fix multi turn MCP tokenization (#30230) · c3487aca
Andrew Xia authored Dec 09, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
c3487aca

09 Dec, 2025 1 commit
- [BUGFIX] Mistral tool call parser v11+ (#30332) · 5c213d28
  Julien Denize authored Dec 09, 2025
```
Signed-off-by: juliendenize <julien.denize@mistral.ai>
```
  5c213d28
08 Dec, 2025 1 commit
- [Frontend] Add MCP type support infrastructure to Responses API (#30054) · 444f0e3f
  daniel-salib authored Dec 07, 2025
```
Signed-off-by: Daniel Salib <danielsalib@meta.com>
```
  444f0e3f
07 Dec, 2025 2 commits
- Revert "[Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145)" (#30199) · e83b7e37
  Cyrus Leung authored Dec 07, 2025
  
  e83b7e37
- [Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145) · 27f4c2fd
  Cyrus Leung authored Dec 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  27f4c2fd
06 Dec, 2025 2 commits
- [ez] move harmony utils to parser folder (#30117) · 421125d0
  Andrew Xia authored Dec 06, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  421125d0
- Gigachat 3 tool parser and tests (#29905) · 21bb3235
  Viacheslav authored Dec 06, 2025
```
Signed-off-by: Viacheslav Barinov <viacheslav.teh@gmail.com>
```
  21bb3235
05 Dec, 2025 2 commits

[KVConnector][Feature] Support KV connector cache reset via /reset_prefix_cache (#27170) · adb31506

Tova Movshovitz authored Dec 05, 2025

Signed-off-by: tovam <tovam@pliops.com>
Signed-off-by: Tova Movshovitz <tovam@pliops.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

adb31506

[responsesAPI][5] ResponsesParser with tools for full MCP python loop (#29798) · da7bc54e

Andrew Xia authored Dec 05, 2025


Signed-off-by: Andrew Xia <axia@fb.com>
Signed-off-by: Andrew Xia <axia@meta.com>
Co-authored-by: Andrew Xia <axia@fb.com>

da7bc54e