Commits · f56ffafdce2efbcb59c83b36e4f45c8462a3f696 · OpenDAS / vllm_cscc

27 Mar, 2026 1 commit
- [frontend] dump openai responses type by alias (#38262) · 2babac0b
  cjackal authored Mar 27, 2026
```
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
```
  2babac0b
26 Mar, 2026 3 commits
- [CI] Reorganize scoring tests (#38207) · dcdc1458
  wang.yuqi authored Mar 26, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  dcdc1458
- Add `/v1/chat/completions/batch` endpoint for batched chat completions (#38011) · 29080945
  Matej Rojec authored Mar 26, 2026
```
Signed-off-by: Matej Rojec <64556640+MatejRojec@users.noreply.github.com>
```
  29080945
- [Tool Parser][1/3] Pass tools to ToolParser constructor (#38029) · e2db2b42
  Flora Feng authored Mar 25, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  e2db2b42
25 Mar, 2026 3 commits
- [Misc] Reorganize inputs (#35182) · ba2f0acc
  Cyrus Leung authored Mar 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ba2f0acc
- [CI] Fix realtime WebSocket timeout deadlock and unhandled model validation errors (#37483) · 9ac2fcaf
  Andreas Karatzas authored Mar 25, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  9ac2fcaf
- [Bugfix] Fix IndexError when accessing prev_tool_call_arr in OpenAIToolParser (#37958) · a32783bb
  Chauncey authored Mar 25, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  a32783bb
24 Mar, 2026 3 commits

[Feature] limit thinking tokens (hard limit) (#20859) · 47318847

Sungjae Lee authored Mar 25, 2026


Signed-off-by: Sungjae Lee <33976427+llsj14@users.noreply.github.com>
Signed-off-by: Sungjae Lee <sung-jae.lee@navercorp.com>
Signed-off-by: Chauncey <chaunceyjiang@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

47318847

Fix tool_parser_cls type annotation from Callable to type[ToolParser] (#37957) · 2e67fa75
Flora Feng authored Mar 24, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
2e67fa75
[Frontend][Bugfix] Pass default_chat_template_kwargs to AnthropicServingMessages (#37899) · 16a664df
jetxa authored Mar 24, 2026
```
Signed-off-by: jetxa <jetxzhang@outlook.com>
```
16a664df

23 Mar, 2026 1 commit
- [Frontend][Responses API] Fix arrival_time recording for TTFT on initial request (#37498) · 9ace378a
  Andrew Xia authored Mar 23, 2026
```
Signed-off-by: Andrew Xia <axia@meta.com>
```
  9ace378a
21 Mar, 2026 2 commits
- [Responses API] Add kv_transfer_params for PD disaggregation (#37424) · 17ee641c
  Bongwoo Bak authored Mar 21, 2026
```
Signed-off-by: bongwoobak <bongwoobak@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  17ee641c
- [Frontend] Remove librosa from audio dependency (#37058) · c7f98b4d
  Isotr0py authored Mar 21, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  c7f98b4d
20 Mar, 2026 2 commits
- [Model] Deprecate the score task (this will not affect users). (#37537) · ed359c49
  wang.yuqi authored Mar 20, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  ed359c49
- [V0 Deprecation] Deprecate --disable-frontend-multiprocessing (#37612) · 9040151f
  Flora Feng authored Mar 19, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  9040151f
19 Mar, 2026 2 commits

Remove deprecated reasoning_content message field(part-2) (#37480) · 104605cb

Ifta khairul Alam Adil authored Mar 19, 2026


Signed-off-by: JartX <sagformas@epdcenter.es>
Signed-off-by: Ifta Khairul Alam Adil <ikaadil007@gmail.com>
Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Philip Ottesen <phiott256@gmail.com>
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
Signed-off-by: Andy Lo <andy@mistral.ai>
Signed-off-by: Thillai Chithambaram <thillaichithambaram.a@gmail.com>
Signed-off-by: sihao.li <sihao.li@intel.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: JartX <sagformas@epdcenter.es>
Co-authored-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Philip Ottesen <phiott256@gmail.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Giancarlo Delfin <32987265+TheEpicDolphin@users.noreply.github.com>
Co-authored-by: Andy Lo <andy@mistral.ai>
Co-authored-by: Thillai Chithambaram <79466435+thillai-c@users.noreply.github.com>
Co-authored-by: sihao_li <165983188+1643661061leo@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

104605cb

[Bugfix] Add Kimi-K2.5 reasoning/tool parser aliases and tool_call_id support (#37438) · c63ca2b2
DorBernsohn authored Mar 19, 2026
```
Signed-off-by: DorBernsohn <dor.bernsohn@gmail.com>
```
c63ca2b2

18 Mar, 2026 2 commits
- [Build] Bump python openai version (#32316) · b322b197
  Chauncey authored Mar 18, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  b322b197
- [responsesAPI] parser.extract_response_outputs can take in token IDs (#37130) · 0e959161
  Andrew Xia authored Mar 17, 2026
```
Signed-off-by: Andrew Xia <axia@meta.com>
```
  0e959161
17 Mar, 2026 7 commits
- [Models] Cohere ASR (#35809) · b5ca9c35
  Ekagra Ranjan authored Mar 17, 2026
```
Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
```
  b5ca9c35
- [openapi] remove redundant exception stack trace[4/N] (#37157) · c9e50962
  Ning Xie authored Mar 17, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  c9e50962
- [Chore] Replace all base64 usages with faster pybase64 package (#37290) · a836524d
  Isotr0py authored Mar 17, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  a836524d
- [Frontend] Complete OpenAI render delegation (#37287) · 59192dfd
  Sage authored Mar 17, 2026
```
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
```
  59192dfd
- [Misc] Use VLLMValidationError in batch, pooling, and tokenize protocol validators (#36256) · 56cb1baa
  Umut Polat authored Mar 17, 2026
```
Signed-off-by: umut-polat <52835619+umut-polat@users.noreply.github.com>
```
  56cb1baa
- [Frontend] Delegate tokenization serving preprocessing to OpenAIServingRender (#37266) · 00f8e0d2
  Sage authored Mar 17, 2026
```
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
```
  00f8e0d2
- Fix some Mistral parser issues (#37209) · 5db91f0a
  Julien Denize authored Mar 17, 2026
```
Signed-off-by: juliendenize <julien.denize@mistral.ai>
```
  5db91f0a
16 Mar, 2026 2 commits
- [Bugfix] Add error handling for FINISHED_ERROR in OpenAIServing (#37148) · 6682c231
  Chauncey authored Mar 17, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  6682c231
- [CI][Bugfix] Fix 500 errors from priority overflow and TemplateError... · 57a314d1
  Andreas Karatzas authored Mar 16, 2026
```
[CI][Bugfix] Fix 500 errors from priority overflow and TemplateError subclasses in schema fuzz tests (#37127)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  57a314d1
15 Mar, 2026 1 commit
- [Frontend] Remove `torchcodec` from audio dependency (#37061) · 6590a3ec
  Isotr0py authored Mar 15, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  6590a3ec
14 Mar, 2026 3 commits

[Bugfix][Frontend] Fix audio transcription for MP4, M4A, and WebM formats (#35109) · 84868e47
seanmamasde authored Mar 14, 2026
```
Signed-off-by: seanmamasde <seanmamasde@gmail.com>
```
84868e47

[Bug] Fix Failure in /v1/chat/completions/render for Multimodal Requests... · 4a718e77

Sergey Zinchenko authored Mar 14, 2026

[Bug] Fix Failure in /v1/chat/completions/render for Multimodal Requests (https://github.com/vllm-project/vllm/issues/35665) (#35684)

4a718e77

[responsesAPI] prioritize content over summary in reasoning item input (#36516) · f680dc1b

Andrew Xia authored Mar 13, 2026


Signed-off-by: Andrew Xia <axia@meta.com>
Signed-off-by: Andrew Xia <mitandrewxia@gmail.com>
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Andrew Xia <axia@fb.com>

f680dc1b

13 Mar, 2026 2 commits
- [Frontend] Delegate preprocessing to `OpenAIServingRender` (#36483) · a2268617
  Sage authored Mar 13, 2026
```
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
```
  a2268617
- [Frontend] Fix usage incorrectly returned with empty stream_options` (#36379) · bc2c0c86
  Csrayz authored Mar 13, 2026
```
Signed-off-by: Csrayz <33659823+Csrayz@users.noreply.github.com>
```
  bc2c0c86
12 Mar, 2026 4 commits
- [Bugfix] Fix KeyError in parse_response_input for reasoning items with optional content (#34499) · bdc23434
  Eunkwang Jeon authored Mar 13, 2026
```
Signed-off-by: jeonsworld <jeonsworld@gmail.com>
```
  bdc23434
- [Frontend] Split `OpenAIServingModels` into `OpenAIModelRegistry` + `OpenAIServingModels` (#36536) · 06e0bc21
  Sage authored Mar 12, 2026
```
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
```
  06e0bc21
- [Bugfix] Fix crash when tool_choice=required exceeds max_tokens (#36841) · 5a71cdd7
  Chauncey authored Mar 12, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  5a71cdd7
- [Frontend] OpenAI Responses API supports Tool/Function calling with streaming (#29947) · 9fe404ed
  Chauncey authored Mar 12, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  9fe404ed
11 Mar, 2026 2 commits
- Add 'none' reasoning effort to ChatCompletionRequest (#36238) · a3ea760e
  Julien Denize authored Mar 11, 2026
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
  a3ea760e
- [Refactor] Remove deadcode in Responses API serving (#36726) · d5080aea
  Flora Feng authored Mar 11, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  d5080aea