Commits · 1c0aabdeb0cf77019a1f89b5bed5b8eebdd5c211 · OpenDAS / vllm_cscc

24 Mar, 2026 3 commits
- [Bugfix] Suppress spurious CPU KV cache warning in `launch render` (#37911) · 1c0aabde
  Sage authored Mar 24, 2026
```
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
```
  1c0aabde
- Fix tool_parser_cls type annotation from Callable to type[ToolParser] (#37957) · 2e67fa75
  Flora Feng authored Mar 24, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  2e67fa75
- [Frontend][Bugfix] Pass default_chat_template_kwargs to AnthropicServingMessages (#37899) · 16a664df
  jetxa authored Mar 24, 2026
```
Signed-off-by: jetxa <jetxzhang@outlook.com>
```
  16a664df
23 Mar, 2026 1 commit
- [Frontend][Responses API] Fix arrival_time recording for TTFT on initial request (#37498) · 9ace378a
  Andrew Xia authored Mar 23, 2026
```
Signed-off-by: Andrew Xia <axia@meta.com>
```
  9ace378a
21 Mar, 2026 3 commits

Add tensor IPC transfer mechanism for multimodal data (#32104) · 80b70884

Brandon Pelfrey authored Mar 21, 2026


Signed-off-by: Brandon Pelfrey <bpelfrey@nvidia.com>
Signed-off-by: Brandon Pelfrey <brandonpelfrey@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

80b70884

[Responses API] Add kv_transfer_params for PD disaggregation (#37424) · 17ee641c
Bongwoo Bak authored Mar 21, 2026
```
Signed-off-by: bongwoobak <bongwoobak@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
17ee641c
[Frontend] Remove librosa from audio dependency (#37058) · c7f98b4d
Isotr0py authored Mar 21, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
c7f98b4d

20 Mar, 2026 2 commits
- [Model] Deprecate the score task (this will not affect users). (#37537) · ed359c49
  wang.yuqi authored Mar 20, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  ed359c49
- [V0 Deprecation] Deprecate --disable-frontend-multiprocessing (#37612) · 9040151f
  Flora Feng authored Mar 19, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  9040151f
19 Mar, 2026 7 commits

[Bug] Fix EmbedIOprocessor "classify" <-> "embed" (#37573) · df3c0291
Wentao Ye authored Mar 19, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
df3c0291
[Refactor] Remove dead code in pooling model (#37572) · 2be1a0f7
Wentao Ye authored Mar 19, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
2be1a0f7
[P/D] AnthropicMessages add kv_transfer_params for PD disaggregation (#37535) · 2f9f946b
Chauncey authored Mar 20, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
2f9f946b

Remove deprecated reasoning_content message field(part-2) (#37480) · 104605cb

Ifta khairul Alam Adil authored Mar 19, 2026


Signed-off-by: JartX <sagformas@epdcenter.es>
Signed-off-by: Ifta Khairul Alam Adil <ikaadil007@gmail.com>
Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Philip Ottesen <phiott256@gmail.com>
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
Signed-off-by: Andy Lo <andy@mistral.ai>
Signed-off-by: Thillai Chithambaram <thillaichithambaram.a@gmail.com>
Signed-off-by: sihao.li <sihao.li@intel.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: JartX <sagformas@epdcenter.es>
Co-authored-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Philip Ottesen <phiott256@gmail.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Giancarlo Delfin <32987265+TheEpicDolphin@users.noreply.github.com>
Co-authored-by: Andy Lo <andy@mistral.ai>
Co-authored-by: Thillai Chithambaram <79466435+thillai-c@users.noreply.github.com>
Co-authored-by: sihao_li <165983188+1643661061leo@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

104605cb

Cap the number of API servers to 1 when using Elastic EP. (#37466) · 7c0cf3bc
Sage Moore authored Mar 19, 2026
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
7c0cf3bc
[Bugfix] Add Kimi-K2.5 reasoning/tool parser aliases and tool_call_id support (#37438) · c63ca2b2
DorBernsohn authored Mar 19, 2026
```
Signed-off-by: DorBernsohn <dor.bernsohn@gmail.com>
```
c63ca2b2
fix(anthropic): remove non-standard 'data: [DONE]' from Anthropic streaming (#37510) · 354cd580
cdpath authored Mar 19, 2026
```
Signed-off-by: cdpath <cdpath@outlook.com>
```
354cd580

18 Mar, 2026 2 commits
- [Build] Bump python openai version (#32316) · b322b197
  Chauncey authored Mar 18, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  b322b197
- [responsesAPI] parser.extract_response_outputs can take in token IDs (#37130) · 0e959161
  Andrew Xia authored Mar 17, 2026
```
Signed-off-by: Andrew Xia <axia@meta.com>
```
  0e959161
17 Mar, 2026 7 commits
- [Models] Cohere ASR (#35809) · b5ca9c35
  Ekagra Ranjan authored Mar 17, 2026
```
Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
```
  b5ca9c35
- [openapi] remove redundant exception stack trace[4/N] (#37157) · c9e50962
  Ning Xie authored Mar 17, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  c9e50962
- [Chore] Replace all base64 usages with faster pybase64 package (#37290) · a836524d
  Isotr0py authored Mar 17, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  a836524d
- [Frontend] Complete OpenAI render delegation (#37287) · 59192dfd
  Sage authored Mar 17, 2026
```
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
```
  59192dfd
- [Misc] Use VLLMValidationError in batch, pooling, and tokenize protocol validators (#36256) · 56cb1baa
  Umut Polat authored Mar 17, 2026
```
Signed-off-by: umut-polat <52835619+umut-polat@users.noreply.github.com>
```
  56cb1baa
- [Frontend] Delegate tokenization serving preprocessing to OpenAIServingRender (#37266) · 00f8e0d2
  Sage authored Mar 17, 2026
```
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
```
  00f8e0d2
- Fix some Mistral parser issues (#37209) · 5db91f0a
  Julien Denize authored Mar 17, 2026
```
Signed-off-by: juliendenize <julien.denize@mistral.ai>
```
  5db91f0a
16 Mar, 2026 6 commits
- [Feature][Frontend] add support for Cohere Embed v2 API (#37074) · 061980c3
  Walter Beller-Morales authored Mar 16, 2026
```
Signed-off-by: walterbm <walter.beller.morales@gmail.com>
```
  061980c3
- [Bugfix] Fix render server crash for quantized models on CPU-only hosts (#37215) · 0fefd00e
  Sage authored Mar 16, 2026
```
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
```
  0fefd00e
- [Bugfix] Add error handling for FINISHED_ERROR in OpenAIServing (#37148) · 6682c231
  Chauncey authored Mar 17, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  6682c231
- [Bugfix] accept redacted thinking blocks in Anthropic messages (#36992) · 0e5a9382
  Benjamin Bartels authored Mar 16, 2026
```
Signed-off-by: Benjamin Bartels <benjaminba@tiglab-ubuntu.ilab.local>
Signed-off-by: bbartels <benjamin@bartels.dev>
Co-authored-by: Benjamin Bartels <benjaminba@tiglab-ubuntu.ilab.local>
```
  0e5a9382
- [Frontend][Misc] Remove unused log in `/is_sleeping` (#37093) · 0115e957
  Roy Wang authored Mar 16, 2026
```
Signed-off-by: esmeetu <jasonailu87@gmail.com>
```
  0115e957
- [CI][Bugfix] Fix 500 errors from priority overflow and TemplateError... · 57a314d1
  Andreas Karatzas authored Mar 16, 2026
```
[CI][Bugfix] Fix 500 errors from priority overflow and TemplateError subclasses in schema fuzz tests (#37127)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  57a314d1
15 Mar, 2026 2 commits
- [Misc] Add online audio_in_video test (#36775) · 143e4dcc
  Isotr0py authored Mar 15, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  143e4dcc
- [Frontend] Remove `torchcodec` from audio dependency (#37061) · 6590a3ec
  Isotr0py authored Mar 15, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  6590a3ec
14 Mar, 2026 3 commits

[Bugfix][Frontend] Fix audio transcription for MP4, M4A, and WebM formats (#35109) · 84868e47
seanmamasde authored Mar 14, 2026
```
Signed-off-by: seanmamasde <seanmamasde@gmail.com>
```
84868e47

[Bug] Fix Failure in /v1/chat/completions/render for Multimodal Requests... · 4a718e77

Sergey Zinchenko authored Mar 14, 2026

[Bug] Fix Failure in /v1/chat/completions/render for Multimodal Requests (https://github.com/vllm-project/vllm/issues/35665) (#35684)

4a718e77

[responsesAPI] prioritize content over summary in reasoning item input (#36516) · f680dc1b

Andrew Xia authored Mar 13, 2026


Signed-off-by: Andrew Xia <axia@meta.com>
Signed-off-by: Andrew Xia <mitandrewxia@gmail.com>
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Andrew Xia <axia@fb.com>

f680dc1b

13 Mar, 2026 3 commits
- [Frontend][Core] Re-add shutdown timeout - allowing in-flight requests to finish (#36666) · 7afe0faa
  Mark McLoughlin authored Mar 13, 2026
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
```
  7afe0faa
- [Frontend] Delegate preprocessing to `OpenAIServingRender` (#36483) · a2268617
  Sage authored Mar 13, 2026
```
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
```
  a2268617
- [Frontend] Fix usage incorrectly returned with empty stream_options` (#36379) · bc2c0c86
  Csrayz authored Mar 13, 2026
```
Signed-off-by: Csrayz <33659823+Csrayz@users.noreply.github.com>
```
  bc2c0c86
12 Mar, 2026 1 commit
- [Bugfix] Fix KeyError in parse_response_input for reasoning items with optional content (#34499) · bdc23434
  Eunkwang Jeon authored Mar 13, 2026
```
Signed-off-by: jeonsworld <jeonsworld@gmail.com>
```
  bdc23434