Commits · d9d21eb8e35fa356ebb2a1ffa94da4306905ff0e · OpenDAS / vllm_cscc

31 Mar, 2026 2 commits
- [Frontend][3/n] Improve pooling entrypoints | scoring. (#28631) · d9d21eb8
  wang.yuqi authored Mar 31, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  d9d21eb8
- [Mypy] Fix adjust_request typing (#38264) · 3e802e87
  Flora Feng authored Mar 31, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  3e802e87
30 Mar, 2026 3 commits
- [Refactor] Unify engine process monitoring in engine manager and add Ray backend support (#35862) · b5e60825
  fangyuchu authored Mar 31, 2026
```
Signed-off-by: fangyuchu <fangyuchu@qq.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
```
  b5e60825
- [Bugfix] Fix shared-object aliasing in n>1 streaming with tool calls (#38158) · 3683fe6c
  yzong-rh authored Mar 30, 2026
```
Signed-off-by: Yifan Zong <yzong@redhat.com>
Signed-off-by: Yifan <yzong@redhat.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  3683fe6c
- (security) Fix SSRF in batch runner download_bytes_from_url (#38482) · 57861ae4
  Juan Pérez de Algaba authored Mar 30, 2026
```
Signed-off-by: jperezde <jperezde@redhat.com>
```
  57861ae4
28 Mar, 2026 1 commit
- [BugFix][Frontend] apply task instruction as system prompt in cohere v2/embed (#38362) · fafca38a
  Walter Beller-Morales authored Mar 28, 2026
```
Signed-off-by: walterbm <walter.beller.morales@gmail.com>
```
  fafca38a
27 Mar, 2026 1 commit
- [frontend] dump openai responses type by alias (#38262) · 2babac0b
  cjackal authored Mar 27, 2026
```
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
```
  2babac0b
26 Mar, 2026 3 commits
- [CI] Reorganize scoring tests (#38207) · dcdc1458
  wang.yuqi authored Mar 26, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  dcdc1458
- Add `/v1/chat/completions/batch` endpoint for batched chat completions (#38011) · 29080945
  Matej Rojec authored Mar 26, 2026
```
Signed-off-by: Matej Rojec <64556640+MatejRojec@users.noreply.github.com>
```
  29080945
- [Tool Parser][1/3] Pass tools to ToolParser constructor (#38029) · e2db2b42
  Flora Feng authored Mar 25, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  e2db2b42
25 Mar, 2026 6 commits
- [Frontend] Move APIServerProcessManager target server fn (#38115) · 72cad44d
  Nick Hill authored Mar 25, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  72cad44d
- [Misc] Reorganize inputs (#35182) · ba2f0acc
  Cyrus Leung authored Mar 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ba2f0acc
- [Mypy] Better fixes for the `mypy` issues in `vllm/config` (#37902) · d215d1ef
  Harry Mellor authored Mar 25, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d215d1ef
- [ROCm][CI] Fix flaky Cohere/OpenAI embedding parity test (#37616) · f262a62a
  Andreas Karatzas authored Mar 25, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  f262a62a
- [CI] Fix realtime WebSocket timeout deadlock and unhandled model validation errors (#37483) · 9ac2fcaf
  Andreas Karatzas authored Mar 25, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  9ac2fcaf
- [Bugfix] Fix IndexError when accessing prev_tool_call_arr in OpenAIToolParser (#37958) · a32783bb
  Chauncey authored Mar 25, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  a32783bb
24 Mar, 2026 6 commits

[Bugfix] Force continuous usage stats when CLI override is enabled (#37923) · 4df5fa74

Dhruv Singal authored Mar 24, 2026


Signed-off-by: Your Name <you@example.com>
Co-authored-by: Your Name <you@example.com>
Co-authored-by: OpenCode <noreply@openai.com>

4df5fa74

[Feature] limit thinking tokens (hard limit) (#20859) · 47318847

Sungjae Lee authored Mar 25, 2026


Signed-off-by: Sungjae Lee <33976427+llsj14@users.noreply.github.com>
Signed-off-by: Sungjae Lee <sung-jae.lee@navercorp.com>
Signed-off-by: Chauncey <chaunceyjiang@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

47318847

[Deprecate] Deprecate pooling multi task support. (#37956) · 1b6cb920

wang.yuqi authored Mar 24, 2026


Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

1b6cb920

[Bugfix] Suppress spurious CPU KV cache warning in `launch render` (#37911) · 1c0aabde
Sage authored Mar 24, 2026
```
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
```
1c0aabde
Fix tool_parser_cls type annotation from Callable to type[ToolParser] (#37957) · 2e67fa75
Flora Feng authored Mar 24, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
2e67fa75
[Frontend][Bugfix] Pass default_chat_template_kwargs to AnthropicServingMessages (#37899) · 16a664df
jetxa authored Mar 24, 2026
```
Signed-off-by: jetxa <jetxzhang@outlook.com>
```
16a664df

23 Mar, 2026 1 commit
- [Frontend][Responses API] Fix arrival_time recording for TTFT on initial request (#37498) · 9ace378a
  Andrew Xia authored Mar 23, 2026
```
Signed-off-by: Andrew Xia <axia@meta.com>
```
  9ace378a
21 Mar, 2026 3 commits

Add tensor IPC transfer mechanism for multimodal data (#32104) · 80b70884

Brandon Pelfrey authored Mar 21, 2026


Signed-off-by: Brandon Pelfrey <bpelfrey@nvidia.com>
Signed-off-by: Brandon Pelfrey <brandonpelfrey@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

80b70884

[Responses API] Add kv_transfer_params for PD disaggregation (#37424) · 17ee641c
Bongwoo Bak authored Mar 21, 2026
```
Signed-off-by: bongwoobak <bongwoobak@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
17ee641c
[Frontend] Remove librosa from audio dependency (#37058) · c7f98b4d
Isotr0py authored Mar 21, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
c7f98b4d

20 Mar, 2026 2 commits
- [Model] Deprecate the score task (this will not affect users). (#37537) · ed359c49
  wang.yuqi authored Mar 20, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  ed359c49
- [V0 Deprecation] Deprecate --disable-frontend-multiprocessing (#37612) · 9040151f
  Flora Feng authored Mar 19, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  9040151f
19 Mar, 2026 7 commits

[Bug] Fix EmbedIOprocessor "classify" <-> "embed" (#37573) · df3c0291
Wentao Ye authored Mar 19, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
df3c0291
[Refactor] Remove dead code in pooling model (#37572) · 2be1a0f7
Wentao Ye authored Mar 19, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
2be1a0f7
[P/D] AnthropicMessages add kv_transfer_params for PD disaggregation (#37535) · 2f9f946b
Chauncey authored Mar 20, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
2f9f946b

Remove deprecated reasoning_content message field(part-2) (#37480) · 104605cb

Ifta khairul Alam Adil authored Mar 19, 2026


Signed-off-by: JartX <sagformas@epdcenter.es>
Signed-off-by: Ifta Khairul Alam Adil <ikaadil007@gmail.com>
Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Philip Ottesen <phiott256@gmail.com>
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
Signed-off-by: Andy Lo <andy@mistral.ai>
Signed-off-by: Thillai Chithambaram <thillaichithambaram.a@gmail.com>
Signed-off-by: sihao.li <sihao.li@intel.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: JartX <sagformas@epdcenter.es>
Co-authored-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Philip Ottesen <phiott256@gmail.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Giancarlo Delfin <32987265+TheEpicDolphin@users.noreply.github.com>
Co-authored-by: Andy Lo <andy@mistral.ai>
Co-authored-by: Thillai Chithambaram <79466435+thillai-c@users.noreply.github.com>
Co-authored-by: sihao_li <165983188+1643661061leo@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>