Commits · 37a7d5d74a9eddae3265bb1118efbb0f5ce10a93 · OpenDAS / vllm_cscc

14 Jul, 2025 3 commits
- [Misc] Remove unused function (#20909) · 9887e8ec
  Reid authored Jul 14, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  9887e8ec
- Fix: Add missing EOFError handling in CLI complete command (#20896) · 2c7fa471
  Reid authored Jul 14, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  2c7fa471
- Removing redundant python version check (#20888) · 88fc8a97
  Daniel song authored Jul 14, 2025
```
Signed-off-by: Dannyso05 <dansong1177@gmail.com>
```
  88fc8a97
13 Jul, 2025 2 commits

[Bugfix] fix define of RerankDocument (#20877) · 211b6a61

Liuchenlong authored Jul 13, 2025


Signed-off-by: liuchenlong <liuchenlong@xiaohongshu.com>
Co-authored-by: liuchenlong <liuchenlong@xiaohongshu.com>

211b6a61

[Core] Support multiple tasks per model (#20771) · 020f58ab

Nicolò Lucchesi authored Jul 13, 2025


Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

020f58ab

12 Jul, 2025 2 commits
- [Frontend] Abstract prompt and SpeechToTextConfig for transcriptions models (#20637) · 3c7d942d
  Nicolò Lucchesi authored Jul 12, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  3c7d942d
- [CI Bug] Fix Async Engine, Inputs, Utils, Worker Test: 'State' object has no... · 7b828e30
  Wentao Ye authored Jul 11, 2025
```
[CI Bug] Fix Async Engine, Inputs, Utils, Worker Test: 'State' object has no attribute 'enable_server_load_tracking' (#20845)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  7b828e30
11 Jul, 2025 2 commits

[Bugfix] Refactor `/invocations` to be task-agnostic (#20764) · cbd14ed5
Cyrus Leung authored Jul 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
cbd14ed5

Add kimi-k2 tool parser (#20789) · 0cf893ca

bigmoyan authored Jul 11, 2025


Signed-off-by: wangzhengtao <wangzhengtao@moonshot.cn>
Co-authored-by: wangzhengtao <wangzhengtao@moonshot.cn>
Co-authored-by: wangzhengtao <wangzhengtao@msh.team>

0cf893ca

10 Jul, 2025 6 commits
- [Docs] Lazy import gguf (#20785) · b854321f
  Simon Mo authored Jul 10, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  b854321f
- [Core] Add Support for Default Modality Specific LoRAs [generate / chat completions] (#19126) · 41060c6e
  Alex Brooks authored Jul 10, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  41060c6e
- [CI] Fix pre commit issue (#20782) · 299252ea
  Wentao Ye authored Jul 10, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  299252ea
- [Model][VLM] Support JinaVL Reranker (#20260) · 4bed1677
  shineran96 authored Jul 11, 2025
```
Signed-off-by: shineran96 <shinewang96@gmail.com>
```
  4bed1677
- [Doc] Add engine args back in to the docs (#20674) · 3482fd7e
  Harry Mellor authored Jul 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  3482fd7e
- [Frontend] Support Tool Calling with both `tool_choice='required'` and `$defs`. (#20629) · 8f2720de
  Chauncey authored Jul 10, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  8f2720de
09 Jul, 2025 2 commits

[Bugfix] Fix the issue where `reasoning_content` is `None` when Thinkng is... · 2155e95e

Chauncey authored Jul 09, 2025


[Bugfix] Fix the issue where `reasoning_content` is `None` when Thinkng is enabled and `tool_choice` is set to `'required'`. (#20662)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>

2155e95e

[tech debt] Revisit lora request model checker (#20636) · baed180a
kourosh hakhamaneshi authored Jul 08, 2025
```
Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>
```
baed180a

08 Jul, 2025 1 commit
- [Misc] improve error msg (#20604) · 8369b7c2
  Reid authored Jul 08, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  8369b7c2
07 Jul, 2025 6 commits
- [Misc] feat output content in stream response (#19608) · 8e807cdf
  rongfu.leng authored Jul 08, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  8e807cdf
- [Misc] Add fully interleaved support for multimodal 'string' content format (#14047) · e601efcb
  Anton authored Jul 07, 2025
```
Signed-off-by: drobyshev.anton <drobyshev.anton@wb.ru>
Co-authored-by: drobyshev.anton <drobyshev.anton@wb.ru>
```
  e601efcb
- [Front-end] microbatch tokenization (#19334) · a37d75bb
  ztang2370 authored Jul 08, 2025
```
Signed-off-by: zt2370 <ztang2370@gmail.com>
```
  a37d75bb
- [Model][Last/4] Automatic conversion of CrossEncoding model (#19675) · 110df743
  wang.yuqi authored Jul 07, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  110df743
- [Misc] remove unused jinaai_serving_reranking (#18878) · 448acad3
  Abirdcfly authored Jul 07, 2025
```
Signed-off-by: Abirdcfly <fp544037857@gmail.com>
```
  448acad3
- Implement OpenAI Responses API [1/N] (#20504) · 462b2692
  Woosuk Kwon authored Jul 06, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  462b2692
06 Jul, 2025 4 commits
- [Bugfix] Add `use_cross_encoder` flag to use correct activation in `ClassifierPooler` (#20527) · c18b3b8e
  Cyrus Leung authored Jul 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c18b3b8e
- [Misc] call the pre-defined func (#20518) · 43813e63
  Reid authored Jul 06, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  43813e63
- [Frontend] Support image object in llm.chat (#19635) · fe1e9248
  Flora Feng authored Jul 05, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Signed-off-by: Flora Feng <4florafeng@gmail.com>
```
  fe1e9248
- [Misc] remove unused import (#20517) · 8d763cb8
  Reid authored Jul 06, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  8d763cb8
05 Jul, 2025 1 commit
- [Misc] Add security warning for development mode endpoints (#20508) · 7e908704
  Reid authored Jul 05, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  7e908704
04 Jul, 2025 2 commits
- [Misc] Add SPDX-FileCopyrightText (#20428) · 1caca5a5
  Jee Jee Li authored Jul 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1caca5a5
- [Platform] Add custom default max tokens (#18557) · a4113b03
  Gabriel Marinho authored Jul 03, 2025
```
Signed-off-by: Gabriel Marinho <gmarinho@ibm.com>
```
  a4113b03
03 Jul, 2025 6 commits
- [Frontend] fix duplicate output for bench subcmd (#20446) · 619b9f5c
  Reid authored Jul 03, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  619b9f5c
- [Frontend] improve vllm bench <bench_type> --help display (#20430) · 9854dc90
  Reid authored Jul 03, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  9854dc90
- [Model][2/N] Automatic conversion of CrossEncoding model (#19978) · 6f1229f9
  wang.yuqi authored Jul 03, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  6f1229f9
- [Core] Move multimodal placeholder from chat utils to model definition (#20355) · b024a42e
  Cyrus Leung authored Jul 03, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b024a42e
- [Feature] Support MiniMax-M1 function calls features (#20297) · 363528de
  qscqesze authored Jul 03, 2025
```
Signed-off-by: QscQ <qscqesze@gmail.com>
Signed-off-by: qingjun <qingjun@minimaxi.com>
```
  363528de
- [BugFix] Fix DP headless mode arg validation (#20398) · 059d4cdb
  Nick Hill authored Jul 03, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  059d4cdb
02 Jul, 2025 3 commits
- [DP] Support external DP Load Balancer mode (#19790) · 657f2f30
  Nick Hill authored Jul 02, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  657f2f30
- [Model][VLM] Support Keye-VL-8B-Preview (#20126) · 8452946c
  Kwai-Keye authored Jul 02, 2025
```
Signed-off-by: Kwai-Keye <Keye@kuaishou.com>
```
  8452946c
- [Frontend] Support configurable mm placeholder strings & flexible video... · 2e7cbf2d
  Chenheli Hua authored Jul 01, 2025
```
[Frontend] Support configurable mm placeholder strings & flexible video sampling policies via CLI flags. (#20105)
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
  2e7cbf2d