Commits · a4113b035cd4ee90ec02de0658b75d47f0007ede · OpenDAS / vllm_cscc

04 Jul, 2025 1 commit
- [Platform] Add custom default max tokens (#18557) · a4113b03
  Gabriel Marinho authored Jul 03, 2025
```
Signed-off-by: Gabriel Marinho <gmarinho@ibm.com>
```
  a4113b03
03 Jul, 2025 6 commits
- [Frontend] fix duplicate output for bench subcmd (#20446) · 619b9f5c
  Reid authored Jul 03, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  619b9f5c
- [Frontend] improve vllm bench <bench_type> --help display (#20430) · 9854dc90
  Reid authored Jul 03, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  9854dc90
- [Model][2/N] Automatic conversion of CrossEncoding model (#19978) · 6f1229f9
  wang.yuqi authored Jul 03, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  6f1229f9
- [Core] Move multimodal placeholder from chat utils to model definition (#20355) · b024a42e
  Cyrus Leung authored Jul 03, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b024a42e
- [Feature] Support MiniMax-M1 function calls features (#20297) · 363528de
  qscqesze authored Jul 03, 2025
```
Signed-off-by: QscQ <qscqesze@gmail.com>
Signed-off-by: qingjun <qingjun@minimaxi.com>
```
  363528de
- [BugFix] Fix DP headless mode arg validation (#20398) · 059d4cdb
  Nick Hill authored Jul 03, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  059d4cdb
02 Jul, 2025 4 commits
- [DP] Support external DP Load Balancer mode (#19790) · 657f2f30
  Nick Hill authored Jul 02, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  657f2f30
- [Model][VLM] Support Keye-VL-8B-Preview (#20126) · 8452946c
  Kwai-Keye authored Jul 02, 2025
```
Signed-off-by: Kwai-Keye <Keye@kuaishou.com>
```
  8452946c
- [Frontend] Support configurable mm placeholder strings & flexible video... · 2e7cbf2d
  Chenheli Hua authored Jul 01, 2025
```
[Frontend] Support configurable mm placeholder strings & flexible video sampling policies via CLI flags. (#20105)
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
  2e7cbf2d
- [Misc][Doc] Add missing comment for LLM (#20285) · 9ec1e306
  Lifans authored Jul 01, 2025
```
Signed-off-by: Lifan Shen <lifans@meta.com>
```
  9ec1e306
01 Jul, 2025 4 commits
- [Frontend] Expand tools even if tool_choice="none" (#17177) · 3d19d47d
  Shintarou Okada authored Jul 02, 2025
```
Signed-off-by: okada shintarou <okada@preferred.jp>
```
  3d19d47d
- [Docs] Update transcriptions API to use openai client with `stream=True` (#20271) · 314af861
  Nicolò Lucchesi authored Jul 01, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  314af861
- Add GLM4.1V model (Draft) (#19331) · ed70f3c6
  Yuxuan Zhang authored Jul 01, 2025
```
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  ed70f3c6
- [Bugfix] Fix include prompt in stream response when echo=true (#15233) · e28533a1
  fyuan1316 authored Jul 01, 2025
```
Signed-off-by: Yuan Fang <yuanfang@alauda.io>
```
  e28533a1
30 Jun, 2025 1 commit
- [Core] [Bugfix] [Multimodal] Fix multimodal profiling and generation for SFT/PTQed models (#20058) · d8cf819a
  Kyle Sayers authored Jun 30, 2025
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  d8cf819a
28 Jun, 2025 1 commit
- [Frontend] Generalize `v1/audio/transcriptions` endpoint (#20179) · daceac57
  Nicolò Lucchesi authored Jun 28, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  daceac57
27 Jun, 2025 2 commits
- [Perf] Improved perf for resolve_chat_template_content_format (#20065) · aa0dc77e
  Ilya Lavrenov authored Jun 27, 2025
```
Signed-off-by: Ilya Lavrenov <ilya.lavrenov@cerebras.net>
```
  aa0dc77e
- [Perf][Frontend] eliminate api_key and x_request_id headers middleware overhead (#19946) · 6e244ae0
  Yazan Sharaya authored Jun 27, 2025
```
Signed-off-by: Yazan-Sharaya <yazan.sharaya.yes@gmail.com>
```
  6e244ae0
26 Jun, 2025 1 commit
- [Bugfix] Fix Mistral tool-parser regex for nested JSON (#20093) · 754b00ed
  Michael Goin authored Jun 26, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  754b00ed
25 Jun, 2025 2 commits
- [Frontend] Add `/v1/audio/translations` OpenAI API endpoint (#19615) · e795d723
  Nicolò Lucchesi authored Jun 25, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  e795d723
- [Feat][CLI] enforce-include-usage (#19695) · f59fc60f
  Max Wittig authored Jun 25, 2025
```
Signed-off-by: Max Wittig <max.wittig@siemens.com>
```
  f59fc60f
24 Jun, 2025 1 commit
- [BugFix] Fix multi-node offline data parallel (#19937) · 8619e715
  Nick Hill authored Jun 24, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  8619e715
22 Jun, 2025 2 commits
- [Perf][CLI] Improve overall startup time (#19941) · c4cf2606
  Aaron Pham authored Jun 22, 2025
  
  c4cf2606
- [Misc] Simplify vllm bench cli subcommand implementation (#19948) · 2c11a29f
  Ye (Charlotte) Qi authored Jun 22, 2025
  
  2c11a29f
20 Jun, 2025 2 commits
- Fix: Check the type of params to be a Sequence not list. (#19910) · 8ca81bb0
  Rabin Adhikari authored Jun 21, 2025
```
Signed-off-by: Rabin Adhikari <rabin.adk1@gmail.com>
```
  8ca81bb0
- [Fix] import regex instead of re (#19875) · 7771d1de
  Thomas Parnell authored Jun 20, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  7771d1de
19 Jun, 2025 6 commits

[Frontend] early return chat format resolution when specified (#19735) · ea10dd9d
xzbdmw authored Jun 20, 2025

ea10dd9d
[Core][Bugfix] Fix Online MM Beam Search (#19688) · ead21102
Alex Brooks authored Jun 19, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
ead21102

[Frontend] Add optional token-level progress bar to `LLM.beam_search` (#19301) · 466166dc

NekoMimiUnagi authored Jun 19, 2025


Signed-off-by: Ruosen Li <rxl190028@utdallas.edu>
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Ubuntu <ubuntu@ip-172-31-71-179.ec2.internal>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>

466166dc

Add xLAM tool parser support (#17148) · 1d0ae26c
Zuxin authored Jun 18, 2025

1d0ae26c

Support embedding models in V1 (#16188) · 799397ee

Maximilien de Bayser authored Jun 19, 2025


Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>

799397ee

[Frontend] Expose custom args in OpenAI APIs (#16862) · dfada85e

afeldman-nm authored Jun 18, 2025


Signed-off-by: Andrew Feldman <afeldman@neuralmagic.com>
Signed-off-by: Andrew Feldman <afeldman@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>