Commits · 7e1665b0899778ceeac0e4ab81e157709cf0b57e · OpenDAS / vllm_cscc · GitLab

03 Jul, 2025 3 commits
- [Model][2/N] Automatic conversion of CrossEncoding model (#19978) · 6f1229f9
  wang.yuqi authored Jul 03, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  6f1229f9
- [Core] Move multimodal placeholder from chat utils to model definition (#20355) · b024a42e
  Cyrus Leung authored Jul 03, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b024a42e
- [Feature] Support MiniMax-M1 function calls features (#20297) · 363528de
  qscqesze authored Jul 03, 2025
```
Signed-off-by: QscQ <qscqesze@gmail.com>
Signed-off-by: qingjun <qingjun@minimaxi.com>
```
  363528de
01 Jul, 2025 3 commits
- [Frontend] Expand tools even if tool_choice="none" (#17177) · 3d19d47d
  Shintarou Okada authored Jul 02, 2025
```
Signed-off-by: okada shintarou <okada@preferred.jp>
```
  3d19d47d
- [Docs] Update transcriptions API to use openai client with `stream=True` (#20271) · 314af861
  Nicolò Lucchesi authored Jul 01, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  314af861
- [Bugfix] Fix include prompt in stream response when echo=true (#15233) · e28533a1
  fyuan1316 authored Jul 01, 2025
```
Signed-off-by: Yuan Fang <yuanfang@alauda.io>
```
  e28533a1
28 Jun, 2025 1 commit
- [Frontend] Generalize `v1/audio/transcriptions` endpoint (#20179) · daceac57
  Nicolò Lucchesi authored Jun 28, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  daceac57
27 Jun, 2025 1 commit
- [Perf][Frontend] eliminate api_key and x_request_id headers middleware overhead (#19946) · 6e244ae0
  Yazan Sharaya authored Jun 27, 2025
```
Signed-off-by: Yazan-Sharaya <yazan.sharaya.yes@gmail.com>
```
  6e244ae0
26 Jun, 2025 1 commit
- [Bugfix] Fix Mistral tool-parser regex for nested JSON (#20093) · 754b00ed
  Michael Goin authored Jun 26, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  754b00ed
25 Jun, 2025 2 commits
- [Frontend] Add `/v1/audio/translations` OpenAI API endpoint (#19615) · e795d723
  Nicolò Lucchesi authored Jun 25, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  e795d723
- [Feat][CLI] enforce-include-usage (#19695) · f59fc60f
  Max Wittig authored Jun 25, 2025
```
Signed-off-by: Max Wittig <max.wittig@siemens.com>
```
  f59fc60f
22 Jun, 2025 1 commit
- [Perf][CLI] Improve overall startup time (#19941) · c4cf2606
  Aaron Pham authored Jun 22, 2025
  
  c4cf2606
20 Jun, 2025 1 commit
- [Fix] import regex instead of re (#19875) · 7771d1de
  Thomas Parnell authored Jun 20, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  7771d1de
19 Jun, 2025 3 commits

Add xLAM tool parser support (#17148) · 1d0ae26c
Zuxin authored Jun 18, 2025

1d0ae26c

Support embedding models in V1 (#16188) · 799397ee

Maximilien de Bayser authored Jun 19, 2025


Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>

799397ee

[Frontend] Expose custom args in OpenAI APIs (#16862) · dfada85e

afeldman-nm authored Jun 18, 2025


Signed-off-by: Andrew Feldman <afeldman@neuralmagic.com>
Signed-off-by: Andrew Feldman <afeldman@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

dfada85e

17 Jun, 2025 1 commit
- [Frontend] add chunking audio for > 30s audio (#19597) · ede5c4eb
  nguyenhoangthuan99 authored Jun 17, 2025
```
Signed-off-by: nguyenhoangthuan99 <thuanhppro12@gmail.com>
```
  ede5c4eb
16 Jun, 2025 2 commits

[Bugfix] fix missing 'finish_reason': null in streaming chat (#19662) · 836d4ce1
Chauncey authored Jun 16, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
836d4ce1

[Misc][Frontend] passthrough `bad_words` (#19564) · 367871a4

Francesco Bertolotti authored Jun 16, 2025

Signed-off-by: Francesco Bertolotti <francesco.bertolotti@igenius.ai>
Co-authored-by: Francesco Bertolotti <francesco.bertolotti@igenius.ai>
Co-authored-by: Aaron Pham <Aaronpham0103@gmail.com>

367871a4

12 Jun, 2025 3 commits
- [BugFix] Handle missing sep_token for Qwen3-Reranker in Score API (#19522) · 1b0b065e
  wonjun Jang authored Jun 12, 2025
```
Signed-off-by: strutive07 <strutive07@gmail.com>
```
  1b0b065e
- [Frontend] Improve error message in tool_choice validation (#19239) · 7e3e74c9
  22quinn authored Jun 11, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  7e3e74c9
- [CI] change spell checker from codespell to typos (#18711) · 2f1c19b2
  Ning Xie authored Jun 12, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  2f1c19b2
09 Jun, 2025 1 commit
- [Frontend] Make TIMEOUT_KEEP_ALIVE configurable through env var (#18472) · 31f58be9
  liusiqian-tal authored Jun 10, 2025
```
Signed-off-by: liusiqian <liusiqian@tal.com>
```
  31f58be9
06 Jun, 2025 1 commit
- Support allowed_token_ids in ChatCompletionRequest (#19143) · 3da2313d
  Xu Song authored Jun 06, 2025
```
Signed-off-by: Xu Song <xusong.vip@gmail.com>
```
  3da2313d
05 Jun, 2025 2 commits
- [mistral_common] Add v11 tokenizer (#19193) · f20f9f06
  Patrick von Platen authored Jun 05, 2025
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
```
  f20f9f06
- [Bugfix]: Fix the incompatibility issue with stream when Thinking is disabled (#19135) · 8fc57501
  Chauncey authored Jun 05, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  8fc57501
03 Jun, 2025 2 commits
- [Bugfix]: Fix the incompatibility issue with tool_choice 'required' when... · 4de790fc
  Chauncey authored Jun 04, 2025
```
[Bugfix]: Fix the incompatibility issue with tool_choice 'required' when Thinking is enabled (#19075)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  4de790fc
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
02 Jun, 2025 1 commit
- [Frontend] enable custom logging for the uvicorn server (OpenAI API server) (#18403) · 20133cfe
  Frαnçois authored Jun 02, 2025
```
Signed-off-by: François Paupier <francois.paupier@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  20133cfe
31 May, 2025 3 commits
- [Misc] add return token strs for tokenize (#18941) · 20079c6e
  Reid authored Jun 01, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  20079c6e
- fix security issue of logging llm output (#18980) · b8b90479
  Lucia Fang authored May 31, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
Co-authored-by: Lucia (Lu) Fang <fanglu@meta.com>
```
  b8b90479
- [Frontend] Add rerank support to run_batch endpoint (#16278) · dff80b0e
  Pooya Davoodi authored May 31, 2025
```
Signed-off-by: Pooya Davoodi <pooya.davoodi@parasail.io>
```
  dff80b0e
30 May, 2025 3 commits
- Tool parser regex timeout handling (#18960) · 1dab4d57
  Will Eaton authored May 30, 2025
```
Signed-off-by: Will Eaton <weaton@redhat.com>
```
  1dab4d57
- [Perf] API-server scaleout with many-to-many server-engine comms (#17546) · 2dbe8c07
  Nick Hill authored May 30, 2025
  
  2dbe8c07
- [Bugfix] Consistent ascii handling in tool parsers (#18883) · 77164dad
  Chauncey authored May 30, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  77164dad
29 May, 2025 1 commit
- [Misc] Replace TODO in serving transcription (#18895) · 24d0ef89
  Nicolò Lucchesi authored May 29, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  24d0ef89
28 May, 2025 4 commits
- [Core] Add Lora Support to Beam Search (#18346) · 321331b8
  Alex Brooks authored May 28, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  321331b8
- [Frontend] add run batch to CLI (#18804) · 435fa954
  Reid authored May 28, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  435fa954
- Enable Pydantic mypy checks and convert configs to Pydantic dataclasses (#17599) · 4c2b38ce
  Harry Mellor authored May 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4c2b38ce
- [Deprecation] Remove fallbacks for Embeddings API (#18795) · 0c492b78
  Cyrus Leung authored May 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0c492b78