Commits · 18bdcf41135d5ce47d53b40b9f3dfe47c610f945 · OpenDAS / vllm_cscc

16 Jul, 2025 1 commit

feat - add a new endpoint `get_tokenizer_info` to provide... · 18bdcf41

Mac Misiura authored Jul 16, 2025


feat - add a new endpoint `get_tokenizer_info` to provide tokenizer/chat-template information (#20575)
Signed-off-by: m-misiura <mmisiura@redhat.com>

18bdcf41

15 Jul, 2025 1 commit
- [Frontend] Support cache_salt in /v1/completions and /v1/responses (#20981) · 19c86306
  Marko Rosenmueller authored Jul 15, 2025
```
Signed-off-by: Marko Rosenmueller <5467316+dr75@users.noreply.github.com>
```
  19c86306
13 Jul, 2025 1 commit

[Bugfix] fix define of RerankDocument (#20877) · 211b6a61

Liuchenlong authored Jul 13, 2025


Signed-off-by: liuchenlong <liuchenlong@xiaohongshu.com>
Co-authored-by: liuchenlong <liuchenlong@xiaohongshu.com>

211b6a61

11 Jul, 2025 1 commit
- [Bugfix] Refactor `/invocations` to be task-agnostic (#20764) · cbd14ed5
  Cyrus Leung authored Jul 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  cbd14ed5
10 Jul, 2025 2 commits
- [Model][VLM] Support JinaVL Reranker (#20260) · 4bed1677
  shineran96 authored Jul 11, 2025
```
Signed-off-by: shineran96 <shinewang96@gmail.com>
```
  4bed1677
- [Frontend] Support Tool Calling with both `tool_choice='required'` and `$defs`. (#20629) · 8f2720de
  Chauncey authored Jul 10, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  8f2720de
07 Jul, 2025 1 commit
- Implement OpenAI Responses API [1/N] (#20504) · 462b2692
  Woosuk Kwon authored Jul 06, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  462b2692
06 Jul, 2025 1 commit
- [Bugfix] Add `use_cross_encoder` flag to use correct activation in `ClassifierPooler` (#20527) · c18b3b8e
  Cyrus Leung authored Jul 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c18b3b8e
04 Jul, 2025 1 commit
- [Platform] Add custom default max tokens (#18557) · a4113b03
  Gabriel Marinho authored Jul 03, 2025
```
Signed-off-by: Gabriel Marinho <gmarinho@ibm.com>
```
  a4113b03
01 Jul, 2025 2 commits
- [Frontend] Expand tools even if tool_choice="none" (#17177) · 3d19d47d
  Shintarou Okada authored Jul 02, 2025
```
Signed-off-by: okada shintarou <okada@preferred.jp>
```
  3d19d47d
- [Docs] Update transcriptions API to use openai client with `stream=True` (#20271) · 314af861
  Nicolò Lucchesi authored Jul 01, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  314af861
25 Jun, 2025 1 commit

[Frontend] Add `/v1/audio/translations` OpenAI API endpoint (#19615) · e795d723

Nicolò Lucchesi authored Jun 25, 2025


Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

e795d723

19 Jun, 2025 1 commit

[Frontend] Expose custom args in OpenAI APIs (#16862) · dfada85e

afeldman-nm authored Jun 18, 2025


Signed-off-by: Andrew Feldman <afeldman@neuralmagic.com>
Signed-off-by: Andrew Feldman <afeldman@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

dfada85e

16 Jun, 2025 1 commit

[Misc][Frontend] passthrough `bad_words` (#19564) · 367871a4

Francesco Bertolotti authored Jun 16, 2025

Signed-off-by: Francesco Bertolotti <francesco.bertolotti@igenius.ai>
Co-authored-by: Francesco Bertolotti <francesco.bertolotti@igenius.ai>
Co-authored-by: Aaron Pham <Aaronpham0103@gmail.com>

367871a4

12 Jun, 2025 1 commit
- [Frontend] Improve error message in tool_choice validation (#19239) · 7e3e74c9
  22quinn authored Jun 11, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  7e3e74c9
06 Jun, 2025 1 commit
- Support allowed_token_ids in ChatCompletionRequest (#19143) · 3da2313d
  Xu Song authored Jun 06, 2025
```
Signed-off-by: Xu Song <xusong.vip@gmail.com>
```
  3da2313d
03 Jun, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
31 May, 2025 2 commits
- [Misc] add return token strs for tokenize (#18941) · 20079c6e
  Reid authored Jun 01, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  20079c6e
- [Frontend] Add rerank support to run_batch endpoint (#16278) · dff80b0e
  Pooya Davoodi authored May 31, 2025
```
Signed-off-by: Pooya Davoodi <pooya.davoodi@parasail.io>
```
  dff80b0e
28 May, 2025 1 commit
- Enable Pydantic mypy checks and convert configs to Pydantic dataclasses (#17599) · 4c2b38ce
  Harry Mellor authored May 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4c2b38ce
23 May, 2025 2 commits
- [Bugfix] Migrate to REGEX Library to prevent catastrophic backtracking (#18454) · 4fc1bf81
  Feng XiaoLong authored May 24, 2025
```
Signed-off-by: Crucifixion-Fxl <xmufxl@gmail.com>
Co-authored-by: Crucifixion-Fxl <xmufxl@gmail.com>
```
  4fc1bf81
- Migrate docs from Sphinx to MkDocs (#18145) · a1fe24d9
  Harry Mellor authored May 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a1fe24d9
19 May, 2025 1 commit

Feature/vllm/input embedding completion api (#17590) · 221cfc2f

Nan Qin authored May 18, 2025


Signed-off-by: Andrew Sansom <andrew@protopia.ai>
Signed-off-by: Nan2018 <nan@protopia.ai>
Co-authored-by: 临景 <linjing.yx@alibaba-inc.com>
Co-authored-by: Bryce1010 <bryceyx@gmail.com>
Co-authored-by: Andrew Sansom <andrew@protopia.ai>
Co-authored-by: Andrew Sansom <qthequartermasterman@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

221cfc2f

15 May, 2025 1 commit
- add tools into TokenizeChatRequest (#18187) · 451da4bc
  hustxiayang authored May 15, 2025
```
Signed-off-by: yangxia <yangxiast@gmail.com>
```
  451da4bc
12 May, 2025 2 commits

[P/D] NIXL Integration (#17751) · d1911020

Robert Shaw authored May 12, 2025


Signed-off-by: ApostaC <yihua98@uchicago.edu>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
Signed-off-by: Robert Shaw <rshaw@neuralmagic.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Brent Salisbury <bsalisbu@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: ApostaC <yihua98@uchicago.edu>
Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Brent Salisbury <bsalisbu@redhat.com>

d1911020

Initialize the delta tool call fields explicitly (#17340) · 05a4324f
Maximilien de Bayser authored May 12, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: igmainc <igmainc@icloud.com>
```
05a4324f

11 May, 2025 1 commit
- [Frontend] Add /classify endpoint (#17032) · 9cea90ea
  Frieda Huang authored May 11, 2025
```
Signed-off-by: Frieda (Jingying) Huang <jingyingfhuang@gmail.com>
```
  9cea90ea
09 May, 2025 2 commits
- Handle error when `str` passed to `/v1/audio/transcriptions` (#17909) · 7d4aedae
  Harry Mellor authored May 09, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  7d4aedae
- Change `top_k` to be disabled with `0` (still accept `-1` for now) (#17773) · c6798baa
  Harry Mellor authored May 09, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c6798baa
04 May, 2025 1 commit
- Add full API docs and improve the UX of navigating them (#17485) · d6484ef3
  Harry Mellor authored May 04, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6484ef3
30 Apr, 2025 2 commits

[Core] Prevent side-channel attacks via cache salting (#17045) · 77073c77
Marko Rosenmueller authored Apr 30, 2025
```
Signed-off-by: Marko Rosenmueller <5467316+dr75@users.noreply.github.com>
```
77073c77

Truncation control for embedding models (#14776) · 1c2bc7ea

Gabriel Marinho authored Apr 29, 2025


Signed-off-by: Gabriel Marinho <gmarinho@ibm.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>

1c2bc7ea

26 Apr, 2025 1 commit
- [V1] Add `structural_tag` support using xgrammar (#17085) · f8acd01f
  Russell Bryant authored Apr 26, 2025
  
  f8acd01f
19 Apr, 2025 1 commit

[Frontend] Add sampling params to `v1/audio/transcriptions` endpoint (#16591) · 2ef0dc53

Nicolò Lucchesi authored Apr 19, 2025


Signed-off-by: Jannis Schönleber <joennlae@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Jannis Schönleber <joennlae@gmail.com>

2ef0dc53

12 Apr, 2025 1 commit
- [Frontend] support matryoshka representation / support embedding API dimensions (#16331) · fbf722c6
  wang.yuqi authored Apr 12, 2025
  
  fbf722c6
09 Apr, 2025 1 commit
- [Bugfix][Frontend] respect provided default guided decoding backend (#15476) · 98d01d3c
  Guillaume Calmettes authored Apr 09, 2025
```
Signed-off-by: Guillaume Calmettes <gcalmettes@scaleway.com>
```
  98d01d3c
02 Apr, 2025 1 commit

[Frontend] Implement Tool Calling with `tool_choice='required'` (#13483) · cefb9e5a

Matthias Matt authored Apr 02, 2025


Signed-off-by: Liangfu Chen <liangfc@amazon.com>
Signed-off-by: Matt, Matthias <matthias.matt@tuwien.ac.at>
Co-authored-by: Liangfu Chen <liangfc@amazon.com>
Co-authored-by: mgoin <michael@neuralmagic.com>

cefb9e5a

25 Mar, 2025 1 commit
- Add workaround for shared field_names in pydantic model class (#13925) · e977c111
  Maximilien de Bayser authored Mar 25, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  e977c111
18 Mar, 2025 1 commit
- [Bugfix][Frontend] Fix validation of `logprobs` in `ChatCompletionRequest` (#14352) · dd732028
  Sebastian Schoennenbeck authored Mar 18, 2025
```
Signed-off-by: Sebastian Schönnenbeck <sebastian.schoennenbeck@comma-soft.com>
```
  dd732028
10 Mar, 2025 1 commit
- Correct capitalisation: `VLLM` -> `vLLM` (#14562) · 3b352a2f
  Harry Mellor authored Mar 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  3b352a2f