Commits · 33011318c20824799b817347783d911e5b2076ea · OpenDAS / vllm_cscc

13 May, 2025 1 commit

[Feature][V1] Support `tool_choice: required` when using Xgrammar as the... · dc1a8217

Chauncey authored May 13, 2025


[Feature][V1]  Support `tool_choice: required` when using Xgrammar as the `StructuredOutputBackend`. (#17845)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>

dc1a8217

12 May, 2025 1 commit
- Initialize the delta tool call fields explicitly (#17340) · 05a4324f
  Maximilien de Bayser authored May 12, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: igmainc <igmainc@icloud.com>
```
  05a4324f
11 May, 2025 1 commit
- [Frontend] Add /classify endpoint (#17032) · 9cea90ea
  Frieda Huang authored May 11, 2025
```
Signed-off-by: Frieda (Jingying) Huang <jingyingfhuang@gmail.com>
```
  9cea90ea
10 May, 2025 1 commit

Add missing content type headers to /ping and /health (#17036) (#17786) · fc4441a4

Ximo Guanter authored May 10, 2025


Signed-off-by: Ximo Guanter <ximo.guanter@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

fc4441a4

08 May, 2025 2 commits
- [CI] Fix test_collective_rpc (#17858) · ec54d73c
  Russell Bryant authored May 08, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  ec54d73c
- [Frontend] Chat template fallbacks for multimodal models (#17805) · 96722aa8
  Cyrus Leung authored May 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  96722aa8
07 May, 2025 1 commit
- [Frontend] Add missing chat templates for various MLLMs (#17758) · 8a15c260
  Cyrus Leung authored May 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8a15c260
01 May, 2025 2 commits
- [Feature][Frontend]: Deprecate --enable-reasoning (#17452) · 98060b00
  Chauncey authored May 01, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  98060b00
- [CI/Build] Reorganize models tests (#17459) · afb4429b
  Cyrus Leung authored May 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  afb4429b
30 Apr, 2025 2 commits

[Core] Prevent side-channel attacks via cache salting (#17045) · 77073c77
Marko Rosenmueller authored Apr 30, 2025
```
Signed-off-by: Marko Rosenmueller <5467316+dr75@users.noreply.github.com>
```
77073c77

Truncation control for embedding models (#14776) · 1c2bc7ea

Gabriel Marinho authored Apr 29, 2025


Signed-off-by: Gabriel Marinho <gmarinho@ibm.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>

1c2bc7ea

29 Apr, 2025 2 commits
- Simplify (and fix) passing of guided decoding backend options (#17008) · a6977dbd
  Harry Mellor authored Apr 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a6977dbd
- [Frontend] Support `chat_template_kwargs` in `LLM.chat` (#17356) · 88ad9ec6
  Cyrus Leung authored Apr 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  88ad9ec6
25 Apr, 2025 2 commits
- [BugFix][Frontend] Fix `LLM.chat()` tokenization (#16081) · 70116459
  Nick Hill authored Apr 25, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  70116459
- [Bugfix] remove fallback in guided_json (int range, patterns) (#16725) · 6aae216b
  Sangyeon Cho authored Apr 25, 2025
```
Signed-off-by: csy1204 <josang1204@gmail.com>
Co-authored-by: 조상연[플레이스 AI] <sang-yeon.cho@navercorp.com>
```
  6aae216b
24 Apr, 2025 1 commit
- [Frontend] Using matryoshka_dimensions control the allowed output dimensions. (#16970) · 67309a1c
  wang.yuqi authored Apr 24, 2025
  
  67309a1c
23 Apr, 2025 2 commits
- [Frontend] Support guidance:no-additional-properties for compatibility with xgrammar (#15949) · 3cde34a4
  Travis Johnson authored Apr 23, 2025
```
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
```
  3cde34a4
- [Bugfix] validate urls object for multimodal content parts (#16990) · 36fe7876
  Guillaume Calmettes authored Apr 23, 2025
```
Signed-off-by: Guillaume Calmettes <gcalmettes@scaleway.com>
```
  36fe7876
19 Apr, 2025 2 commits
- [Misc] Benchmarks for audio models (#16505) · 9d4ca19d
  Nicolò Lucchesi authored Apr 19, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  9d4ca19d
- [Frontend] Add sampling params to `v1/audio/transcriptions` endpoint (#16591) · 2ef0dc53
  Nicolò Lucchesi authored Apr 19, 2025
```
Signed-off-by: Jannis Schönleber <joennlae@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Jannis Schönleber <joennlae@gmail.com>
```
  2ef0dc53
18 Apr, 2025 4 commits
- [New Model]: Snowflake Arctic Embed (Family) (#16649) · 3d3ab368
  wang.yuqi authored Apr 18, 2025
  
  3d3ab368
- Fix `nullable_kvs` fallback (#16837) · 686623c5
  Harry Mellor authored Apr 18, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  686623c5
- Improve-mm-and-pooler-and-decoding-configs (#16789) · e78587a6
  Harry Mellor authored Apr 18, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e78587a6
- Add property-based testing for vLLM endpoints using an API defined by an... · e37073ef
  Tarun Kumar authored Apr 18, 2025
```
Add property-based testing for vLLM endpoints using an API defined by an OpenAPI 3.1 schema (#16721)
Signed-off-by: Tarun Kumar <takumar@redhat.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  e37073ef
15 Apr, 2025 1 commit

[Misc] Enable vLLM to Dynamically Load LoRA from a Remote Server (#10546) · fdcb850f

Angky William authored Apr 15, 2025


Signed-off-by: Angky William <angkywilliam@Angkys-MacBook-Pro.local>
Co-authored-by: Angky William <angkywilliam@Angkys-MacBook-Pro.local>

fdcb850f

14 Apr, 2025 1 commit
- [Core][V0] Enable regex support with xgrammar (#13228) · dc1b4a6f
  Russell Bryant authored Apr 13, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  dc1b4a6f
12 Apr, 2025 4 commits
- [Bugfix] Validate logit biases to prevent out of vocab ids crashing engine (#16529) · 6c11ecf8
  Ryan McConville authored Apr 12, 2025
```
Signed-off-by: Ryan McConville <ryan@ryanmcconville.com>
```
  6c11ecf8
- [V1] Enable multi-input by default (#15799) · d9fc8cd9
  Cyrus Leung authored Apr 12, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d9fc8cd9
- [Misc] Update chat utils tests (#16520) · c5bc0e7f
  Cyrus Leung authored Apr 12, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c5bc0e7f
- [Frontend] support matryoshka representation / support embedding API dimensions (#16331) · fbf722c6
  wang.yuqi authored Apr 12, 2025
  
  fbf722c6
10 Apr, 2025 1 commit
- [V1] Set structured output backend to `auto` by default (#15724) · 9665313c
  Russell Bryant authored Apr 10, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  9665313c
09 Apr, 2025 1 commit
- [CI][Bugfix] Fix bad tolerance for test_batch_base64_embedding (#16221) · 87b4ac56
  Michael Goin authored Apr 08, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  87b4ac56
08 Apr, 2025 2 commits
- [Bugfix] Proper input validation for multi-modal encoder-decoder models (#16156) · 4ebc0b96
  Cyrus Leung authored Apr 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4ebc0b96
- [Bugfix] Do not skip "empty" parts of chats that are parsable (#16219) · b99733d0
  Michael Goin authored Apr 07, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  b99733d0
07 Apr, 2025 1 commit
- [Bugfix][V0] XGrammar structured output supports Enum (#15878) · 24f1c01e
  leon-seidel authored Apr 08, 2025
```
Signed-off-by: Leon Seidel <leon.seidel@fau.de>
```
  24f1c01e
03 Apr, 2025 1 commit
- [TPU] Support sliding window and logit soft capping in the paged attention kernel for TPU. (#15732) · b6be6f8d
  iefgnoix authored Apr 03, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
```
  b6be6f8d
02 Apr, 2025 4 commits

[Frontend] Implement Tool Calling with `tool_choice='required'` (#13483) · cefb9e5a

Matthias Matt authored Apr 02, 2025


Signed-off-by: Liangfu Chen <liangfc@amazon.com>
Signed-off-by: Matt, Matthias <matthias.matt@tuwien.ac.at>
Co-authored-by: Liangfu Chen <liangfc@amazon.com>
Co-authored-by: mgoin <michael@neuralmagic.com>

cefb9e5a

[Metrics] Hide deprecated metrics (#15458) · 98d7367b
Mark McLoughlin authored Apr 02, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
98d7367b

[Bugfix] Fix the issue where the model name is empty string, causing no... · 594a8b90

Chauncey authored Apr 02, 2025


[Bugfix] Fix the issue where the model name is empty string, causing no response with the model name. (#15938)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>

594a8b90

[core] Add tags parameter to wake_up() (#15500) · ddb94c26
Eric Tang authored Apr 02, 2025
```
Signed-off-by: Eric <erictang000@gmail.com>
```
ddb94c26