Commits · aadb6565628cbc3b56cfc20df245ad36de675262 · OpenDAS / vllm_cscc

18 Apr, 2025 2 commits

Improve-mm-and-pooler-and-decoding-configs (#16789) · e78587a6
Harry Mellor authored Apr 18, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
e78587a6

Add property-based testing for vLLM endpoints using an API defined by an... · e37073ef

Tarun Kumar authored Apr 18, 2025


Add property-based testing for vLLM endpoints using an API defined by an OpenAPI 3.1 schema (#16721)
Signed-off-by: Tarun Kumar <takumar@redhat.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

e37073ef

15 Apr, 2025 1 commit

[Misc] Enable vLLM to Dynamically Load LoRA from a Remote Server (#10546) · fdcb850f

Angky William authored Apr 15, 2025


Signed-off-by: Angky William <angkywilliam@Angkys-MacBook-Pro.local>
Co-authored-by: Angky William <angkywilliam@Angkys-MacBook-Pro.local>

fdcb850f

14 Apr, 2025 1 commit
- [Core][V0] Enable regex support with xgrammar (#13228) · dc1b4a6f
  Russell Bryant authored Apr 13, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  dc1b4a6f
12 Apr, 2025 4 commits
- [Bugfix] Validate logit biases to prevent out of vocab ids crashing engine (#16529) · 6c11ecf8
  Ryan McConville authored Apr 12, 2025
```
Signed-off-by: Ryan McConville <ryan@ryanmcconville.com>
```
  6c11ecf8
- [V1] Enable multi-input by default (#15799) · d9fc8cd9
  Cyrus Leung authored Apr 12, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d9fc8cd9
- [Misc] Update chat utils tests (#16520) · c5bc0e7f
  Cyrus Leung authored Apr 12, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c5bc0e7f
- [Frontend] support matryoshka representation / support embedding API dimensions (#16331) · fbf722c6
  wang.yuqi authored Apr 12, 2025
  
  fbf722c6
10 Apr, 2025 1 commit
- [V1] Set structured output backend to `auto` by default (#15724) · 9665313c
  Russell Bryant authored Apr 10, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  9665313c
09 Apr, 2025 1 commit
- [CI][Bugfix] Fix bad tolerance for test_batch_base64_embedding (#16221) · 87b4ac56
  Michael Goin authored Apr 08, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  87b4ac56
08 Apr, 2025 2 commits
- [Bugfix] Proper input validation for multi-modal encoder-decoder models (#16156) · 4ebc0b96
  Cyrus Leung authored Apr 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4ebc0b96
- [Bugfix] Do not skip "empty" parts of chats that are parsable (#16219) · b99733d0
  Michael Goin authored Apr 07, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  b99733d0
07 Apr, 2025 1 commit
- [Bugfix][V0] XGrammar structured output supports Enum (#15878) · 24f1c01e
  leon-seidel authored Apr 08, 2025
```
Signed-off-by: Leon Seidel <leon.seidel@fau.de>
```
  24f1c01e
03 Apr, 2025 1 commit
- [TPU] Support sliding window and logit soft capping in the paged attention kernel for TPU. (#15732) · b6be6f8d
  iefgnoix authored Apr 03, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
```
  b6be6f8d
02 Apr, 2025 4 commits

[Frontend] Implement Tool Calling with `tool_choice='required'` (#13483) · cefb9e5a

Matthias Matt authored Apr 02, 2025


Signed-off-by: Liangfu Chen <liangfc@amazon.com>
Signed-off-by: Matt, Matthias <matthias.matt@tuwien.ac.at>
Co-authored-by: Liangfu Chen <liangfc@amazon.com>
Co-authored-by: mgoin <michael@neuralmagic.com>

cefb9e5a

[Metrics] Hide deprecated metrics (#15458) · 98d7367b
Mark McLoughlin authored Apr 02, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
98d7367b

[Bugfix] Fix the issue where the model name is empty string, causing no... · 594a8b90

Chauncey authored Apr 02, 2025


[Bugfix] Fix the issue where the model name is empty string, causing no response with the model name. (#15938)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>

594a8b90

[core] Add tags parameter to wake_up() (#15500) · ddb94c26
Eric Tang authored Apr 02, 2025
```
Signed-off-by: Eric <erictang000@gmail.com>
```
ddb94c26

01 Apr, 2025 1 commit

[Misc] Enable V1 LoRA by default (#15320) · 79455cf4

Varun Sundar Rabindranath authored Apr 01, 2025


Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>

79455cf4

31 Mar, 2025 1 commit
- [V1] TPU CI - Add basic perf regression test (#15414) · 9a2160fa
  Alexander Matveev authored Mar 31, 2025
```
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
```
  9a2160fa
30 Mar, 2025 1 commit
- fix test_phi3v (#15321) · 7fd8c0f8
  pansicheng authored Mar 30, 2025
```
Signed-off-by: pansicheng <sicheng.pan.chn@gmail.com>
```
  7fd8c0f8
29 Mar, 2025 1 commit

[Bugfix] LoRA V1: add and fix entrypoints tests (#15715) · 1286211f

Varun Sundar Rabindranath authored Mar 28, 2025


Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>

1286211f

28 Mar, 2025 3 commits
- [V1] Support disable_any_whtespace for guidance backend (#15584) · 7329ff54
  Russell Bryant authored Mar 28, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  7329ff54
- [Misc] Fix test_sleep to use query parameters (#14373) · a10314c6
  Lize Cai authored Mar 28, 2025
```
Signed-off-by: Lize Cai <lize.cai@sap.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  a10314c6
- [Refactor][Frontend] Keep all logic about reasoning into one class (#14428) · 32b14baf
  Ce Gao authored Mar 28, 2025
```
Signed-off-by: Ce Gao <cegao@tensorchord.ai>
```
  32b14baf
26 Mar, 2025 2 commits
- [Model] Add Reasoning Parser for Granite Models (#14202) · 1711b929
  Alex Brooks authored Mar 26, 2025
```
Signed-off-by: Alex-Brooks <Alex.brooks@ibm.com>
Co-authored-by: Joe Runde <joe@joerun.de>
```
  1711b929
- [Misc] Enhance warning information to user-defined chat template (#15408) · 99f536f8
  wwl2755 authored Mar 26, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
  99f536f8
24 Mar, 2025 1 commit

[Bugfix] Fix chat template loading (#15143) · cbcdf2c6

Cyrus Leung authored Mar 24, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

cbcdf2c6

23 Mar, 2025 2 commits
- [Frontend] Support tool calling and reasoning parser (#14511) · d6cd59f1
  Robin authored Mar 24, 2025
```
Signed-off-by: WangErXiao <863579016@qq.com>
```
  d6cd59f1
- [ci/build] fix broken tests in LLM.collective_rpc (#15350) · f68cce8e
  youkaichao authored Mar 23, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  f68cce8e
20 Mar, 2025 1 commit

[Core][V0] Add guidance backend for structured output (#14589) · 1f16b7fe

Russell Bryant authored Mar 20, 2025


Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Loc Huynh <lohuynh@microsoft.com>
Co-authored-by: Michal Moskal <michal@moskal.me>
Co-authored-by: Aaron Pham <contact@aarnphm.xyz>

1f16b7fe

19 Mar, 2025 1 commit
- [Core] Update dtype detection and defaults (#14858) · f690372b
  Cyrus Leung authored Mar 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f690372b
17 Mar, 2025 2 commits

[Bugfix][ROCm] running new process using spawn method for rocm in tests. (#14810) · 2bb0e1a7

vllmellm authored Mar 17, 2025


Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

2bb0e1a7

[Misc] Replace os environ to monkeypatch in test suite (#14516) · a73e183e

Sibi authored Mar 17, 2025


Signed-off-by: sibi <85477603+t-sibiraj@users.noreply.github.com>
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Aaron Pham <contact@aarnphm.xyz>

a73e183e

15 Mar, 2025 2 commits

[Core] Expose API endpoint `/is_sleeping` (#14312) · 74bc397b
Jun Duan authored Mar 15, 2025
```
Signed-off-by: Jun Duan <jun.duan.phd@outlook.com>
```
74bc397b

[V1] V1 Enablement Oracle (#13726) · d4d93db2

Robert Shaw authored Mar 15, 2025


Signed-off-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>

d4d93db2

14 Mar, 2025 1 commit
- [Frontend] track server_load (#13950) · 73deea2f
  daniel-salib authored Mar 14, 2025
  
  73deea2f
08 Mar, 2025 3 commits
- [V1] TPU - Add tensor parallel support via Ray (#13618) · cb8bdfad
  Alexander Matveev authored Mar 08, 2025
```
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
```
  cb8bdfad
- [CI/Build] Use a fixed seed to avoid flaky tests (#14480) · 33f227e1
  Cyrus Leung authored Mar 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  33f227e1
- Default to `generation_config` from model (#12622) · 47512b32
  Harry Mellor authored Mar 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  47512b32