Commits · c5bc0e7fcce38c4a1aa4fae827a222d4014f6294 · OpenDAS / vllm_cscc

12 Apr, 2025 2 commits
- [Misc] Update chat utils tests (#16520) · c5bc0e7f
  Cyrus Leung authored Apr 12, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c5bc0e7f
- [Frontend] support matryoshka representation / support embedding API dimensions (#16331) · fbf722c6
  wang.yuqi authored Apr 12, 2025
  
  fbf722c6
10 Apr, 2025 1 commit
- [V1] Set structured output backend to `auto` by default (#15724) · 9665313c
  Russell Bryant authored Apr 10, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  9665313c
09 Apr, 2025 1 commit
- [CI][Bugfix] Fix bad tolerance for test_batch_base64_embedding (#16221) · 87b4ac56
  Michael Goin authored Apr 08, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  87b4ac56
08 Apr, 2025 2 commits
- [Bugfix] Proper input validation for multi-modal encoder-decoder models (#16156) · 4ebc0b96
  Cyrus Leung authored Apr 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4ebc0b96
- [Bugfix] Do not skip "empty" parts of chats that are parsable (#16219) · b99733d0
  Michael Goin authored Apr 07, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  b99733d0
07 Apr, 2025 1 commit
- [Bugfix][V0] XGrammar structured output supports Enum (#15878) · 24f1c01e
  leon-seidel authored Apr 08, 2025
```
Signed-off-by: Leon Seidel <leon.seidel@fau.de>
```
  24f1c01e
03 Apr, 2025 1 commit
- [TPU] Support sliding window and logit soft capping in the paged attention kernel for TPU. (#15732) · b6be6f8d
  iefgnoix authored Apr 03, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
```
  b6be6f8d
02 Apr, 2025 4 commits

[Frontend] Implement Tool Calling with `tool_choice='required'` (#13483) · cefb9e5a

Matthias Matt authored Apr 02, 2025


Signed-off-by: Liangfu Chen <liangfc@amazon.com>
Signed-off-by: Matt, Matthias <matthias.matt@tuwien.ac.at>
Co-authored-by: Liangfu Chen <liangfc@amazon.com>
Co-authored-by: mgoin <michael@neuralmagic.com>

cefb9e5a

[Metrics] Hide deprecated metrics (#15458) · 98d7367b
Mark McLoughlin authored Apr 02, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
98d7367b

[Bugfix] Fix the issue where the model name is empty string, causing no... · 594a8b90

Chauncey authored Apr 02, 2025


[Bugfix] Fix the issue where the model name is empty string, causing no response with the model name. (#15938)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>

594a8b90

[core] Add tags parameter to wake_up() (#15500) · ddb94c26
Eric Tang authored Apr 02, 2025
```
Signed-off-by: Eric <erictang000@gmail.com>
```
ddb94c26

01 Apr, 2025 1 commit

[Misc] Enable V1 LoRA by default (#15320) · 79455cf4

Varun Sundar Rabindranath authored Apr 01, 2025


Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>

79455cf4

31 Mar, 2025 1 commit
- [V1] TPU CI - Add basic perf regression test (#15414) · 9a2160fa
  Alexander Matveev authored Mar 31, 2025
```
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
```
  9a2160fa
30 Mar, 2025 1 commit
- fix test_phi3v (#15321) · 7fd8c0f8
  pansicheng authored Mar 30, 2025
```
Signed-off-by: pansicheng <sicheng.pan.chn@gmail.com>
```
  7fd8c0f8
29 Mar, 2025 1 commit

[Bugfix] LoRA V1: add and fix entrypoints tests (#15715) · 1286211f

Varun Sundar Rabindranath authored Mar 28, 2025


Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>

1286211f

28 Mar, 2025 3 commits
- [V1] Support disable_any_whtespace for guidance backend (#15584) · 7329ff54
  Russell Bryant authored Mar 28, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  7329ff54
- [Misc] Fix test_sleep to use query parameters (#14373) · a10314c6
  Lize Cai authored Mar 28, 2025
```
Signed-off-by: Lize Cai <lize.cai@sap.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  a10314c6
- [Refactor][Frontend] Keep all logic about reasoning into one class (#14428) · 32b14baf
  Ce Gao authored Mar 28, 2025
```
Signed-off-by: Ce Gao <cegao@tensorchord.ai>
```
  32b14baf
26 Mar, 2025 2 commits
- [Model] Add Reasoning Parser for Granite Models (#14202) · 1711b929
  Alex Brooks authored Mar 26, 2025
```
Signed-off-by: Alex-Brooks <Alex.brooks@ibm.com>
Co-authored-by: Joe Runde <joe@joerun.de>
```
  1711b929
- [Misc] Enhance warning information to user-defined chat template (#15408) · 99f536f8
  wwl2755 authored Mar 26, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
  99f536f8
24 Mar, 2025 1 commit

[Bugfix] Fix chat template loading (#15143) · cbcdf2c6

Cyrus Leung authored Mar 24, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

cbcdf2c6

23 Mar, 2025 2 commits
- [Frontend] Support tool calling and reasoning parser (#14511) · d6cd59f1
  Robin authored Mar 24, 2025
```
Signed-off-by: WangErXiao <863579016@qq.com>
```
  d6cd59f1
- [ci/build] fix broken tests in LLM.collective_rpc (#15350) · f68cce8e
  youkaichao authored Mar 23, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  f68cce8e
20 Mar, 2025 1 commit

[Core][V0] Add guidance backend for structured output (#14589) · 1f16b7fe

Russell Bryant authored Mar 20, 2025


Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Loc Huynh <lohuynh@microsoft.com>
Co-authored-by: Michal Moskal <michal@moskal.me>
Co-authored-by: Aaron Pham <contact@aarnphm.xyz>

1f16b7fe

19 Mar, 2025 1 commit
- [Core] Update dtype detection and defaults (#14858) · f690372b
  Cyrus Leung authored Mar 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f690372b
17 Mar, 2025 2 commits

[Bugfix][ROCm] running new process using spawn method for rocm in tests. (#14810) · 2bb0e1a7

vllmellm authored Mar 17, 2025


Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

2bb0e1a7

[Misc] Replace os environ to monkeypatch in test suite (#14516) · a73e183e

Sibi authored Mar 17, 2025


Signed-off-by: sibi <85477603+t-sibiraj@users.noreply.github.com>
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Aaron Pham <contact@aarnphm.xyz>

a73e183e

15 Mar, 2025 2 commits

[Core] Expose API endpoint `/is_sleeping` (#14312) · 74bc397b
Jun Duan authored Mar 15, 2025
```
Signed-off-by: Jun Duan <jun.duan.phd@outlook.com>
```
74bc397b

[V1] V1 Enablement Oracle (#13726) · d4d93db2

Robert Shaw authored Mar 15, 2025


Signed-off-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>

d4d93db2

14 Mar, 2025 1 commit
- [Frontend] track server_load (#13950) · 73deea2f
  daniel-salib authored Mar 14, 2025
  
  73deea2f
08 Mar, 2025 3 commits
- [V1] TPU - Add tensor parallel support via Ray (#13618) · cb8bdfad
  Alexander Matveev authored Mar 08, 2025
```
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
```
  cb8bdfad
- [CI/Build] Use a fixed seed to avoid flaky tests (#14480) · 33f227e1
  Cyrus Leung authored Mar 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  33f227e1
- Default to `generation_config` from model (#12622) · 47512b32
  Harry Mellor authored Mar 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  47512b32
07 Mar, 2025 1 commit
- [Misc] Set default value of seed to None (#14274) · cc102814
  மனோஜ்குமார் பழனிச்சாமி authored Mar 07, 2025
```
Signed-off-by: மனோஜ்குமார் பழனிச்சாமி <smartmanoj42857@gmail.com>
```
  cc102814
06 Mar, 2025 1 commit
- [Frontend][Docs] Transcription API streaming (#13301) · fa82b938
  Nicolò Lucchesi authored Mar 06, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  fa82b938
05 Mar, 2025 1 commit
- [Frontend] Allow return_tokens_as_token_ids to be passed as a request param (#14066) · 32985bed
  Benjamin Chislett authored Mar 05, 2025
```
Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
```
  32985bed
03 Mar, 2025 2 commits
- [WIP][[V1][Metrics] Implement max_num_generation_tokens, request_params_n,... · ae122b1c
  Mark McLoughlin authored Mar 03, 2025
```
[WIP][[V1][Metrics] Implement max_num_generation_tokens,  request_params_n, and request_params_max_tokens metrics (#14055)
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  ae122b1c
- Update deprecated Python 3.8 typing (#13971) · cf069aa8
  Harry Mellor authored Mar 03, 2025
  
  cf069aa8
28 Feb, 2025 1 commit
- Fix entrypoint tests for embedding models (#14052) · 4be4b26c
  Harry Mellor authored Feb 28, 2025
  
  4be4b26c