Commits · 6e244ae09121b2c1cdcd4db51076decc4a724c5c · OpenDAS / vllm_cscc

27 Jun, 2025 1 commit
- [Perf][Frontend] eliminate api_key and x_request_id headers middleware overhead (#19946) · 6e244ae0
  Yazan Sharaya authored Jun 27, 2025
```
Signed-off-by: Yazan-Sharaya <yazan.sharaya.yes@gmail.com>
```
  6e244ae0
25 Jun, 2025 1 commit

[Frontend] Add `/v1/audio/translations` OpenAI API endpoint (#19615) · e795d723

Nicolò Lucchesi authored Jun 25, 2025


Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

e795d723

19 Jun, 2025 2 commits

[Core][Bugfix] Fix Online MM Beam Search (#19688) · ead21102
Alex Brooks authored Jun 19, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
ead21102

Support embedding models in V1 (#16188) · 799397ee

Maximilien de Bayser authored Jun 19, 2025


Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>

799397ee

17 Jun, 2025 1 commit
- [Frontend] add chunking audio for > 30s audio (#19597) · ede5c4eb
  nguyenhoangthuan99 authored Jun 17, 2025
```
Signed-off-by: nguyenhoangthuan99 <thuanhppro12@gmail.com>
```
  ede5c4eb
16 Jun, 2025 1 commit
- [CI] Add mteb testing for rerank models (#19344) · f40f763f
  wang.yuqi authored Jun 16, 2025
  
  f40f763f
12 Jun, 2025 1 commit
- [CI] change spell checker from codespell to typos (#18711) · 2f1c19b2
  Ning Xie authored Jun 12, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  2f1c19b2
11 Jun, 2025 1 commit
- Fix test_max_model_len in tests/entrypoints/llm/test_generate.py (#19451) · 2b1e2111
  Lu Fang authored Jun 11, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  2b1e2111
09 Jun, 2025 1 commit
- [Bugfix][Core] Prevent token lengths exceeding `max_model_len` in V0 (#19348) · c1c7dbbe
  22quinn authored Jun 09, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  c1c7dbbe
07 Jun, 2025 1 commit
- [Easy][Test] Simplify test_function_tool_use with multiple parametrizes (#19269) · 6e0cd10f
  Lu Fang authored Jun 07, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  6e0cd10f
05 Jun, 2025 1 commit
- [Bugfix]: Fix the incompatibility issue with stream when Thinking is disabled (#19135) · 8fc57501
  Chauncey authored Jun 05, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  8fc57501
03 Jun, 2025 2 commits
- [Bugfix]: Fix the incompatibility issue with tool_choice 'required' when... · 4de790fc
  Chauncey authored Jun 04, 2025
```
[Bugfix]: Fix the incompatibility issue with tool_choice 'required' when Thinking is enabled (#19075)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  4de790fc
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
31 May, 2025 2 commits
- [Misc] add return token strs for tokenize (#18941) · 20079c6e
  Reid authored Jun 01, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  20079c6e
- [Frontend] Add rerank support to run_batch endpoint (#16278) · dff80b0e
  Pooya Davoodi authored May 31, 2025
```
Signed-off-by: Pooya Davoodi <pooya.davoodi@parasail.io>
```
  dff80b0e
30 May, 2025 2 commits
- Tool parser regex timeout handling (#18960) · 1dab4d57
  Will Eaton authored May 30, 2025
```
Signed-off-by: Will Eaton <weaton@redhat.com>
```
  1dab4d57
- [Perf] API-server scaleout with many-to-many server-engine comms (#17546) · 2dbe8c07
  Nick Hill authored May 30, 2025
  
  2dbe8c07
29 May, 2025 1 commit
- [Deprecation] Disallow pos-args other than `model` when initializing `LLM` (#18802) · c2903403
  Cyrus Leung authored May 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c2903403
28 May, 2025 4 commits
- [V1][Metrics] Remove metrics that were deprecated in 0.8 (#18837) · 0e98964e
  Mark McLoughlin authored May 28, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  0e98964e
- [Core] Add Lora Support to Beam Search (#18346) · 321331b8
  Alex Brooks authored May 28, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  321331b8
- [Frontend] add run batch to CLI (#18804) · 435fa954
  Reid authored May 28, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  435fa954
- [CI] improve embed testing (#18747) · de65fc8e
  wang.yuqi authored May 28, 2025
  
  de65fc8e
26 May, 2025 1 commit
- [CI/Build] Replace `math.isclose` with `pytest.approx` (#18703) · 38b13dfe
  Cyrus Leung authored May 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  38b13dfe
23 May, 2025 2 commits

[Bugfix] Migrate to REGEX Library to prevent catastrophic backtracking (#18454) · 4fc1bf81
Feng XiaoLong authored May 24, 2025
```
Signed-off-by: Crucifixion-Fxl <xmufxl@gmail.com>
Co-authored-by: Crucifixion-Fxl <xmufxl@gmail.com>
```
4fc1bf81

[Frontend] [Core] Add Tensorizer support for V1, LoRA adapter serialization... · c32e249a

Sanger Steel authored May 22, 2025


[Frontend] [Core] Add Tensorizer support for V1, LoRA adapter serialization and deserialization (#17926)
Signed-off-by: Sanger Steel <sangersteel@gmail.com>

c32e249a

22 May, 2025 2 commits
- [Frontend][Bug Fix] Update llama4 pythonic jinja template and llama4_pythonic parser (#17917) · c91fe7b1
  Kai Wu authored May 22, 2025
```
Signed-off-by: Kai Wu <kaiwu@meta.com>
```
  c91fe7b1
- [Bugfix] make `test_openai_schema.py` pass (#18224) · 1f3a1200
  David Xia authored May 22, 2025
```
Signed-off-by: David Xia <david@davidxia.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  1f3a1200
20 May, 2025 1 commit
- [CI] Add mteb testing to test the accuracy of the embedding model (#17175) · 86847700
  wang.yuqi authored May 20, 2025
  
  86847700
19 May, 2025 1 commit

Feature/vllm/input embedding completion api (#17590) · 221cfc2f

Nan Qin authored May 18, 2025


Signed-off-by: Andrew Sansom <andrew@protopia.ai>
Signed-off-by: Nan2018 <nan@protopia.ai>
Co-authored-by: 临景 <linjing.yx@alibaba-inc.com>
Co-authored-by: Bryce1010 <bryceyx@gmail.com>
Co-authored-by: Andrew Sansom <andrew@protopia.ai>
Co-authored-by: Andrew Sansom <qthequartermasterman@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

221cfc2f

15 May, 2025 1 commit
- add tools into TokenizeChatRequest (#18187) · 451da4bc
  hustxiayang authored May 15, 2025
```
Signed-off-by: yangxia <yangxiast@gmail.com>
```
  451da4bc
14 May, 2025 3 commits
- [Bugfix] Fix chat utils tests (#18139) · d066e520
  Cyrus Leung authored May 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d066e520
- [Bugfix] Fix entrypoints audio test failure (#18111) · 8f5dc414
  Cyrus Leung authored May 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8f5dc414
- [Fix] Move "model_config" as keyword args in chat_utils.py (#18098) · 6685890d
  lkchen authored May 13, 2025
```
Signed-off-by: Linkun <github@lkchen.net>
```
  6685890d
13 May, 2025 1 commit

[Feature][V1] Support `tool_choice: required` when using Xgrammar as the... · dc1a8217

Chauncey authored May 13, 2025


[Feature][V1]  Support `tool_choice: required` when using Xgrammar as the `StructuredOutputBackend`. (#17845)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>

dc1a8217

12 May, 2025 1 commit
- Initialize the delta tool call fields explicitly (#17340) · 05a4324f
  Maximilien de Bayser authored May 12, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: igmainc <igmainc@icloud.com>
```
  05a4324f
11 May, 2025 1 commit
- [Frontend] Add /classify endpoint (#17032) · 9cea90ea
  Frieda Huang authored May 11, 2025
```
Signed-off-by: Frieda (Jingying) Huang <jingyingfhuang@gmail.com>
```
  9cea90ea
10 May, 2025 1 commit

Add missing content type headers to /ping and /health (#17036) (#17786) · fc4441a4

Ximo Guanter authored May 10, 2025


Signed-off-by: Ximo Guanter <ximo.guanter@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

fc4441a4

08 May, 2025 2 commits
- [CI] Fix test_collective_rpc (#17858) · ec54d73c
  Russell Bryant authored May 08, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  ec54d73c
- [Frontend] Chat template fallbacks for multimodal models (#17805) · 96722aa8
  Cyrus Leung authored May 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  96722aa8
07 May, 2025 1 commit
- [Frontend] Add missing chat templates for various MLLMs (#17758) · 8a15c260
  Cyrus Leung authored May 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8a15c260