Commits · 02f0c7b220422792f5e53de2a7d51d2d3ff2df28 · OpenDAS / vllm_cscc

03 Jun, 2025 2 commits
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
- [V1] Support DP with Ray (#18779) · bdce64f2
  Rui Qiao authored Jun 02, 2025
  
  bdce64f2
02 Jun, 2025 1 commit
- [Frontend] enable custom logging for the uvicorn server (OpenAI API server) (#18403) · 20133cfe
  Frαnçois authored Jun 02, 2025
```
Signed-off-by: François Paupier <francois.paupier@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  20133cfe
31 May, 2025 3 commits
- [Misc] add return token strs for tokenize (#18941) · 20079c6e
  Reid authored Jun 01, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  20079c6e
- fix security issue of logging llm output (#18980) · b8b90479
  Lucia Fang authored May 31, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
Co-authored-by: Lucia (Lu) Fang <fanglu@meta.com>
```
  b8b90479
- [Frontend] Add rerank support to run_batch endpoint (#16278) · dff80b0e
  Pooya Davoodi authored May 31, 2025
```
Signed-off-by: Pooya Davoodi <pooya.davoodi@parasail.io>
```
  dff80b0e
30 May, 2025 3 commits
- Tool parser regex timeout handling (#18960) · 1dab4d57
  Will Eaton authored May 30, 2025
```
Signed-off-by: Will Eaton <weaton@redhat.com>
```
  1dab4d57
- [Perf] API-server scaleout with many-to-many server-engine comms (#17546) · 2dbe8c07
  Nick Hill authored May 30, 2025
  
  2dbe8c07
- [Bugfix] Consistent ascii handling in tool parsers (#18883) · 77164dad
  Chauncey authored May 30, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  77164dad
29 May, 2025 2 commits
- [Deprecation] Disallow pos-args other than `model` when initializing `LLM` (#18802) · c2903403
  Cyrus Leung authored May 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c2903403
- [Misc] Replace TODO in serving transcription (#18895) · 24d0ef89
  Nicolò Lucchesi authored May 29, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  24d0ef89
28 May, 2025 6 commits
- [Core] Add Lora Support to Beam Search (#18346) · 321331b8
  Alex Brooks authored May 28, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  321331b8
- decrement server_load on listen for disconnect (#18784) · 6e4cea1c
  daniel-salib authored May 28, 2025
```
Signed-off-by: Daniel Salib <danielsalib@meta.com>
```
  6e4cea1c
- [Frontend] add run batch to CLI (#18804) · 435fa954
  Reid authored May 28, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  435fa954
- Enable Pydantic mypy checks and convert configs to Pydantic dataclasses (#17599) · 4c2b38ce
  Harry Mellor authored May 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4c2b38ce
- [Deprecation] Remove fallbacks for Embeddings API (#18795) · 0c492b78
  Cyrus Leung authored May 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0c492b78
- [Bugfix]: correctly propagate errors message caught at the chat_templating... · 9a21e331
  Guillaume Calmettes authored May 28, 2025
```
[Bugfix]: correctly propagate errors message caught at the chat_templating step to the client (#18769)
Signed-off-by: Guillaume Calmettes <gcalmettes@scaleway.com>
```
  9a21e331
27 May, 2025 3 commits
- [V1][Metrics] Add API for accessing in-memory Prometheus metrics (#17010) · 06a03380
  Mark McLoughlin authored May 27, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  06a03380
- [CI/Build] Remove imports of built-in `re` (#18750) · 4318c055
  Cyrus Leung authored May 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4318c055
- [Doc] Convert Sphinx directives ( `{class}`, `{meth}`, `{attr}`, ...) to... · a68e293c
  Hyogeun Oh (오효근) authored May 27, 2025
```
[Doc]  Convert Sphinx directives ( `{class}`, `{meth}`, `{attr}`, ...) to MkDocs format for better documentation linking (#18663)
Signed-off-by: Zerohertz <ohg3417@gmail.com>
```
  a68e293c
26 May, 2025 1 commit
- refactor: simplify request handler, use positive condition check for handler assignment (#18690) · abd4030d
  CYJiang authored May 26, 2025
```
Signed-off-by: googs1025 <googs1025@gmail.com>
```
  abd4030d
25 May, 2025 1 commit
- [VLM] Initialize video input support for InternVL models (#18499) · 75f81750
  Isotr0py authored May 25, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  75f81750
24 May, 2025 1 commit

[Frontend] improve vllm serve --help display (#18643) · 441dc63a

Reid authored May 24, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

441dc63a

23 May, 2025 4 commits
- [Bugfix] Migrate to REGEX Library to prevent catastrophic backtracking (#18454) · 4fc1bf81
  Feng XiaoLong authored May 24, 2025
```
Signed-off-by: Crucifixion-Fxl <xmufxl@gmail.com>
Co-authored-by: Crucifixion-Fxl <xmufxl@gmail.com>
```
  4fc1bf81
- [Doc] Fix top-level API links/docs (#18621) · 273cb3b4
  Cyrus Leung authored May 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  273cb3b4
- Migrate docs from Sphinx to MkDocs (#18145) · a1fe24d9
  Harry Mellor authored May 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a1fe24d9
- [Misc] refactor: simplify input validation and num_requests handling in _convert_v1_inputs (#18482) · fae453f8
  CYJiang authored May 23, 2025
```
Signed-off-by: googs1025 <googs1025@gmail.com>
```
  fae453f8
22 May, 2025 1 commit
- [Frontend][Bug Fix] Update llama4 pythonic jinja template and llama4_pythonic parser (#17917) · c91fe7b1
  Kai Wu authored May 22, 2025
```
Signed-off-by: Kai Wu <kaiwu@meta.com>
```
  c91fe7b1
21 May, 2025 1 commit
- [Bugfix] Consistent ascii handling in tool parsers (#17704) · 1f079540
  Sebastian Schoennenbeck authored May 21, 2025
```
Signed-off-by: Sebastian Schönnenbeck <sebastian.schoennenbeck@comma-soft.com>
```
  1f079540
19 May, 2025 2 commits

[Frontend] add --quick option for vllm chat/complete (#18297) · 20d8ce81
Reid authored May 20, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
20d8ce81

Feature/vllm/input embedding completion api (#17590) · 221cfc2f

Nan Qin authored May 18, 2025


Signed-off-by: Andrew Sansom <andrew@protopia.ai>
Signed-off-by: Nan2018 <nan@protopia.ai>
Co-authored-by: 临景 <linjing.yx@alibaba-inc.com>
Co-authored-by: Bryce1010 <bryceyx@gmail.com>
Co-authored-by: Andrew Sansom <andrew@protopia.ai>
Co-authored-by: Andrew Sansom <qthequartermasterman@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

221cfc2f

16 May, 2025 1 commit
- [Fix] Fix typo in `resolve_hf_chat_template` (#18259) · a5f8c111
  fxmarty-amd authored May 16, 2025
```
Signed-off-by: Felix Marty <felmarty@amd.com>
```
  a5f8c111
15 May, 2025 3 commits
- [Frontend] Fix chat template content format detection (#18190) · 2aa5470a
  Sebastian Schoennenbeck authored May 15, 2025
```
Signed-off-by: Sebastian Schönnenbeck <sebastian.schoennenbeck@comma-soft.com>
```
  2aa5470a
- add tools into TokenizeChatRequest (#18187) · 451da4bc
  hustxiayang authored May 15, 2025
```
Signed-off-by: yangxia <yangxiast@gmail.com>
```
  451da4bc
- [Bugfix]: make most of `test_openai_schema.py` pass (#17664) · f25e0d11
  David Xia authored May 14, 2025
  
  f25e0d11
14 May, 2025 1 commit
- [Fix] Move "model_config" as keyword args in chat_utils.py (#18098) · 6685890d
  lkchen authored May 13, 2025
```
Signed-off-by: Linkun <github@lkchen.net>
```
  6685890d
13 May, 2025 4 commits
- [V1] DP scale-out (2/N): Decouple engine process management and comms (#15977) · 55aa7af9
  Nick Hill authored May 13, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  55aa7af9
- [Bugfix] Fix entrypoints metrics tests (#18063) · b922c2eb
  Cyrus Leung authored May 13, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b922c2eb
- [Fix] check to make sure processor has chat templates (#18047) · cb528d05
  Aaron Pham authored May 13, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  cb528d05
- [Bugfix] Avoid repeatedly creating dummy data during engine startup (#17935) · 61e0a506
  Cyrus Leung authored May 13, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  61e0a506