Commits · 34ddcf9ff433a9a80657ec507a57c049d7ef8183 · OpenDAS / vllm_cscc

25 Jul, 2025 1 commit
- [Frontend] `run-batch` supports V1 (#21541) · 34ddcf9f
  Cyrus Leung authored Jul 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  34ddcf9f
24 Jul, 2025 6 commits

[Feat] Allow custom naming of vLLM processes (#21445) · 6da00785
Chauncey authored Jul 24, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
6da00785

Replace `--expand-tools-even-if-tool-choice-none` with... · 6eca337c

Shintarou Okada authored Jul 24, 2025

Replace `--expand-tools-even-if-tool-choice-none` with `--exclude-tools-when-tool-choice-none` for v0.10.0 (#20544)
Signed-off-by: okada <kokuzen@gmail.com>
Signed-off-by: okada shintarou <okada@preferred.jp>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6eca337c

remove GLM-4.5 quantization wrong Code (#21435) · 85bda9e7
Yuxuan Zhang authored Jul 24, 2025

85bda9e7
Add think chunk (#21333) · 6d8d0a24
Julien Denize authored Jul 24, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
6d8d0a24

[DP] Internal Load Balancing Per Node [`one-pod-per-node`] (#21238) · d5b981f8

Robert Shaw authored Jul 23, 2025


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

d5b981f8

[Frontend] Set MAX_AUDIO_CLIP_FILESIZE_MB via env var instead of hardcoding (#21374) · 63d92abb
deven-labovitch authored Jul 23, 2025
```
Signed-off-by: Deven Labovitch <deven@videa.ai>
```
63d92abb

23 Jul, 2025 2 commits
- [V0 Deprecation] Remove Prompt Adapters (#20588) · 82ec66f5
  Michael Goin authored Jul 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  82ec66f5
- [Bugfix] ensure tool_choice is popped when `tool_choice:null` is passed in json payload (#19679) · 7aaa2bd5
  Guillaume Calmettes authored Jul 23, 2025
```
Signed-off-by: Guillaume Calmettes <gcalmettes@scaleway.com>
```
  7aaa2bd5
22 Jul, 2025 2 commits
- [Model] Add Qwen3CoderToolParser (#21396) · 4594fc3b
  Yiheng Xu authored Jul 22, 2025
```
Signed-off-by: simon-mo <xmo@berkeley.edu>
Co-authored-by: simon-mo <xmo@berkeley.edu>
```
  4594fc3b
- Add tokenization_kwargs to encode for embedding model truncation (#21033) · 44554a00
  Wang Yijun authored Jul 22, 2025
  
  44554a00
21 Jul, 2025 1 commit
- [Model][1/N] Support multiple poolers at model level (#21227) · 042af0c8
  Cyrus Leung authored Jul 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  042af0c8
19 Jul, 2025 3 commits

GLM-4 Update (#20736) · 10eb24cc

Yuxuan Zhang authored Jul 20, 2025


Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Lu Fang <fanglu@fb.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Lu Fang <fanglu@fb.com>

10eb24cc

[Bugfix][Frontend] Fix openai CLI arg `middleware` (#21220) · b3d82108
22quinn authored Jul 19, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
b3d82108
Elastic Expert Parallel Initial Support (#20775) · 21793722
Rui Qiao authored Jul 18, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
21793722

18 Jul, 2025 1 commit
- [Core] Set pooling params based on task and model (#21128) · 45badd05
  Cyrus Leung authored Jul 18, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  45badd05
17 Jul, 2025 4 commits
- [Model] Update pooling model interface (#21058) · 90bd2ab6
  Cyrus Leung authored Jul 18, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  90bd2ab6
- [Misc] Avoid unnecessary import (#21106) · 89e3c4e9
  wangxiyuan authored Jul 17, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  89e3c4e9
- [Model] Add ToolParser and MoE Config for Hunyuan A13B (#20820) · 5a7fb3ab
  Asher authored Jul 17, 2025
```
Signed-off-by: Asher Zhang <asherszhang@tencent.com>
```
  5a7fb3ab
- [Bugfix]: Fix final_res_batch list index out of range error (#21055) · fdc5b43d
  Chauncey authored Jul 17, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  fdc5b43d
16 Jul, 2025 4 commits
- feat - add a new endpoint `get_tokenizer_info` to provide... · 18bdcf41
  Mac Misiura authored Jul 16, 2025
```
feat - add a new endpoint `get_tokenizer_info` to provide tokenizer/chat-template information (#20575)
Signed-off-by: m-misiura <mmisiura@redhat.com>
```
  18bdcf41
- [CI] update typos config for CI pre-commit and fix some spells (#20919) · 1eb2b9c1
  Peter Pan authored Jul 16, 2025
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
```
  1eb2b9c1
- [Frontend] Remove print left in FrontendArgs.add_cli_args (#21004) · 153c6f1e
  Michael Goin authored Jul 15, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  153c6f1e
- [Frontend] OpenAI Responses API supports input image (#20975) · 34cda778
  Chauncey authored Jul 16, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  34cda778
15 Jul, 2025 6 commits
- [Frontend] Support cache_salt in /v1/completions and /v1/responses (#20981) · 19c86306
  Marko Rosenmueller authored Jul 15, 2025
```
Signed-off-by: Marko Rosenmueller <5467316+dr75@users.noreply.github.com>
```
  19c86306
- Add full serve CLI reference back to docs (#20978) · b637e9dc
  Harry Mellor authored Jul 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b637e9dc
- [Deprecation] Remove everything scheduled for removal in v0.10.0 (#20979) · 313ae8c1
  Harry Mellor authored Jul 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  313ae8c1
- Voxtral (#20970) · e7e3e6d2
  Patrick von Platen authored Jul 15, 2025
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  e7e3e6d2
- [frontend] Refactor CLI Args for a better modular integration (#20206) · f148c44c
  kourosh hakhamaneshi authored Jul 15, 2025
```
Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>
```
  f148c44c
- [frontend] Add --help=page option for paginated help output (#20961) · 68d28e37
  Reid authored Jul 15, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  68d28e37
14 Jul, 2025 3 commits
- [Misc] Remove unused function (#20909) · 9887e8ec
  Reid authored Jul 14, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  9887e8ec
- Fix: Add missing EOFError handling in CLI complete command (#20896) · 2c7fa471
  Reid authored Jul 14, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  2c7fa471
- Removing redundant python version check (#20888) · 88fc8a97
  Daniel song authored Jul 14, 2025
```
Signed-off-by: Dannyso05 <dansong1177@gmail.com>
```
  88fc8a97
13 Jul, 2025 2 commits

[Bugfix] fix define of RerankDocument (#20877) · 211b6a61

Liuchenlong authored Jul 13, 2025


Signed-off-by: liuchenlong <liuchenlong@xiaohongshu.com>
Co-authored-by: liuchenlong <liuchenlong@xiaohongshu.com>

211b6a61

[Core] Support multiple tasks per model (#20771) · 020f58ab

Nicolò Lucchesi authored Jul 13, 2025


Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

020f58ab

12 Jul, 2025 2 commits
- [Frontend] Abstract prompt and SpeechToTextConfig for transcriptions models (#20637) · 3c7d942d
  Nicolò Lucchesi authored Jul 12, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  3c7d942d
- [CI Bug] Fix Async Engine, Inputs, Utils, Worker Test: 'State' object has no... · 7b828e30
  Wentao Ye authored Jul 11, 2025
```
[CI Bug] Fix Async Engine, Inputs, Utils, Worker Test: 'State' object has no attribute 'enable_server_load_tracking' (#20845)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  7b828e30
11 Jul, 2025 2 commits

[Bugfix] Refactor `/invocations` to be task-agnostic (#20764) · cbd14ed5
Cyrus Leung authored Jul 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
cbd14ed5

Add kimi-k2 tool parser (#20789) · 0cf893ca

bigmoyan authored Jul 11, 2025


Signed-off-by: wangzhengtao <wangzhengtao@moonshot.cn>
Co-authored-by: wangzhengtao <wangzhengtao@moonshot.cn>
Co-authored-by: wangzhengtao <wangzhengtao@msh.team>

0cf893ca

10 Jul, 2025 1 commit
- [Docs] Lazy import gguf (#20785) · b854321f
  Simon Mo authored Jul 10, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  b854321f