Commits · fbd88728b3aa7add999529e2c3f1b6b0aa8e428d · OpenDAS / vllm_cscc

15 Aug, 2025 1 commit

[Frontend] Expose do_log_stats interval to env (#22905) · a0632a3e

Csrayz authored Aug 15, 2025


Signed-off-by: Csrayz <jover@cmbchina.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

a0632a3e

13 Aug, 2025 2 commits

[Misc] clear and separate error messages for input too long and input +... · da270519

Roger Wang authored Aug 13, 2025


[Misc] clear and separate error messages for input too long and input + max-tokens too long (#22803)
Signed-off-by: Roger Wang <hey@rogerw.me>

da270519

[Frontend] Add chunked processing to handle long inputs in embedding models (#22280) · 653124bd

Kdump authored Aug 13, 2025


Signed-off-by: x22x22 <wadeking@qq.com>
Signed-off-by: Kdump <rootshellexp@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Maximilien de Bayser <maxdebayser@gmail.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

653124bd

12 Aug, 2025 2 commits
- [gpt-oss] Small bug fixes for frontend (#22512) · ad344ef5
  Chen Zhang authored Aug 11, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  ad344ef5
- [gpt-oss] Support streaming in response API (#22431) · 95a935fc
  Chen Zhang authored Aug 11, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  95a935fc
11 Aug, 2025 2 commits
- [Docs] Add comprehensive CLI reference for all large `vllm` subcommands (#22601) · bc1d02ac
  Harry Mellor authored Aug 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  bc1d02ac
- Support token_type_ids in V1 with less code changes (#21985) · 39052dbc
  Maximilien de Bayser authored Aug 11, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  39052dbc
08 Aug, 2025 3 commits
- [Frontend] Add unix domain socket support (#18097) · baece8c3
  yyweiss authored Aug 09, 2025
```
Signed-off-by: <yyweiss@gmail.com>
Signed-off-by: yyw <yyweiss@gmail.com>
```
  baece8c3
- [gpt-oss] Support tool call and implement MCP tool server (#22427) · fe6d8257
  Chen Zhang authored Aug 08, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  fe6d8257
- [PERF] Use pybase64 to more quickly decode prompt embeddings (#22469) · e2c8f1ed
  Andrew Sansom authored Aug 07, 2025
```
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
```
  e2c8f1ed
07 Aug, 2025 9 commits
- Fix pre-commit error in main (#22462) · 399d2a10
  Woosuk Kwon authored Aug 07, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  399d2a10
- [gpt-oss] Generate ResponseOutputItem from Harmony Message (#22410) · 4815b00f
  Chen Zhang authored Aug 07, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  4815b00f
- [Tool] Fix auto tool call (#22434) · 4da8bf20
  Chen Zhang authored Aug 07, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  4da8bf20
- feat: Add --enable-log-outputs flag for logging model generations (#20707) · 8e8e0b6a
  Adrián García García authored Aug 07, 2025
```
Signed-off-by: Adrian Garcia <adrian.garcia@inceptionai.ai>
```
  8e8e0b6a
- [Frontend] Update OpenAI error response to upstream format (#22099) · 37066185
  Moritz Sanft authored Aug 07, 2025
```
Signed-off-by: Moritz Sanft <58110325+msanft@users.noreply.github.com>
```
  37066185
- [gpt-oss] Convert user input to harmony format (#22402) · f6278b62
  Chen Zhang authored Aug 06, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  f6278b62
- preload heavy modules when mp method is forkserver (#22214) · ad6c655d
  Lionel Villard authored Aug 06, 2025
```
Signed-off-by: Lionel Villard <villard@us.ibm.com>
```
  ad6c655d
- [Bugfix]: Fix the streaming output for function calls in the minimax (#22015) · 5e9455ae
  qscqesze authored Aug 07, 2025
```
Signed-off-by: QscQ <qscqesze@gmail.com>
Signed-off-by: qingjun <qingjun@minimaxi.com>
```
  5e9455ae
- [gpt-oss] add demo tool server (#22393) · 19c9365a
  Chen Zhang authored Aug 06, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  19c9365a
06 Aug, 2025 2 commits

[gpt-oss] Add loop for built-in tool call (#22374) · ec7cb192

Woosuk Kwon authored Aug 06, 2025


Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>
Co-authored-by: simon-mo <xmo@berkeley.edu>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Hongxia Yang <62075498+hongxiayang@users.noreply.github.com>
Co-authored-by: Minseok Lee <47620120+minseokl@users.noreply.github.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>

ec7cb192

[gpt-oss] Support chat completion api (#22342) · f263a4b5
Woosuk Kwon authored Aug 06, 2025

f263a4b5

05 Aug, 2025 2 commits
- [Model] Pooling model activation supports per request control by PoolingParams (#20538) · 586f2867
  wang.yuqi authored Aug 05, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  586f2867
- fix: kimi_k2 return empty tool call list (#22149) · 8a6e108e
  tlipoca9 authored Aug 05, 2025
```
Signed-off-by: tlipoca9 <tlipoca9@gmail.com>
```
  8a6e108e
04 Aug, 2025 1 commit
- [Responses API] Ignore `store=True` and process the request by default (#22185) · 9af654cc
  Woosuk Kwon authored Aug 04, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  9af654cc
03 Aug, 2025 1 commit
- [Responses API] Disable response store by default (#22137) · 6d98843b
  Woosuk Kwon authored Aug 03, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  6d98843b
02 Aug, 2025 1 commit
- [BugFix] Improve internal DP load balancing (#21617) · 8d524ce7
  Nick Hill authored Aug 02, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  8d524ce7
01 Aug, 2025 4 commits
- Deprecate `--disable-log-requests` and replace with `--enable-log-requests` (#21739) · 2d7b09b9
  Harry Mellor authored Aug 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2d7b09b9
- [BugFix] Don't change title of top-level process (#22032) · 3146519a
  Nick Hill authored Aug 01, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  3146519a
- [Bugfix] Add log prefix in non-dp mode engine core (#21889) · e6680f9e
  wuhang authored Aug 01, 2025
```
Signed-off-by: wuhang <wuhang6@huawei.com>
```
  e6680f9e
- [Frontend] Align tool_choice="required" behavior with OpenAI when tools is empty (#21052) · 98df153a
  Sungyoon Jeong authored Aug 01, 2025
```
Signed-off-by: Sungyoon Jeong <sungyoon.jeong@furiosa.ai>
```
  98df153a
31 Jul, 2025 2 commits

[Model] Add step3 vl (#21998) · 94846416

Song authored Jul 31, 2025


Signed-off-by: oliveryuan <yuansong@step.ai>
Co-authored-by: oliveryuan <yuansong@step.ai>

94846416

[Bugfix] Relax lang pin for voxtral (#21833) · ec02e536

Sanchit Gandhi authored Jul 31, 2025


Signed-off-by: Sanchit Gandhi <sgandhi3141@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

ec02e536

30 Jul, 2025 2 commits
- [Feature] Support multiple api keys in server (#18548) · bf668b5b
  Yan Pashkovsky authored Jul 30, 2025
```
Signed-off-by: Yan Pashkovsky <yanp.bugz@gmail.com>
```
  bf668b5b
- [Bugfix] we should use metavar is not choices (#21902) · da3e0bd6
  rongfu.leng authored Jul 30, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  da3e0bd6
29 Jul, 2025 1 commit
- [Misc] Rework process titles (#21780) · 7234fe26
  Nick Hill authored Jul 29, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  7234fe26
28 Jul, 2025 5 commits

[Bugfix] Improve JSON extraction in LlamaToolParser (#19024) · 9ace2eaf
Keyang Ru authored Jul 28, 2025
```
Signed-off-by: keru <keyang.ru@oracle.com>
Co-authored-by: keru <keyang.ru@oracle.com>
```
9ace2eaf
[feature] add log non default args in LLM (#21680) · 2cc57119
rongfu.leng authored Jul 28, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
2cc57119

[Bugfix] [issue-21565] Fix the incompatibility issue with stream and named... · 7656cf4c

Hongsheng Liu authored Jul 28, 2025


[Bugfix] [issue-21565] Fix the incompatibility issue with stream and named function calling when Thinking is disabled (#21573)
Signed-off-by: wangzi <3220100013@zju.edu.cn>
Co-authored-by: wangzi <3220100013@zju.edu.cn>

7656cf4c

Fix GLM tool parser (#21668) · 93269bb4
Yuxuan Zhang authored Jul 28, 2025
```
Co-authored-by: Chenhui Zhang <zhang.chenhui@outlook.com>
```
93269bb4

[Deprecation][2/N] Replace `--task` with `--runner` and `--convert` (#21470) · 86ae693f

Cyrus Leung authored Jul 28, 2025

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

86ae693f