Commits · 8fcaaf6a165e661f63fc51be906bc05b0767332f · OpenDAS / vllm_cscc

12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
09 Oct, 2025 1 commit
- [Bugfix] Fix SHM cache initialization (#26427) · 4bdf7ac5
  Cyrus Leung authored Oct 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4bdf7ac5
05 Oct, 2025 2 commits
- Remove all references to `yapf` as it's no longer used (#26251) · 4e256cad
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4e256cad
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
04 Oct, 2025 1 commit
- [Frontend] Cache chat template kwargs resolution (#26227) · a42d2df7
  Isotr0py authored Oct 04, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  a42d2df7
27 Sep, 2025 2 commits

Add filtering for chat template kwargs (#25794) · 7977e502

Russell Bryant authored Sep 27, 2025


Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

7977e502

Validate API tokens in constant time (#25781) · 3f5d902d

Russell Bryant authored Sep 27, 2025


Signed-off-by: rentianyue-jk <rentianyue-jk@360shuke.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: rentianyue-jk <rentianyue-jk@360shuke.com>

3f5d902d

25 Sep, 2025 1 commit
- [V0 deprecation] Remove unreachable model_config.supported_tasks (#25642) · 7f570f1c
  wang.yuqi authored Sep 25, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  7f570f1c
19 Sep, 2025 1 commit
- [Frontend] Pass API server count to each process (#23717) · 6c117cff
  Cyrus Leung authored Sep 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6c117cff
18 Sep, 2025 3 commits

[V0 Deprecation] Remove AsyncLLMEngine (#25025) · e19bce40

Woosuk Kwon authored Sep 18, 2025


Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

e19bce40

feat(api): Return 503 on /health when engine is dead (#24897) · 67244c86
dongbo910220 authored Sep 18, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
Co-authored-by: Claude <noreply@anthropic.com>
```
67244c86

[Chore] Cleanup guided namespace, move to structured outputs config (#22772) · 29283e89

Aaron Pham authored Sep 18, 2025

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

29283e89

17 Sep, 2025 2 commits
- [gpt-oss][2] fix types for streaming (#24556) · bff2e5f1
  Andrew Xia authored Sep 17, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
```
  bff2e5f1
- [V0 Deprecation] Remove MQLLMEngine (#25019) · 5801e497
  Woosuk Kwon authored Sep 16, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  5801e497
15 Sep, 2025 1 commit
- [gpt-oss][1a] create_responses stream outputs BaseModel type, api server is SSE still (#24759) · 73df49ef
  Andrew Xia authored Sep 15, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
```
  73df49ef
09 Sep, 2025 1 commit
- [gpt-oss] Validate gpt-oss python tool during initialization (#23856) · 1116590b
  Chen Zhang authored Sep 09, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  1116590b
04 Sep, 2025 1 commit
- [Feature][Responses API]Support MCP tools with streaming mode + background mode (#23927) · a38f8bd5
  wuhang authored Sep 04, 2025
```
Signed-off-by: wuhang <wuhang6@huawei.com>
```
  a38f8bd5
01 Sep, 2025 1 commit

[Misc] IO Processor plugins for pooling models (#22820) · 1cb39dbc

Christian Pinto authored Sep 01, 2025


Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>

1cb39dbc

29 Aug, 2025 1 commit
- [Performance] V1 Classify Models E2E Performance Optimization (#23541) · d9e00dbd
  wang.yuqi authored Aug 29, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  d9e00dbd
28 Aug, 2025 1 commit
- [Doc]: fix typos in Python scripts (#23828) · d3da2eea
  Didier Durand authored Aug 28, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  d3da2eea
27 Aug, 2025 1 commit
- [Frontend] Add --log-error-stack to print stack trace for error response (#22960) · 32102644
  Chen Zhang authored Aug 26, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  32102644
26 Aug, 2025 1 commit
- [Bugfix] Add missing enable_log_outputs parameter to init_app_state function (#23634) · 384dd1b0
  Matúš Námešný authored Aug 26, 2025
```
Signed-off-by: Matúš Námešný <matus.namesny@ameria.com>
```
  384dd1b0
20 Aug, 2025 2 commits

[Frontend] improve error logging of chat completion (#22957) · b95697d7
Chen Zhang authored Aug 20, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
b95697d7

Limit HTTP header count and size (#23267) · f77a0802

Russell Bryant authored Aug 20, 2025


Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>

f77a0802

19 Aug, 2025 1 commit
- [Frontend] Add `/collective_rpc` API endpoint (#23075) · f7cf5b51
  22quinn authored Aug 19, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  f7cf5b51
15 Aug, 2025 1 commit

[Frontend] Expose do_log_stats interval to env (#22905) · a0632a3e

Csrayz authored Aug 15, 2025


Signed-off-by: Csrayz <jover@cmbchina.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

a0632a3e

08 Aug, 2025 2 commits
- [Frontend] Add unix domain socket support (#18097) · baece8c3
  yyweiss authored Aug 09, 2025
```
Signed-off-by: <yyweiss@gmail.com>
Signed-off-by: yyw <yyweiss@gmail.com>
```
  baece8c3
- [gpt-oss] Support tool call and implement MCP tool server (#22427) · fe6d8257
  Chen Zhang authored Aug 08, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  fe6d8257
07 Aug, 2025 3 commits
- [Frontend] Update OpenAI error response to upstream format (#22099) · 37066185
  Moritz Sanft authored Aug 07, 2025
```
Signed-off-by: Moritz Sanft <58110325+msanft@users.noreply.github.com>
```
  37066185
- preload heavy modules when mp method is forkserver (#22214) · ad6c655d
  Lionel Villard authored Aug 06, 2025
```
Signed-off-by: Lionel Villard <villard@us.ibm.com>
```
  ad6c655d
- [gpt-oss] add demo tool server (#22393) · 19c9365a
  Chen Zhang authored Aug 06, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  19c9365a
02 Aug, 2025 1 commit
- [BugFix] Improve internal DP load balancing (#21617) · 8d524ce7
  Nick Hill authored Aug 02, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  8d524ce7
01 Aug, 2025 3 commits
- Deprecate `--disable-log-requests` and replace with `--enable-log-requests` (#21739) · 2d7b09b9
  Harry Mellor authored Aug 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2d7b09b9
- [BugFix] Don't change title of top-level process (#22032) · 3146519a
  Nick Hill authored Aug 01, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  3146519a
- [Bugfix] Add log prefix in non-dp mode engine core (#21889) · e6680f9e
  wuhang authored Aug 01, 2025
```
Signed-off-by: wuhang <wuhang6@huawei.com>
```
  e6680f9e
30 Jul, 2025 1 commit
- [Feature] Support multiple api keys in server (#18548) · bf668b5b
  Yan Pashkovsky authored Jul 30, 2025
```
Signed-off-by: Yan Pashkovsky <yanp.bugz@gmail.com>
```
  bf668b5b
29 Jul, 2025 1 commit
- [Misc] Rework process titles (#21780) · 7234fe26
  Nick Hill authored Jul 29, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  7234fe26
28 Jul, 2025 2 commits

[feature] add log non default args in LLM (#21680) · 2cc57119
rongfu.leng authored Jul 28, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
2cc57119

[Deprecation][2/N] Replace `--task` with `--runner` and `--convert` (#21470) · 86ae693f

Cyrus Leung authored Jul 28, 2025

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

86ae693f

25 Jul, 2025 1 commit
- [V1] Get supported tasks from model runner instead of model config (#21585) · 46d81d69
  Cyrus Leung authored Jul 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  46d81d69