Commits · ba464e6ae24857b2db7c82f4123342b9ab90049e · OpenDAS / vllm_cscc

03 Nov, 2025 1 commit
- Add ORCA endpoint load metrics support (#24905) · ba464e6a
  Misha Efimov authored Nov 03, 2025
```
Signed-off-by: Misha Efimov <mef@google.com>
```
  ba464e6a
01 Nov, 2025 1 commit
- Adds anthropic /v1/messages endpoint to openai api_server (#27882) · 1e88fb75
  Benjamin Bartels authored Nov 01, 2025
```
Signed-off-by: bbartels <benjamin@bartels.dev>
Signed-off-by: Benjamin Bartels <benjamin@bartels.dev>
```
  1e88fb75
31 Oct, 2025 1 commit
- [Cleanup] Remove no-longer-used `SpeculativeConfig.enable_chunked_prefill` (#27826) · 9e5bd307
  Nick Hill authored Oct 31, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  9e5bd307
30 Oct, 2025 1 commit

[Frontend][Doc][5/N] Improve all pooling task | Polish encode (pooling) api & Document. (#25524) · 4464723f

wang.yuqi authored Oct 30, 2025

Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

4464723f

28 Oct, 2025 1 commit
- [Misc] Separate out `utils.counter` and move `utils.Device` to engine (#27588) · f58d9b64
  Cyrus Leung authored Oct 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f58d9b64
27 Oct, 2025 2 commits
- [Misc] Clean up more utils (#27567) · 6ebffafb
  Cyrus Leung authored Oct 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6ebffafb
- [Misc] Clean up utils (#27552) · 7c2bdb83
  Cyrus Leung authored Oct 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7c2bdb83
23 Oct, 2025 1 commit

[Frontend][4/N] Improve all pooling task | Add plugin pooling task (#26973) · 3fa2c121

wang.yuqi authored Oct 23, 2025

Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Christian Pinto <christian.pinto@ibm.com>

3fa2c121

22 Oct, 2025 3 commits

[Chore] Separate out system utilities from vllm.utils (#27201) · a0003b56
dongbo910220 authored Oct 23, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
a0003b56

Support Anthropic API /v1/messages Endpoint (#22627) · c9461e05

RED authored Oct 23, 2025


Signed-off-by: liuli <ll407707@alibaba-inc.com>
Co-authored-by: liuli <ll407707@alibaba-inc.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

c9461e05

[Frontend][3/N] Improve all pooling task | Support binary embedding response (#27066) · 1f633b86

wang.yuqi authored Oct 22, 2025

Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

1f633b86

19 Oct, 2025 2 commits
- [Chore] Separate out `vllm.utils.network_utils` (#27164) · 7a6c8c3f
  iAmir97 authored Oct 19, 2025
```
Signed-off-by: iAmir97 <Amir.balwel@embeddedllm.com>
Co-authored-by: iAmir97 <Amir.balwel@embeddedllm.com>
```
  7a6c8c3f
- [Benchmark] Convenience script for multiple parameter combinations (#27085) · b3aba04e
  Cyrus Leung authored Oct 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b3aba04e
15 Oct, 2025 1 commit
- [Model][2/N] Improve all pooling task | Support multi-vector retrieval (#25370) · f54f8512
  wang.yuqi authored Oct 15, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  f54f8512
14 Oct, 2025 2 commits

[Bugfix][FE]: Always include usage with `--enable-force-include-usage ` (#20983) · fd85c9f4

Max Wittig authored Oct 14, 2025

Signed-off-by: Max Wittig <max.wittig@siemens.com>
Signed-off-by: Antoine Auger <antoineauger@users.noreply.github.com>
Co-authored-by: Antoine Auger <antoineauger@users.noreply.github.com>

fd85c9f4

[Misc][DP] support customized aggregated logger for dp (#24354) · 8317f723
Lucia Fang authored Oct 13, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
```
8317f723

12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
09 Oct, 2025 1 commit
- [Bugfix] Fix SHM cache initialization (#26427) · 4bdf7ac5
  Cyrus Leung authored Oct 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4bdf7ac5
05 Oct, 2025 2 commits
- Remove all references to `yapf` as it's no longer used (#26251) · 4e256cad
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4e256cad
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
04 Oct, 2025 1 commit
- [Frontend] Cache chat template kwargs resolution (#26227) · a42d2df7
  Isotr0py authored Oct 04, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  a42d2df7
27 Sep, 2025 2 commits

Add filtering for chat template kwargs (#25794) · 7977e502

Russell Bryant authored Sep 27, 2025


Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

7977e502

Validate API tokens in constant time (#25781) · 3f5d902d

Russell Bryant authored Sep 27, 2025


Signed-off-by: rentianyue-jk <rentianyue-jk@360shuke.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: rentianyue-jk <rentianyue-jk@360shuke.com>

3f5d902d

25 Sep, 2025 1 commit
- [V0 deprecation] Remove unreachable model_config.supported_tasks (#25642) · 7f570f1c
  wang.yuqi authored Sep 25, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  7f570f1c
19 Sep, 2025 1 commit
- [Frontend] Pass API server count to each process (#23717) · 6c117cff
  Cyrus Leung authored Sep 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6c117cff
18 Sep, 2025 3 commits

[V0 Deprecation] Remove AsyncLLMEngine (#25025) · e19bce40

Woosuk Kwon authored Sep 18, 2025


Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

e19bce40

feat(api): Return 503 on /health when engine is dead (#24897) · 67244c86
dongbo910220 authored Sep 18, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
Co-authored-by: Claude <noreply@anthropic.com>
```
67244c86

[Chore] Cleanup guided namespace, move to structured outputs config (#22772) · 29283e89

Aaron Pham authored Sep 18, 2025

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

29283e89

17 Sep, 2025 2 commits
- [gpt-oss][2] fix types for streaming (#24556) · bff2e5f1
  Andrew Xia authored Sep 17, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
```
  bff2e5f1
- [V0 Deprecation] Remove MQLLMEngine (#25019) · 5801e497
  Woosuk Kwon authored Sep 16, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  5801e497
15 Sep, 2025 1 commit
- [gpt-oss][1a] create_responses stream outputs BaseModel type, api server is SSE still (#24759) · 73df49ef
  Andrew Xia authored Sep 15, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
```
  73df49ef
09 Sep, 2025 1 commit
- [gpt-oss] Validate gpt-oss python tool during initialization (#23856) · 1116590b
  Chen Zhang authored Sep 09, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  1116590b
04 Sep, 2025 1 commit
- [Feature][Responses API]Support MCP tools with streaming mode + background mode (#23927) · a38f8bd5
  wuhang authored Sep 04, 2025
```
Signed-off-by: wuhang <wuhang6@huawei.com>
```
  a38f8bd5
01 Sep, 2025 1 commit

[Misc] IO Processor plugins for pooling models (#22820) · 1cb39dbc

Christian Pinto authored Sep 01, 2025


Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>

1cb39dbc

29 Aug, 2025 1 commit
- [Performance] V1 Classify Models E2E Performance Optimization (#23541) · d9e00dbd
  wang.yuqi authored Aug 29, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  d9e00dbd
28 Aug, 2025 1 commit
- [Doc]: fix typos in Python scripts (#23828) · d3da2eea
  Didier Durand authored Aug 28, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  d3da2eea
27 Aug, 2025 1 commit
- [Frontend] Add --log-error-stack to print stack trace for error response (#22960) · 32102644
  Chen Zhang authored Aug 26, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  32102644
26 Aug, 2025 1 commit
- [Bugfix] Add missing enable_log_outputs parameter to init_app_state function (#23634) · 384dd1b0
  Matúš Námešný authored Aug 26, 2025
```
Signed-off-by: Matúš Námešný <matus.namesny@ameria.com>
```
  384dd1b0
20 Aug, 2025 2 commits

[Frontend] improve error logging of chat completion (#22957) · b95697d7
Chen Zhang authored Aug 20, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
b95697d7

Limit HTTP header count and size (#23267) · f77a0802

Russell Bryant authored Aug 20, 2025


Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>

f77a0802