Commits · d4d1a6024f526129941d2fecaec504d93f9072ed · OpenDAS / vllm_cscc

14 Oct, 2025 1 commit
- [Misc][DP] support customized aggregated logger for dp (#24354) · 8317f723
  Lucia Fang authored Oct 13, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
```
  8317f723
13 Oct, 2025 3 commits

[Frontend][1/N] Improve all pooling task | Support FP16 Embedding Base64... · d2a79385

wang.yuqi authored Oct 14, 2025


[Frontend][1/N] Improve all pooling task | Support FP16 Embedding Base64 (Still uses fp32 by default). (#26414)
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Maximilien de Bayser <maxdebayser@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

d2a79385

[Model][0/N] Improve all pooling task | clean up (#25817) · 767c3ab8
wang.yuqi authored Oct 13, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
767c3ab8
docs: wrong command in structured_outputs README (#26677) · 3cd36660
yihong authored Oct 13, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
3cd36660

12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
08 Oct, 2025 1 commit
- Remove Python 3.9 support ahead of PyTorch 2.9 in v0.11.1 (#26416) · e09d1753
  Harry Mellor authored Oct 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e09d1753
07 Oct, 2025 2 commits
- [V0 Deprecation] Remove `VLLM_USE_V1` from docs and scripts (#26336) · 7e4cd070
  Cyrus Leung authored Oct 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7e4cd070
- [BugFix] Update KV block hash type from BlockHash to ExternalBlockHash in... · 46b07799
  Snehlata authored Oct 07, 2025
```
[BugFix] Update KV block hash type from BlockHash to ExternalBlockHash in kv_events_subscriber - #26264 (#26265)
Signed-off-by: atalhens <sneh.lata@nutanix.com>
```
  46b07799
06 Oct, 2025 1 commit
- Fix per file ruff ignores related to line length (#26262) · 6c046382
  Harry Mellor authored Oct 06, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6c046382
04 Oct, 2025 1 commit
- [Model] CLIP Embedding Support (#26010) · 4570535e
  Cyrus Leung authored Oct 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4570535e
02 Oct, 2025 1 commit

[CI/Build] Replace `vllm.entrypoints.openai.api_server` entrypoint with `vllm... · d00d6529

Cyrus Leung authored Oct 03, 2025


[CI/Build] Replace `vllm.entrypoints.openai.api_server` entrypoint with `vllm serve` command (#25967)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

d00d6529

30 Sep, 2025 1 commit
- [Doc] Improve MM Pooling model documentation (#25966) · 2f652e6c
  Cyrus Leung authored Oct 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2f652e6c
27 Sep, 2025 1 commit

[Misc] Update openai client example file for multimodal (#25795) · 23b8ee67

Roger Wang authored Sep 27, 2025


Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

23b8ee67

24 Sep, 2025 1 commit
- [Docs] Enable `fail_on_warning` for the docs build in CI (#25580) · 8c853050
  Harry Mellor authored Sep 24, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8c853050
19 Sep, 2025 1 commit
- Move `PoolerConfig` from `config/__init__.py` to `config/pooler.py` (#25181) · 058525b9
  Harry Mellor authored Sep 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  058525b9
18 Sep, 2025 2 commits

[New Model] Support BertForTokenClassification / Named Entity Recognition (NER) task (#24872) · 5f696c33

wang.yuqi authored Sep 18, 2025


Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

5f696c33

[Chore] Cleanup guided namespace, move to structured outputs config (#22772) · 29283e89

Aaron Pham authored Sep 18, 2025

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

29283e89

16 Sep, 2025 1 commit
- feat: Add Grafana and Perces monitoring dashboards for vLLM (#23498) · de3e53a7
  liangwen12year authored Sep 16, 2025
  
  de3e53a7
15 Sep, 2025 1 commit

[Misc] Fix examples openai_pooling_client.py (#24853) · bf214ca2

wang.yuqi authored Sep 15, 2025


Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

bf214ca2

09 Sep, 2025 1 commit
- [Core] Use sha256 bytes instead of BlockHash to reduce GC overhead (#23673) · 82dfb12e
  Zebing Lin authored Sep 09, 2025
```
Signed-off-by: linzebing <linzebing1995@gmail.com>
```
  82dfb12e
08 Sep, 2025 1 commit

[Misc] Terratorch related fixes (#24337) · 9cd76b71

Christian Pinto authored Sep 08, 2025


Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

9cd76b71

04 Sep, 2025 1 commit

[Core][Model] Terratorch backend integration (#23513) · 51d5e9be

mgazz authored Sep 04, 2025


Signed-off-by: Michele Gazzetti <michele.gazzetti1@ibm.com>
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
Co-authored-by: Christian Pinto <christian.pinto@ibm.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

51d5e9be

03 Sep, 2025 2 commits
- Remove deprecated `PyNcclConnector` (#24151) · b5ee1e32
  Peter Pan authored Sep 04, 2025
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
```
  b5ee1e32
- fix some typos (#24071) · 1bd007f2
  co63oc authored Sep 03, 2025
```
Signed-off-by: co63oc <co63oc@users.noreply.github.com>
```
  1bd007f2
02 Sep, 2025 3 commits
- [Metrics] Deprecate TPOT in favor of ITL (#24110) · 24177984
  Mark McLoughlin authored Sep 02, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  24177984
- [Gemma3n] Fix audio batching (#24052) · 0a74e9d0
  Nicolò Lucchesi authored Sep 02, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  0a74e9d0
- correct LWS deployment yaml (#23104) · 8bd58449
  Christian Berge authored Sep 02, 2025
```
Signed-off-by: cberge908 <42270330+cberge908@users.noreply.github.com>
```
  8bd58449
01 Sep, 2025 3 commits
- [docs][misc] IOProcessor plugins fixes (#24046) · cf91a89d
  Christian Pinto authored Sep 01, 2025
```
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
```
  cf91a89d
- [Misc] IO Processor plugins for pooling models (#22820) · 1cb39dbc
  Christian Pinto authored Sep 01, 2025
```
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>
```
  1cb39dbc
- v1: Support KV events from connectors (#19737) · 14b4326b
  Or Ozeri authored Sep 01, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  14b4326b
13 Aug, 2025 1 commit

[Frontend] Add chunked processing to handle long inputs in embedding models (#22280) · 653124bd

Kdump authored Aug 13, 2025


Signed-off-by: x22x22 <wadeking@qq.com>
Signed-off-by: Kdump <rootshellexp@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Maximilien de Bayser <maxdebayser@gmail.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

653124bd

04 Aug, 2025 1 commit
- [Bugfix][V1][P/D]Fix the uneven polling issue in the toy proxy for P2pNcclConnector (#21819) · c09efff9
  Zhonghua Deng authored Aug 05, 2025
```
Signed-off-by: Abatom <abzhonghua@gmail.com>
```
  c09efff9
02 Aug, 2025 1 commit
- docs: remove deprecated disable-log-requests flag (#22113) · 067c34a1
  Roger Wang authored Aug 02, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.me>
```
  067c34a1
01 Aug, 2025 1 commit
- [Bugfix][PD] set max_completion_tokens=1 if req has this value (#21841) · 5c54d975
  Abirdcfly authored Aug 01, 2025
```
Signed-off-by: Abirdcfly <fp544037857@gmail.com>
```
  5c54d975
30 Jul, 2025 1 commit

[Docs] Fix the example code of streaming chat completions in reasoning (#21825) · 5c8fe389

Hongsheng Liu authored Jul 30, 2025


Signed-off-by: wangzi <3220100013@zju.edu.cn>
Co-authored-by: wangzi <3220100013@zju.edu.cn>
Co-authored-by: Zi Wang <66560864+BruceW-07@users.noreply.github.com>

5c8fe389

28 Jul, 2025 2 commits

[PD] let p2p nccl toy proxy handle /chat/completions (#21734) · 63fe3a70
Chauncey authored Jul 28, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
63fe3a70

[Deprecation][2/N] Replace `--task` with `--runner` and `--convert` (#21470) · 86ae693f

Cyrus Leung authored Jul 28, 2025

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

86ae693f

27 Jul, 2025 1 commit
- [CI/Build][Doc] Clean up more docs that point to old bench scripts (#21667) · 01a395e9
  Ye (Charlotte) Qi authored Jul 26, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  01a395e9
26 Jul, 2025 1 commit
- [CI/Build][Doc] Move existing benchmark scripts in CI/document/example to vllm bench CLI (#21355) · e7c4f9ee
  Ye (Charlotte) Qi authored Jul 26, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  e7c4f9ee
24 Jul, 2025 1 commit
- [Bugfix] Fix example disagg_example_p2p_nccl_xpyd.sh zombie process (#21437) · f8c15c4e
  WeiQing Chen authored Jul 24, 2025
```
Signed-off-by: David Chen <530634352@qq.com>
```
  f8c15c4e