Commits · 38d8096760cd8f42fb65fc0ba2b9fb11f98d8ac3 · OpenDAS / vllm_cscc

09 Sep, 2025 1 commit
- [Core] Use sha256 bytes instead of BlockHash to reduce GC overhead (#23673) · 82dfb12e
  Zebing Lin authored Sep 09, 2025
```
Signed-off-by: linzebing <linzebing1995@gmail.com>
```
  82dfb12e
08 Sep, 2025 1 commit

[Misc] Terratorch related fixes (#24337) · 9cd76b71

Christian Pinto authored Sep 08, 2025


Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

9cd76b71

04 Sep, 2025 1 commit

[Core][Model] Terratorch backend integration (#23513) · 51d5e9be

mgazz authored Sep 04, 2025


Signed-off-by: Michele Gazzetti <michele.gazzetti1@ibm.com>
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
Co-authored-by: Christian Pinto <christian.pinto@ibm.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

51d5e9be

03 Sep, 2025 2 commits
- Remove deprecated `PyNcclConnector` (#24151) · b5ee1e32
  Peter Pan authored Sep 04, 2025
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
```
  b5ee1e32
- fix some typos (#24071) · 1bd007f2
  co63oc authored Sep 03, 2025
```
Signed-off-by: co63oc <co63oc@users.noreply.github.com>
```
  1bd007f2
02 Sep, 2025 3 commits
- [Metrics] Deprecate TPOT in favor of ITL (#24110) · 24177984
  Mark McLoughlin authored Sep 02, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  24177984
- [Gemma3n] Fix audio batching (#24052) · 0a74e9d0
  Nicolò Lucchesi authored Sep 02, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  0a74e9d0
- correct LWS deployment yaml (#23104) · 8bd58449
  Christian Berge authored Sep 02, 2025
```
Signed-off-by: cberge908 <42270330+cberge908@users.noreply.github.com>
```
  8bd58449
01 Sep, 2025 3 commits
- [docs][misc] IOProcessor plugins fixes (#24046) · cf91a89d
  Christian Pinto authored Sep 01, 2025
```
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
```
  cf91a89d
- [Misc] IO Processor plugins for pooling models (#22820) · 1cb39dbc
  Christian Pinto authored Sep 01, 2025
```
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>
```
  1cb39dbc
- v1: Support KV events from connectors (#19737) · 14b4326b
  Or Ozeri authored Sep 01, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  14b4326b
13 Aug, 2025 1 commit

[Frontend] Add chunked processing to handle long inputs in embedding models (#22280) · 653124bd

Kdump authored Aug 13, 2025


Signed-off-by: x22x22 <wadeking@qq.com>
Signed-off-by: Kdump <rootshellexp@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Maximilien de Bayser <maxdebayser@gmail.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

653124bd

04 Aug, 2025 1 commit
- [Bugfix][V1][P/D]Fix the uneven polling issue in the toy proxy for P2pNcclConnector (#21819) · c09efff9
  Zhonghua Deng authored Aug 05, 2025
```
Signed-off-by: Abatom <abzhonghua@gmail.com>
```
  c09efff9
02 Aug, 2025 1 commit
- docs: remove deprecated disable-log-requests flag (#22113) · 067c34a1
  Roger Wang authored Aug 02, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.me>
```
  067c34a1
01 Aug, 2025 1 commit
- [Bugfix][PD] set max_completion_tokens=1 if req has this value (#21841) · 5c54d975
  Abirdcfly authored Aug 01, 2025
```
Signed-off-by: Abirdcfly <fp544037857@gmail.com>
```
  5c54d975
30 Jul, 2025 1 commit

[Docs] Fix the example code of streaming chat completions in reasoning (#21825) · 5c8fe389

Hongsheng Liu authored Jul 30, 2025


Signed-off-by: wangzi <3220100013@zju.edu.cn>
Co-authored-by: wangzi <3220100013@zju.edu.cn>
Co-authored-by: Zi Wang <66560864+BruceW-07@users.noreply.github.com>

5c8fe389

28 Jul, 2025 2 commits

[PD] let p2p nccl toy proxy handle /chat/completions (#21734) · 63fe3a70
Chauncey authored Jul 28, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
63fe3a70

[Deprecation][2/N] Replace `--task` with `--runner` and `--convert` (#21470) · 86ae693f

Cyrus Leung authored Jul 28, 2025

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

86ae693f

27 Jul, 2025 1 commit
- [CI/Build][Doc] Clean up more docs that point to old bench scripts (#21667) · 01a395e9
  Ye (Charlotte) Qi authored Jul 26, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  01a395e9
26 Jul, 2025 1 commit
- [CI/Build][Doc] Move existing benchmark scripts in CI/document/example to vllm bench CLI (#21355) · e7c4f9ee
  Ye (Charlotte) Qi authored Jul 26, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  e7c4f9ee
24 Jul, 2025 1 commit
- [Bugfix] Fix example disagg_example_p2p_nccl_xpyd.sh zombie process (#21437) · f8c15c4e
  WeiQing Chen authored Jul 24, 2025
```
Signed-off-by: David Chen <530634352@qq.com>
```
  f8c15c4e
19 Jul, 2025 1 commit
- Elastic Expert Parallel Initial Support (#20775) · 21793722
  Rui Qiao authored Jul 18, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  21793722
17 Jul, 2025 1 commit
- [V1][P/D]Enhance Performance and code readability for P2pNcclConnector (#20906) · 8a4e5c5f
  Zhonghua Deng authored Jul 17, 2025
```
Signed-off-by: Abatom <abzhonghua@gmail.com>
```
  8a4e5c5f
15 Jul, 2025 1 commit
- [Docs] Improve documentation for ray cluster launcher helper script (#20602) · 33d56000
  Ricardo Decal authored Jul 15, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
```
  33d56000
10 Jul, 2025 1 commit
- [Model][VLM] Support JinaVL Reranker (#20260) · 4bed1677
  shineran96 authored Jul 11, 2025
```
Signed-off-by: shineran96 <shinewang96@gmail.com>
```
  4bed1677
09 Jul, 2025 1 commit
- [Docs] Improve documentation for multi-node service helper script (#20600) · 977180c9
  Ricardo Decal authored Jul 08, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
```
  977180c9
08 Jul, 2025 1 commit
- [Docs] Improve documentation for Deepseek R1 on Ray Serve LLM (#20601) · b91cb3fa
  Ricardo Decal authored Jul 08, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
```
  b91cb3fa
06 Jul, 2025 2 commits
- Revert "[V0 deprecation] Remove V0 CPU/XPU/TPU backends (#20412)" · a5dd03c1
  simon-mo authored Jul 06, 2025
```
This reverts commit e202dd27.
```
  a5dd03c1
- [V0 deprecation] Remove V0 CPU/XPU/TPU backends (#20412) · e202dd27
  Woosuk Kwon authored Jul 06, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
```
  e202dd27
04 Jul, 2025 2 commits
- [Misc] Add SPDX-FileCopyrightText (#20428) · 1caca5a5
  Jee Jee Li authored Jul 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1caca5a5
- [Misc] small update (#20462) · a7bab0c9
  Reid authored Jul 04, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  a7bab0c9
01 Jul, 2025 2 commits
- [Docs] Update transcriptions API to use openai client with `stream=True` (#20271) · 314af861
  Nicolò Lucchesi authored Jul 01, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  314af861
- [Example] add one-click runnable example for P2P NCCL XpYd (#20246) · 92ee7baa
  Kuntai Du authored Jun 30, 2025
```
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
```
  92ee7baa
25 Jun, 2025 1 commit

[Frontend] Add `/v1/audio/translations` OpenAI API endpoint (#19615) · e795d723

Nicolò Lucchesi authored Jun 25, 2025


Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

e795d723

23 Jun, 2025 1 commit
- [Docs] Fix syntax highlighting of shell commands (#19870) · c3649e4f
  Lukas Geiger authored Jun 23, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  c3649e4f
20 Jun, 2025 1 commit
- [Misc] refactor example - openai_transcription_client (#19851) · e384f2f1
  Reid authored Jun 20, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  e384f2f1
19 Jun, 2025 1 commit
- Add xLAM tool parser support (#17148) · 1d0ae26c
  Zuxin authored Jun 18, 2025
  
  1d0ae26c
18 Jun, 2025 1 commit
- [V1][P/D] An native implementation of xPyD based on P2P NCCL (#18242) · eccdc831
  Zhonghua Deng authored Jun 18, 2025
```
Signed-off-by: Abatom <abzhonghua@gmail.com>
```
  eccdc831
16 Jun, 2025 1 commit
- [DOC] Add reasoning capability to vLLM streamlit code (#19557) · 3e750697
  Navanit Dubey authored Jun 16, 2025
  
  3e750697
13 Jun, 2025 1 commit
- [Doc] uses absolute links for structured outputs (#19582) · 7b3c9ff9
  Aaron Pham authored Jun 12, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  7b3c9ff9