Commits · 977180c912b1b07153decbeb62c2cef24032a701 · OpenDAS / vllm_cscc

09 Jul, 2025 1 commit
- [Docs] Improve documentation for multi-node service helper script (#20600) · 977180c9
  Ricardo Decal authored Jul 08, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
```
  977180c9
08 Jul, 2025 3 commits
- [Docs] Improve documentation for Deepseek R1 on Ray Serve LLM (#20601) · b91cb3fa
  Ricardo Decal authored Jul 08, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
```
  b91cb3fa
- [Frontend] [Core] Integrate Tensorizer in to S3 loading machinery, allow... · 72d14d0e
  Sanger Steel authored Jul 08, 2025
```
[Frontend] [Core] Integrate Tensorizer in to S3 loading machinery, allow passing arbitrary arguments during save/load (#19619)
Signed-off-by: Sanger Steel <sangersteel@gmail.com>
Co-authored-by: Eta <esyra@coreweave.com>
```
  72d14d0e
- [Docs] Improve docstring for ray data llm example (#20597) · e60d422f
  Ricardo Decal authored Jul 07, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
```
  e60d422f
07 Jul, 2025 1 commit
- [Model][Last/4] Automatic conversion of CrossEncoding model (#19675) · 110df743
  wang.yuqi authored Jul 07, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  110df743
06 Jul, 2025 3 commits

[V1] Support any head size for FlexAttention backend (#20467) · 9fb52e52
Cyrus Leung authored Jul 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
9fb52e52

[V0 deprecation] Remove V0 CPU/XPU/TPU backends (#20412) · e202dd27

Woosuk Kwon authored Jul 06, 2025


Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>

e202dd27

[Frontend] Support image object in llm.chat (#19635) · fe1e9248

Flora Feng authored Jul 05, 2025


Signed-off-by: sfeng33 <4florafeng@gmail.com>
Signed-off-by: Flora Feng <4florafeng@gmail.com>

fe1e9248

04 Jul, 2025 3 commits
- [Misc] Add SPDX-FileCopyrightText (#20428) · 1caca5a5
  Jee Jee Li authored Jul 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1caca5a5
- [Misc] small update (#20462) · a7bab0c9
  Reid authored Jul 04, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  a7bab0c9
- Add ignore consolidated file in mistral example code (#20420) · 25950dca
  汪志鹏 authored Jul 04, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  25950dca
03 Jul, 2025 2 commits
- [doc] fix link (#20417) · 359200f6
  Reid authored Jul 03, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  359200f6
- [Feature] Support MiniMax-M1 function calls features (#20297) · 363528de
  qscqesze authored Jul 03, 2025
```
Signed-off-by: QscQ <qscqesze@gmail.com>
Signed-off-by: qingjun <qingjun@minimaxi.com>
```
  363528de
02 Jul, 2025 1 commit
- [Model][VLM] Support Keye-VL-8B-Preview (#20126) · 8452946c
  Kwai-Keye authored Jul 02, 2025
```
Signed-off-by: Kwai-Keye <Keye@kuaishou.com>
```
  8452946c
01 Jul, 2025 4 commits
- [Docs] Update transcriptions API to use openai client with `stream=True` (#20271) · 314af861
  Nicolò Lucchesi authored Jul 01, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  314af861
- Add GLM4.1V model (Draft) (#19331) · ed70f3c6
  Yuxuan Zhang authored Jul 01, 2025
```
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  ed70f3c6
- [Example] add one-click runnable example for P2P NCCL XpYd (#20246) · 92ee7baa
  Kuntai Du authored Jun 30, 2025
```
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
```
  92ee7baa
- [Misc] Fix spec decode example (#20296) · 7151f922
  Woosuk Kwon authored Jun 30, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  7151f922
30 Jun, 2025 1 commit
- [Spec Decode] Clean up spec decode example (#20240) · 2965c99c
  Woosuk Kwon authored Jun 30, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2965c99c
28 Jun, 2025 1 commit
- fix ci issue distributed 4 gpu test (#20204) · d45417b8
  Wentao Ye authored Jun 28, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  d45417b8
26 Jun, 2025 1 commit
- [Benchmark][Bug] Fix multiple bugs in bench and add args to spec_decode offline (#20083) · 9502c381
  Ekagra Ranjan authored Jun 26, 2025
  
  9502c381
25 Jun, 2025 1 commit

[Frontend] Add `/v1/audio/translations` OpenAI API endpoint (#19615) · e795d723

Nicolò Lucchesi authored Jun 25, 2025


Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

e795d723

24 Jun, 2025 1 commit

refactor example - qwen3_reranker (#19847) · 26d34eb6

Reid authored Jun 24, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

26d34eb6

23 Jun, 2025 2 commits
- [Docs] Fix syntax highlighting of shell commands (#19870) · c3649e4f
  Lukas Geiger authored Jun 23, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  c3649e4f
- [doc] use MkDocs collapsible blocks - supplement (#19973) · b82e0f82
  Reid authored Jun 23, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  b82e0f82
21 Jun, 2025 1 commit
- [New model support]Support Tarsier2 (#19887) · c3bf9bad
  汪志鹏 authored Jun 21, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  c3bf9bad
20 Jun, 2025 2 commits

[Misc] refactor example - openai_transcription_client (#19851) · e384f2f1
Reid authored Jun 20, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
e384f2f1

[Misc] update cuda version (#19526) · 089a306f

Reid authored Jun 20, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

089a306f

19 Jun, 2025 2 commits

Add xLAM tool parser support (#17148) · 1d0ae26c
Zuxin authored Jun 18, 2025

1d0ae26c

Support embedding models in V1 (#16188) · 799397ee

Maximilien de Bayser authored Jun 19, 2025


Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>

799397ee

18 Jun, 2025 1 commit
- [V1][P/D] An native implementation of xPyD based on P2P NCCL (#18242) · eccdc831
  Zhonghua Deng authored Jun 18, 2025
```
Signed-off-by: Abatom <abzhonghua@gmail.com>
```
  eccdc831
17 Jun, 2025 1 commit
- [Doc] Add missing llava family multi-image examples (#19698) · aed84686
  Isotr0py authored Jun 17, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  aed84686
16 Jun, 2025 1 commit
- [DOC] Add reasoning capability to vLLM streamlit code (#19557) · 3e750697
  Navanit Dubey authored Jun 16, 2025
  
  3e750697
13 Jun, 2025 1 commit
- [Doc] uses absolute links for structured outputs (#19582) · 7b3c9ff9
  Aaron Pham authored Jun 12, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  7b3c9ff9
12 Jun, 2025 3 commits
- [Doc] Unify structured outputs examples (#18196) · dba68f91
  Aaron Pham authored Jun 12, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  dba68f91
- [Spec Decode][Benchmark] Generalize spec decode offline benchmark to more... · 017ef648
  Ekagra Ranjan authored Jun 12, 2025
```
[Spec Decode][Benchmark] Generalize spec decode offline benchmark to more methods and datasets (#18847)
```
  017ef648
- Fix typo (#19525) · dff68000
  niu_he authored Jun 12, 2025
```
Signed-off-by: 2niuhe <carlton2tang@gmail.com>
```
  dff68000
11 Jun, 2025 2 commits
- [Bugfix] Update the example code, make it work with the latest lmcache (#19453) · 943ffa57
  runzhen authored Jun 11, 2025
```
Signed-off-by: Runzhen Wang <wangrunzhen@gmail.com>
```
  943ffa57
- [New Model]: Support Qwen3 Embedding & Reranker (#19260) · 3952731e
  wang.yuqi authored Jun 11, 2025
  
  3952731e
10 Jun, 2025 1 commit

[Misc] refactor neuron_multimodal and profiling (#19397) · 6b1391ca

Reid authored Jun 10, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

6b1391ca