Commits · 9499e26e2ae18826bcda99ae7e0883268cde03db · OpenDAS / vllm_cscc

19 Jul, 2025 1 commit
- Elastic Expert Parallel Initial Support (#20775) · 21793722
  Rui Qiao authored Jul 18, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  21793722
18 Jul, 2025 1 commit
- [Doc] Add inplace weights loading example (#19640) · b38baabc
  22quinn authored Jul 17, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  b38baabc
17 Jul, 2025 3 commits
- [VLM] Add Nemotron-Nano-VL-8B-V1 support (#20349) · 4ef00b5c
  kYLe authored Jul 17, 2025
```
Signed-off-by: Kyle Huang <kylhuang@nvidia.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  4ef00b5c
- [Model] Add ToolParser and MoE Config for Hunyuan A13B (#20820) · 5a7fb3ab
  Asher authored Jul 17, 2025
```
Signed-off-by: Asher Zhang <asherszhang@tencent.com>
```
  5a7fb3ab
- [V1][P/D]Enhance Performance and code readability for P2pNcclConnector (#20906) · 8a4e5c5f
  Zhonghua Deng authored Jul 17, 2025
```
Signed-off-by: Abatom <abzhonghua@gmail.com>
```
  8a4e5c5f
16 Jul, 2025 1 commit

[Meta] Llama4 EAGLE Support (#20591) · c11013db

zhiweiz authored Jul 15, 2025


Signed-off-by: qizixi <qizixi@meta.com>
Co-authored-by: qizixi <qizixi@meta.com>

c11013db

15 Jul, 2025 3 commits
- Voxtral (#20970) · e7e3e6d2
  Patrick von Platen authored Jul 15, 2025
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  e7e3e6d2
- [Docs] Improve documentation for ray cluster launcher helper script (#20602) · 33d56000
  Ricardo Decal authored Jul 15, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
```
  33d56000
- [Docs] Improve documentation for RLHF example (#20598) · 235bfd5d
  Ricardo Decal authored Jul 15, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
```
  235bfd5d
10 Jul, 2025 2 commits
- Fix DeepSeek-R1-0528 chat template (#20717) · 25159536
  sfbemerk authored Jul 10, 2025
```
Signed-off-by: Benjamin Merkel <benjamin.merkel@tngtech.com>
Co-authored-by: Benjamin Merkel <benjamin.merkel@tngtech.com>
```
  25159536
- [Model][VLM] Support JinaVL Reranker (#20260) · 4bed1677
  shineran96 authored Jul 11, 2025
```
Signed-off-by: shineran96 <shinewang96@gmail.com>
```
  4bed1677
09 Jul, 2025 2 commits
- [Docs] Improve docs for RLHF co-location example (#20599) · 853487bc
  Ricardo Decal authored Jul 09, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  853487bc
- [Docs] Improve documentation for multi-node service helper script (#20600) · 977180c9
  Ricardo Decal authored Jul 08, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
```
  977180c9
08 Jul, 2025 3 commits
- [Docs] Improve documentation for Deepseek R1 on Ray Serve LLM (#20601) · b91cb3fa
  Ricardo Decal authored Jul 08, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
```
  b91cb3fa
- [Frontend] [Core] Integrate Tensorizer in to S3 loading machinery, allow... · 72d14d0e
  Sanger Steel authored Jul 08, 2025
```
[Frontend] [Core] Integrate Tensorizer in to S3 loading machinery, allow passing arbitrary arguments during save/load (#19619)
Signed-off-by: Sanger Steel <sangersteel@gmail.com>
Co-authored-by: Eta <esyra@coreweave.com>
```
  72d14d0e
- [Docs] Improve docstring for ray data llm example (#20597) · e60d422f
  Ricardo Decal authored Jul 07, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
```
  e60d422f
07 Jul, 2025 1 commit
- [Model][Last/4] Automatic conversion of CrossEncoding model (#19675) · 110df743
  wang.yuqi authored Jul 07, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  110df743
06 Jul, 2025 3 commits

[V1] Support any head size for FlexAttention backend (#20467) · 9fb52e52
Cyrus Leung authored Jul 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
9fb52e52

[V0 deprecation] Remove V0 CPU/XPU/TPU backends (#20412) · e202dd27

Woosuk Kwon authored Jul 06, 2025


Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>

e202dd27

[Frontend] Support image object in llm.chat (#19635) · fe1e9248

Flora Feng authored Jul 05, 2025


Signed-off-by: sfeng33 <4florafeng@gmail.com>
Signed-off-by: Flora Feng <4florafeng@gmail.com>

fe1e9248

04 Jul, 2025 3 commits
- [Misc] Add SPDX-FileCopyrightText (#20428) · 1caca5a5
  Jee Jee Li authored Jul 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1caca5a5
- [Misc] small update (#20462) · a7bab0c9
  Reid authored Jul 04, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  a7bab0c9
- Add ignore consolidated file in mistral example code (#20420) · 25950dca
  汪志鹏 authored Jul 04, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  25950dca
03 Jul, 2025 2 commits
- [doc] fix link (#20417) · 359200f6
  Reid authored Jul 03, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  359200f6
- [Feature] Support MiniMax-M1 function calls features (#20297) · 363528de
  qscqesze authored Jul 03, 2025
```
Signed-off-by: QscQ <qscqesze@gmail.com>
Signed-off-by: qingjun <qingjun@minimaxi.com>
```
  363528de
02 Jul, 2025 1 commit
- [Model][VLM] Support Keye-VL-8B-Preview (#20126) · 8452946c
  Kwai-Keye authored Jul 02, 2025
```
Signed-off-by: Kwai-Keye <Keye@kuaishou.com>
```
  8452946c
01 Jul, 2025 4 commits
- [Docs] Update transcriptions API to use openai client with `stream=True` (#20271) · 314af861
  Nicolò Lucchesi authored Jul 01, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  314af861
- Add GLM4.1V model (Draft) (#19331) · ed70f3c6
  Yuxuan Zhang authored Jul 01, 2025
```
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  ed70f3c6
- [Example] add one-click runnable example for P2P NCCL XpYd (#20246) · 92ee7baa
  Kuntai Du authored Jun 30, 2025
```
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
```
  92ee7baa
- [Misc] Fix spec decode example (#20296) · 7151f922
  Woosuk Kwon authored Jun 30, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  7151f922
30 Jun, 2025 1 commit
- [Spec Decode] Clean up spec decode example (#20240) · 2965c99c
  Woosuk Kwon authored Jun 30, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2965c99c
28 Jun, 2025 1 commit
- fix ci issue distributed 4 gpu test (#20204) · d45417b8
  Wentao Ye authored Jun 28, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  d45417b8
26 Jun, 2025 1 commit
- [Benchmark][Bug] Fix multiple bugs in bench and add args to spec_decode offline (#20083) · 9502c381
  Ekagra Ranjan authored Jun 26, 2025
  
  9502c381
25 Jun, 2025 1 commit

[Frontend] Add `/v1/audio/translations` OpenAI API endpoint (#19615) · e795d723

Nicolò Lucchesi authored Jun 25, 2025


Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

e795d723

24 Jun, 2025 1 commit

refactor example - qwen3_reranker (#19847) · 26d34eb6

Reid authored Jun 24, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

26d34eb6

23 Jun, 2025 2 commits
- [Docs] Fix syntax highlighting of shell commands (#19870) · c3649e4f
  Lukas Geiger authored Jun 23, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  c3649e4f
- [doc] use MkDocs collapsible blocks - supplement (#19973) · b82e0f82
  Reid authored Jun 23, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  b82e0f82
21 Jun, 2025 1 commit
- [New model support]Support Tarsier2 (#19887) · c3bf9bad
  汪志鹏 authored Jun 21, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  c3bf9bad
20 Jun, 2025 2 commits

[Misc] refactor example - openai_transcription_client (#19851) · e384f2f1
Reid authored Jun 20, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
e384f2f1

[Misc] update cuda version (#19526) · 089a306f

Reid authored Jun 20, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

089a306f