Commits · 5a7fb3ab9ee4bd8174a5100595326f6f40024cdc · OpenDAS / vllm_cscc

16 Jul, 2025 1 commit

[Meta] Llama4 EAGLE Support (#20591) · c11013db

zhiweiz authored Jul 15, 2025


Signed-off-by: qizixi <qizixi@meta.com>
Co-authored-by: qizixi <qizixi@meta.com>

c11013db

15 Jul, 2025 2 commits
- Voxtral (#20970) · e7e3e6d2
  Patrick von Platen authored Jul 15, 2025
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  e7e3e6d2
- [Docs] Improve documentation for RLHF example (#20598) · 235bfd5d
  Ricardo Decal authored Jul 15, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
```
  235bfd5d
10 Jul, 2025 1 commit
- [Model][VLM] Support JinaVL Reranker (#20260) · 4bed1677
  shineran96 authored Jul 11, 2025
```
Signed-off-by: shineran96 <shinewang96@gmail.com>
```
  4bed1677
09 Jul, 2025 1 commit

[Docs] Improve docs for RLHF co-location example (#20599) · 853487bc

Ricardo Decal authored Jul 09, 2025


Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

853487bc

08 Jul, 2025 1 commit
- [Docs] Improve docstring for ray data llm example (#20597) · e60d422f
  Ricardo Decal authored Jul 07, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
```
  e60d422f
07 Jul, 2025 1 commit
- [Model][Last/4] Automatic conversion of CrossEncoding model (#19675) · 110df743
  wang.yuqi authored Jul 07, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  110df743
06 Jul, 2025 2 commits
- [V1] Support any head size for FlexAttention backend (#20467) · 9fb52e52
  Cyrus Leung authored Jul 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9fb52e52
- [Frontend] Support image object in llm.chat (#19635) · fe1e9248
  Flora Feng authored Jul 05, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Signed-off-by: Flora Feng <4florafeng@gmail.com>
```
  fe1e9248
04 Jul, 2025 3 commits
- [Misc] Add SPDX-FileCopyrightText (#20428) · 1caca5a5
  Jee Jee Li authored Jul 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1caca5a5
- [Misc] small update (#20462) · a7bab0c9
  Reid authored Jul 04, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  a7bab0c9
- Add ignore consolidated file in mistral example code (#20420) · 25950dca
  汪志鹏 authored Jul 04, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  25950dca
03 Jul, 2025 1 commit
- [doc] fix link (#20417) · 359200f6
  Reid authored Jul 03, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  359200f6
02 Jul, 2025 1 commit
- [Model][VLM] Support Keye-VL-8B-Preview (#20126) · 8452946c
  Kwai-Keye authored Jul 02, 2025
```
Signed-off-by: Kwai-Keye <Keye@kuaishou.com>
```
  8452946c
01 Jul, 2025 2 commits

Add GLM4.1V model (Draft) (#19331) · ed70f3c6

Yuxuan Zhang authored Jul 01, 2025


Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

ed70f3c6

[Misc] Fix spec decode example (#20296) · 7151f922
Woosuk Kwon authored Jun 30, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
7151f922

30 Jun, 2025 1 commit
- [Spec Decode] Clean up spec decode example (#20240) · 2965c99c
  Woosuk Kwon authored Jun 30, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2965c99c
28 Jun, 2025 1 commit
- fix ci issue distributed 4 gpu test (#20204) · d45417b8
  Wentao Ye authored Jun 28, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  d45417b8
26 Jun, 2025 1 commit
- [Benchmark][Bug] Fix multiple bugs in bench and add args to spec_decode offline (#20083) · 9502c381
  Ekagra Ranjan authored Jun 26, 2025
  
  9502c381
24 Jun, 2025 1 commit

refactor example - qwen3_reranker (#19847) · 26d34eb6

Reid authored Jun 24, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

26d34eb6

23 Jun, 2025 1 commit
- [Docs] Fix syntax highlighting of shell commands (#19870) · c3649e4f
  Lukas Geiger authored Jun 23, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  c3649e4f
21 Jun, 2025 1 commit
- [New model support]Support Tarsier2 (#19887) · c3bf9bad
  汪志鹏 authored Jun 21, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  c3bf9bad
19 Jun, 2025 1 commit

Support embedding models in V1 (#16188) · 799397ee

Maximilien de Bayser authored Jun 19, 2025


Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>

799397ee

17 Jun, 2025 1 commit
- [Doc] Add missing llava family multi-image examples (#19698) · aed84686
  Isotr0py authored Jun 17, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  aed84686
12 Jun, 2025 2 commits
- [Spec Decode][Benchmark] Generalize spec decode offline benchmark to more... · 017ef648
  Ekagra Ranjan authored Jun 12, 2025
```
[Spec Decode][Benchmark] Generalize spec decode offline benchmark to more methods and datasets (#18847)
```
  017ef648
- Fix typo (#19525) · dff68000
  niu_he authored Jun 12, 2025
```
Signed-off-by: 2niuhe <carlton2tang@gmail.com>
```
  dff68000
11 Jun, 2025 1 commit
- [New Model]: Support Qwen3 Embedding & Reranker (#19260) · 3952731e
  wang.yuqi authored Jun 11, 2025
  
  3952731e
10 Jun, 2025 1 commit

[Misc] refactor neuron_multimodal and profiling (#19397) · 6b1391ca

Reid authored Jun 10, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

6b1391ca

07 Jun, 2025 1 commit

[Misc] refactor context extension (#19246) · 122cdca5

Reid authored Jun 07, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

122cdca5

04 Jun, 2025 1 commit
- Fix #19130 (#19132) · 3336c8cf
  汪志鹏 authored Jun 04, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  3336c8cf
03 Jun, 2025 3 commits
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
- Add tarsier model support (#18985) · 1282bd81
  汪志鹏 authored Jun 03, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  1282bd81
- [Hardware][TPU] Initial support of model parallelism with single worker using SPMD (#18011) · 9112b443
  Siyuan Liu authored Jun 02, 2025
```
Signed-off-by: Siyuan Liu <lsiyuan@google.com>
Co-authored-by: Hossein Sarshar <hossein.sarshar@gmail.com>
Co-authored-by: Chengji Yao <chengjiyao@google.com>
```
  9112b443
02 Jun, 2025 1 commit
- add an absolute path for run.sh (#18258) · c57d577e
  Calvin Chen authored Jun 03, 2025
```
Signed-off-by: calvin chen <120380290@qq.com>
```
  c57d577e
31 May, 2025 2 commits

[BugFix] Fix multi-node offline data-parallel (#18981) · 9a1b9b99

Nick Hill authored May 31, 2025


Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Yizhou Liu <liu_yizhou@outlook.com>

9a1b9b99

[Neuron] Add Multi-Modal model support for Neuron (#18921) · 2a50ef57

Satyajith Chilappagari authored May 31, 2025


Signed-off-by: Satyajith Chilappagari <satchill@amazon.com>
Co-authored-by: Ashraf Mahgoub <ashymahg@amazon.com>
Co-authored-by: Rohith Nallamaddi <nalrohit@amazon.com>
Co-authored-by: FeliciaLuo <luof@amazon.com>
Co-authored-by: Elaine Zhao <elaineyz@amazon.com>

2a50ef57

28 May, 2025 2 commits
- [Frontend] add run batch to CLI (#18804) · 435fa954
  Reid authored May 28, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  435fa954
- [Bugfix] Fix nomic max_model_len (#18755) · 3e9ce609
  wang.yuqi authored May 28, 2025
  
  3e9ce609
27 May, 2025 2 commits
- [V1][Metrics] Add API for accessing in-memory Prometheus metrics (#17010) · 06a03380
  Mark McLoughlin authored May 27, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  06a03380
- [Misc] improve docs (#18734) · fc6d0c29
  Reid authored May 27, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  fc6d0c29