Commits · 2965c99c86b460ee819e4805764d769c7b7d3d8e · OpenDAS / vllm_cscc

30 Jun, 2025 1 commit
- [Spec Decode] Clean up spec decode example (#20240) · 2965c99c
  Woosuk Kwon authored Jun 30, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2965c99c
28 Jun, 2025 1 commit
- fix ci issue distributed 4 gpu test (#20204) · d45417b8
  Wentao Ye authored Jun 28, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  d45417b8
26 Jun, 2025 1 commit
- [Benchmark][Bug] Fix multiple bugs in bench and add args to spec_decode offline (#20083) · 9502c381
  Ekagra Ranjan authored Jun 26, 2025
  
  9502c381
25 Jun, 2025 1 commit

[Frontend] Add `/v1/audio/translations` OpenAI API endpoint (#19615) · e795d723

Nicolò Lucchesi authored Jun 25, 2025


Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

e795d723

24 Jun, 2025 1 commit

refactor example - qwen3_reranker (#19847) · 26d34eb6

Reid authored Jun 24, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

26d34eb6

23 Jun, 2025 2 commits
- [Docs] Fix syntax highlighting of shell commands (#19870) · c3649e4f
  Lukas Geiger authored Jun 23, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  c3649e4f
- [doc] use MkDocs collapsible blocks - supplement (#19973) · b82e0f82
  Reid authored Jun 23, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  b82e0f82
21 Jun, 2025 1 commit
- [New model support]Support Tarsier2 (#19887) · c3bf9bad
  汪志鹏 authored Jun 21, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  c3bf9bad
20 Jun, 2025 2 commits

[Misc] refactor example - openai_transcription_client (#19851) · e384f2f1
Reid authored Jun 20, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
e384f2f1

[Misc] update cuda version (#19526) · 089a306f

Reid authored Jun 20, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

089a306f

19 Jun, 2025 2 commits

Add xLAM tool parser support (#17148) · 1d0ae26c
Zuxin authored Jun 18, 2025

1d0ae26c

Support embedding models in V1 (#16188) · 799397ee

Maximilien de Bayser authored Jun 19, 2025


Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>

799397ee

18 Jun, 2025 1 commit
- [V1][P/D] An native implementation of xPyD based on P2P NCCL (#18242) · eccdc831
  Zhonghua Deng authored Jun 18, 2025
```
Signed-off-by: Abatom <abzhonghua@gmail.com>
```
  eccdc831
17 Jun, 2025 1 commit
- [Doc] Add missing llava family multi-image examples (#19698) · aed84686
  Isotr0py authored Jun 17, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  aed84686
16 Jun, 2025 1 commit
- [DOC] Add reasoning capability to vLLM streamlit code (#19557) · 3e750697
  Navanit Dubey authored Jun 16, 2025
  
  3e750697
13 Jun, 2025 1 commit
- [Doc] uses absolute links for structured outputs (#19582) · 7b3c9ff9
  Aaron Pham authored Jun 12, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  7b3c9ff9
12 Jun, 2025 3 commits
- [Doc] Unify structured outputs examples (#18196) · dba68f91
  Aaron Pham authored Jun 12, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  dba68f91
- [Spec Decode][Benchmark] Generalize spec decode offline benchmark to more... · 017ef648
  Ekagra Ranjan authored Jun 12, 2025
```
[Spec Decode][Benchmark] Generalize spec decode offline benchmark to more methods and datasets (#18847)
```
  017ef648
- Fix typo (#19525) · dff68000
  niu_he authored Jun 12, 2025
```
Signed-off-by: 2niuhe <carlton2tang@gmail.com>
```
  dff68000
11 Jun, 2025 2 commits
- [Bugfix] Update the example code, make it work with the latest lmcache (#19453) · 943ffa57
  runzhen authored Jun 11, 2025
```
Signed-off-by: Runzhen Wang <wangrunzhen@gmail.com>
```
  943ffa57
- [New Model]: Support Qwen3 Embedding & Reranker (#19260) · 3952731e
  wang.yuqi authored Jun 11, 2025
  
  3952731e
10 Jun, 2025 1 commit

[Misc] refactor neuron_multimodal and profiling (#19397) · 6b1391ca

Reid authored Jun 10, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

6b1391ca

07 Jun, 2025 1 commit

[Misc] refactor context extension (#19246) · 122cdca5

Reid authored Jun 07, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

122cdca5

04 Jun, 2025 5 commits
- Allow AsyncLLMEngine.generate to target a specific DP rank (#19102) · c8dcc159
  jmswen authored Jun 04, 2025
```
Signed-off-by: Jon Swenson <jmswen@gmail.com>
```
  c8dcc159
- Add DeepSeek-R1-0528 function call chat template (#18874) · 02658c2d
  Xu Wenqing authored Jun 04, 2025
```
Signed-off-by: 许文卿 <xwq391974@alibaba-inc.com>
```
  02658c2d
- Fix #19130 (#19132) · 3336c8cf
  汪志鹏 authored Jun 04, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  3336c8cf
- [Cleanup][v1]:remote guided-decoding-backend for example (#19059) · 8d646c2e
  Calvin Chen authored Jun 04, 2025
```
Signed-off-by: calvin chen <120380290@qq.com>
```
  8d646c2e
- [Misc] Fix path and python alias errors in disagg_prefill exmaples (#18919) · abd7df2f
  Jiaxin Shan authored Jun 03, 2025
  
  abd7df2f
03 Jun, 2025 3 commits
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
- Add tarsier model support (#18985) · 1282bd81
  汪志鹏 authored Jun 03, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  1282bd81
- [Hardware][TPU] Initial support of model parallelism with single worker using SPMD (#18011) · 9112b443
  Siyuan Liu authored Jun 02, 2025
```
Signed-off-by: Siyuan Liu <lsiyuan@google.com>
Co-authored-by: Hossein Sarshar <hossein.sarshar@gmail.com>
Co-authored-by: Chengji Yao <chengjiyao@google.com>
```
  9112b443
02 Jun, 2025 1 commit
- add an absolute path for run.sh (#18258) · c57d577e
  Calvin Chen authored Jun 03, 2025
```
Signed-off-by: calvin chen <120380290@qq.com>
```
  c57d577e
31 May, 2025 2 commits

[BugFix] Fix multi-node offline data-parallel (#18981) · 9a1b9b99

Nick Hill authored May 31, 2025


Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Yizhou Liu <liu_yizhou@outlook.com>

9a1b9b99

[Neuron] Add Multi-Modal model support for Neuron (#18921) · 2a50ef57

Satyajith Chilappagari authored May 31, 2025


Signed-off-by: Satyajith Chilappagari <satchill@amazon.com>
Co-authored-by: Ashraf Mahgoub <ashymahg@amazon.com>
Co-authored-by: Rohith Nallamaddi <nalrohit@amazon.com>
Co-authored-by: FeliciaLuo <luof@amazon.com>
Co-authored-by: Elaine Zhao <elaineyz@amazon.com>

2a50ef57

28 May, 2025 3 commits
- [V1][Metrics] Remove metrics that were deprecated in 0.8 (#18837) · 0e98964e
  Mark McLoughlin authored May 28, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  0e98964e
- [Frontend] add run batch to CLI (#18804) · 435fa954
  Reid authored May 28, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  435fa954
- [Bugfix] Fix nomic max_model_len (#18755) · 3e9ce609
  wang.yuqi authored May 28, 2025
  
  3e9ce609
27 May, 2025 3 commits
- [V1][Metrics] Add API for accessing in-memory Prometheus metrics (#17010) · 06a03380
  Mark McLoughlin authored May 27, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  06a03380
- [Misc] improve docs (#18734) · fc6d0c29
  Reid authored May 27, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  fc6d0c29
- [Doc] Update reproducibility doc and example (#18741) · 753944fa
  Cyrus Leung authored May 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  753944fa