Commits · 4c676e3db3acddcd2acfd3c7ccab32ac7b9add5a · OpenDAS / vllm_cscc

04 Jun, 2025 2 commits
- Allow AsyncLLMEngine.generate to target a specific DP rank (#19102) · c8dcc159
  jmswen authored Jun 04, 2025
```
Signed-off-by: Jon Swenson <jmswen@gmail.com>
```
  c8dcc159
- [Cleanup][v1]:remote guided-decoding-backend for example (#19059) · 8d646c2e
  Calvin Chen authored Jun 04, 2025
```
Signed-off-by: calvin chen <120380290@qq.com>
```
  8d646c2e
03 Jun, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
28 May, 2025 1 commit
- [V1][Metrics] Remove metrics that were deprecated in 0.8 (#18837) · 0e98964e
  Mark McLoughlin authored May 28, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  0e98964e
26 May, 2025 1 commit
- Convert `examples` to `ruff-format` (#18400) · 27bebcd8
  Harry Mellor authored May 26, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  27bebcd8
22 May, 2025 2 commits
- [Doc] Add stream flag for chat completion example (#18524) · 3f505233
  Calvin Chen authored May 22, 2025
```
Signed-off-by: calvin chen <120380290@qq.com>
```
  3f505233
- [Doc] Support --stream arg in openai_completion_client.py script (#18388) · 71075029
  CYJiang authored May 22, 2025
```
Signed-off-by: googs1025 <googs1025@gmail.com>
```
  71075029
20 May, 2025 1 commit

[Misc] refactor prompt embedding examples (#18405) · 8f55962a

Reid authored May 20, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

8f55962a

19 May, 2025 1 commit

[Misc] extract parser.parse_args() (#18323) · 27d09526

Reid authored May 19, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

27d09526

16 May, 2025 1 commit
- [doc] fix multimodal example script (#18089) · 5c04bb8b
  David Xia authored May 16, 2025
```
Signed-off-by: David Xia <david@davidxia.com>
```
  5c04bb8b
15 May, 2025 1 commit
- Improve examples rendering in docs and GitHub (#18203) · 51ff1546
  Harry Mellor authored May 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  51ff1546
11 May, 2025 1 commit
- [Frontend] Add /classify endpoint (#17032) · 9cea90ea
  Frieda Huang authored May 11, 2025
```
Signed-off-by: Frieda (Jingying) Huang <jingyingfhuang@gmail.com>
```
  9cea90ea
10 May, 2025 1 commit

[Misc] remove --model from vllm serve usage (#17944) · 4c31218f

Reid authored May 10, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

4c31218f

09 May, 2025 1 commit
- [Misc] Add references in ray_serve_deepseek example (#17907) · c44c384b
  Rui Qiao authored May 09, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  c44c384b
08 May, 2025 1 commit
- [Chore][Doc] uses model id determined from OpenAI client (#17815) · a8238bbd
  Aaron Pham authored May 07, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  a8238bbd
07 May, 2025 1 commit
- [Frontend] Add missing chat templates for various MLLMs (#17758) · 8a15c260
  Cyrus Leung authored May 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8a15c260
06 May, 2025 1 commit

[doc] Add RAG Integration example (#17692) · 7525d5f3

Reid authored May 07, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

7525d5f3

01 May, 2025 2 commits
- [Feature][Frontend]: Deprecate --enable-reasoning (#17452) · 98060b00
  Chauncey authored May 01, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  98060b00
- [doc] add streamlit integration (#17522) · 7169f87a
  Reid authored May 01, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  7169f87a
30 Apr, 2025 3 commits
- [BugFix] Fix authorization of openai_transcription_client.py (#17321) · d586ddc6
  zh Wang authored May 01, 2025
```
Signed-off-by: zh Wang <rekind133@outlook.com>
```
  d586ddc6
- [V1][Metrics] add support for kv event publishing (#16750) · 0be6d05b
  Alec authored Apr 30, 2025
```
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>
```
  0be6d05b
- Update PyTorch to 2.7.0 (#16859) · 2c4f59af
  Huy Do authored Apr 29, 2025
  
  2c4f59af
29 Apr, 2025 1 commit
- Simplify (and fix) passing of guided decoding backend options (#17008) · a6977dbd
  Harry Mellor authored Apr 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a6977dbd
26 Apr, 2025 1 commit
- [V1] Add `structural_tag` support using xgrammar (#17085) · f8acd01f
  Russell Bryant authored Apr 26, 2025
  
  f8acd01f
25 Apr, 2025 1 commit
- [Misc] Refine ray_serve_deepseek example (#17204) · c53e0730
  Rui Qiao authored Apr 25, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  c53e0730
24 Apr, 2025 4 commits
- [Misc] Add example to run DeepSeek with Ray Serve LLM (#17134) · 583e9009
  Rui Qiao authored Apr 24, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  583e9009
- [Misc] refactor example series - structured outputs (#17040) · 1bcbcbf5
  Reid authored Apr 24, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  1bcbcbf5
- [Frontend] Using matryoshka_dimensions control the allowed output dimensions. (#16970) · 67309a1c
  wang.yuqi authored Apr 24, 2025
  
  67309a1c
- [V1] Update structured output (#16812) · db2f8d91
  Reid authored Apr 24, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  db2f8d91
22 Apr, 2025 1 commit

[Misc] refactor example series (#16972) · 4b91c927

Reid authored Apr 22, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

4b91c927

19 Apr, 2025 1 commit

[Frontend] Add sampling params to `v1/audio/transcriptions` endpoint (#16591) · 2ef0dc53

Nicolò Lucchesi authored Apr 19, 2025


Signed-off-by: Jannis Schönleber <joennlae@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Jannis Schönleber <joennlae@gmail.com>

2ef0dc53

18 Apr, 2025 2 commits
- [Misc] refactor examples series - Chat Completion Client With Tools (#16829) · 5a5e29de
  Reid authored Apr 19, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  5a5e29de
- Improve-mm-and-pooler-and-decoding-configs (#16789) · e78587a6
  Harry Mellor authored Apr 18, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e78587a6
17 Apr, 2025 1 commit
- [Doc] Document Matryoshka Representation Learning support (#16770) · 11c3b984
  wang.yuqi authored Apr 17, 2025
  
  11c3b984
16 Apr, 2025 1 commit

[Misc] refactor examples series (#16708) · 71689204

Reid authored Apr 16, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

71689204

15 Apr, 2025 1 commit

[Misc] refactor argument parsing in examples (#16635) · 6ae996a8

Reid authored Apr 15, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

6ae996a8

14 Apr, 2025 1 commit

[Misc] refactor examples (#16563) · 7cbfc109

Reid authored Apr 14, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

7cbfc109

12 Apr, 2025 1 commit
- [Misc] Openai transcription client example use same Whisper model (#16487) · f069f3ea
  Nicolò Lucchesi authored Apr 12, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  f069f3ea
11 Apr, 2025 1 commit

[Misc] update api_client example (#16459) · 35e076b3

Reid authored Apr 11, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

35e076b3

02 Apr, 2025 1 commit

[Frontend] Implement Tool Calling with `tool_choice='required'` (#13483) · cefb9e5a

Matthias Matt authored Apr 02, 2025


Signed-off-by: Liangfu Chen <liangfc@amazon.com>
Signed-off-by: Matt, Matthias <matthias.matt@tuwien.ac.at>
Co-authored-by: Liangfu Chen <liangfc@amazon.com>
Co-authored-by: mgoin <michael@neuralmagic.com>

cefb9e5a