Commits · 6dd55af6c9dde9174e0616739d783133f5e45d42 · OpenDAS / vllm_cscc · GitLab

24 Mar, 2025 1 commit

[Doc] Update docs on handling OOM (#15357) · 6dd55af6

Cyrus Leung authored Mar 25, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

6dd55af6

23 Mar, 2025 1 commit
- [Misc][Doc] Add note regarding loading `generation_config` by default (#15281) · 9c5c81b0
  Roger Wang authored Mar 23, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  9c5c81b0
21 Mar, 2025 3 commits
- Revert "[Feature] specify model in config.yaml (#14855)" (#15293) · baec0d4d
  Cyrus Leung authored Mar 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  baec0d4d
- [Feature] specify model in config.yaml (#14855) · 0fa3970d
  Wei Zeng authored Mar 21, 2025
```
Signed-off-by: weizeng <weizeng@roblox.com>
```
  0fa3970d
- Mention `extra_body` as a way top pass vLLM only parameters using the OpenAI client (#15240) · 6edbfa92
  Harry Mellor authored Mar 21, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6edbfa92
20 Mar, 2025 1 commit
- [Doc] Clarify run vllm only on one node in distributed inference (#15148) · 4cb1c05c
  Rui Qiao authored Mar 19, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  4cb1c05c
14 Mar, 2025 2 commits
- [V1][Metrics] Updated list of deprecated metrics in v0.8 (#14695) · 9d2b4a70
  Mark McLoughlin authored Mar 14, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  9d2b4a70
- [Doc] Fix typo in documentation (#14783) · 3fb17d26
  yasu52 authored Mar 13, 2025
```
Signed-off-by: yasu52 <tsuguro4649@gmail.com>
```
  3fb17d26
10 Mar, 2025 1 commit
- [Frontend] support image embeds (#13955) · b0746fae
  Chauncey authored Mar 10, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  b0746fae
06 Mar, 2025 2 commits
- [Frontend][Docs] Transcription API streaming (#13301) · fa82b938
  Nicolò Lucchesi authored Mar 06, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  fa82b938
- [misc] Mention `ray list nodes` command to troubleshoot ray issues (#14318) · abcc61e0
  Rui Qiao authored Mar 05, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  abcc61e0
28 Feb, 2025 1 commit
- [Doc] Move multimodal Embedding API example to Online Serving page (#14017) · 1088f062
  Cyrus Leung authored Feb 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1088f062
22 Feb, 2025 1 commit
- [Metrics] Add `--show-hidden-metrics-for-version` CLI arg (#13295) · 2cb8c154
  Mark McLoughlin authored Feb 22, 2025
  
  2cb8c154
21 Feb, 2025 1 commit
- [FEATURE] Enables /score endpoint for embedding models (#12846) · 1c3c9757
  Gabriel Marinho authored Feb 21, 2025
  
  1c3c9757
19 Feb, 2025 1 commit
- [doc] clarify multi-node serving doc (#13558) · ad5a35c2
  youkaichao authored Feb 19, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  ad5a35c2
17 Feb, 2025 1 commit
- [VLM] Check required fields before initializing field config in `DictEmbeddingItems` (#13380) · 7b623fca
  Cyrus Leung authored Feb 17, 2025
  
  7b623fca
13 Feb, 2025 1 commit
- [Frontend] Add `/v1/audio/transcriptions` OpenAI API endpoint (#12909) · d84cef76
  Nicolò Lucchesi authored Feb 13, 2025
  
  d84cef76
10 Feb, 2025 1 commit
- [Model] Ultravox Model: Support v0.5 Release (#12912) · 08b2d845
  Farzad Abdolhosseini authored Feb 10, 2025
```
Signed-off-by: Farzad Abdolhosseini <farzad@fixie.ai>
```
  08b2d845
08 Feb, 2025 1 commit
- [CI/Build] Auto-fix Markdown files (#12941) · 8a69e0e2
  Cyrus Leung authored Feb 08, 2025
  
  8a69e0e2
03 Feb, 2025 1 commit

[doc][misc] clarify VLLM_HOST_IP for multi-node inference (#12667) · e6433091

youkaichao authored Feb 03, 2025

As more and more people are trying deepseek models with multi-node
inference, https://github.com/vllm-project/vllm/issues/7815

 becomes more
frequent. Let's give clear message to users.
Signed-off-by: youkaichao <youkaichao@gmail.com>

e6433091

29 Jan, 2025 1 commit
- [Doc] Convert docs to use colon fences (#12471) · dd6a3a02
  Harry Mellor authored Jan 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  dd6a3a02
27 Jan, 2025 1 commit
- [Frontend] Rerank API (Jina- and Cohere-compatible API) (#12376) · 0034b09c
  Kyle Mistele authored Jan 26, 2025
```
Signed-off-by: Kyle Mistele <kyle@mistele.com>
```
  0034b09c
23 Jan, 2025 1 commit
- [Doc] Troubleshooting errors during model inspection (#12351) · d07efb31
  Cyrus Leung authored Jan 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d07efb31
16 Jan, 2025 1 commit
- [Doc] Add documentation for specifying model architecture (#12105) · f8ef146f
  Cyrus Leung authored Jan 16, 2025
  
  f8ef146f
12 Jan, 2025 1 commit
- [CI/Build] Add markdown linter (#11857) · 43f3d9e6
  Rafael Vasquez authored Jan 12, 2025
```
Signed-off-by: Rafael Vasquez <rafvasq21@gmail.com>
```
  43f3d9e6
10 Jan, 2025 3 commits
- [Doc] Rename offline inference examples (#11927) · 482cdc49
  Harry Mellor authored Jan 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  482cdc49
- [Doc] [1/N] Initial guide for merged multi-modal processor (#11925) · 12664ddd
  Cyrus Leung authored Jan 10, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  12664ddd
- Replace "online inference" with "online serving" (#11923) · d85c47d6
  Harry Mellor authored Jan 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d85c47d6
08 Jan, 2025 2 commits
- [Doc][4/N] Reorganize API Reference (#11843) · 6cd40a5b
  Cyrus Leung authored Jan 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6cd40a5b
- [Doc] Move examples into categories (#11840) · aba8d6ee
  Harry Mellor authored Jan 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  aba8d6ee
07 Jan, 2025 1 commit
- [Doc][3/N] Reorganize Serving section (#11766) · 8ceffbf3
  Cyrus Leung authored Jan 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8ceffbf3
06 Jan, 2025 3 commits
- [Doc][2/N] Reorganize Models and Usage sections (#11755) · ee77fdb5
  Cyrus Leung authored Jan 06, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ee77fdb5
- k8s-config: Update the secret to use stringData (#11679) · 2a622d70
  Suraj Deshmukh authored Jan 06, 2025
```
Signed-off-by: Suraj Deshmukh <surajd.service@gmail.com>
```
  2a622d70
- [Doc] [1/N] Reorganize Getting Started section (#11645) · 402d3783
  Cyrus Leung authored Jan 06, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  402d3783
02 Jan, 2025 1 commit
- According to vllm.EngineArgs, the name should be distributed_executor_backend (#11689) · 84c35c37
  Chunyang Wen authored Jan 03, 2025
  
  84c35c37
29 Dec, 2024 1 commit
- [Doc] Convert list tables to MyST (#11594) · 32b4c63f
  Cyrus Leung authored Dec 29, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  32b4c63f
28 Dec, 2024 1 commit
- [Doc] Minor documentation fixes (#11580) · d427e5cf
  Cyrus Leung authored Dec 28, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d427e5cf
27 Dec, 2024 2 commits
- Update deploying_with_k8s.md with AMD ROCm GPU example (#11465) · d003f3ea
  AlexHe99 authored Dec 27, 2024
```
Signed-off-by: Alex He <alehe@amd.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  d003f3ea
- Update openai_compatible_server.md (#11536) · 0c0c2015
  Robert Shaw authored Dec 26, 2024
```
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  0c0c2015
25 Dec, 2024 1 commit
- [Doc] Improve GitHub links (#11491) · 6ad909fd
  Cyrus Leung authored Dec 26, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6ad909fd