Commits · 5950f555a1d2ce19c30efb24abe03737320d05c1 · OpenDAS / vllm_cscc

"cacheflow/engine/ray_utils.py" did not exist on "c3442c1f6fabe54adb82d2d676920c5f31b9834e"

08 Jan, 2025 1 commit
- [Doc] Group examples into categories (#11782) · 5950f555
  Harry Mellor authored Jan 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  5950f555
07 Jan, 2025 8 commits
- [Doc]Add documentation for using EAGLE in vLLM (#11417) · 973f5dc5
  sroy745 authored Jan 07, 2025
```
Signed-off-by: Sourashis Roy <sroy@roblox.com>
```
  973f5dc5
- [Doc] Add note to `gte-Qwen2` models (#11808) · c0efe92d
  Cyrus Leung authored Jan 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c0efe92d
- [doc] update how pip can install nightly wheels (#11806) · d9fa1c05
  youkaichao authored Jan 07, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  d9fa1c05
- [V1] Support audio language models on V1 (#11733) · 2de197bd
  Roger Wang authored Jan 07, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  2de197bd
- [doc] add doc to explain how to use uv (#11773) · 869e829b
  youkaichao authored Jan 07, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  869e829b
- [V1][Doc] Update V1 support for `LLaVa-NeXT-Video` (#11798) · 8082ad79
  Roger Wang authored Jan 07, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  8082ad79
- [Doc] Create a vulnerability management team (#9925) · ce1917fc
  Russell Bryant authored Jan 07, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  ce1917fc
- [Doc][3/N] Reorganize Serving section (#11766) · 8ceffbf3
  Cyrus Leung authored Jan 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8ceffbf3
06 Jan, 2025 5 commits
- [V1] Extend beyond image modality and support mixed-modality inference with... · 91b361ae
  Roger Wang authored Jan 06, 2025
```
[V1] Extend beyond image modality and support mixed-modality inference with Llava-OneVision (#11685)
Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  91b361ae
- [doc] explain how to add interleaving sliding window support (#11771) · 4ca5d40a
  youkaichao authored Jan 06, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  4ca5d40a
- [Doc][2/N] Reorganize Models and Usage sections (#11755) · ee77fdb5
  Cyrus Leung authored Jan 06, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ee77fdb5
- k8s-config: Update the secret to use stringData (#11679) · 2a622d70
  Suraj Deshmukh authored Jan 06, 2025
```
Signed-off-by: Suraj Deshmukh <surajd.service@gmail.com>
```
  2a622d70
- [Doc] [1/N] Reorganize Getting Started section (#11645) · 402d3783
  Cyrus Leung authored Jan 06, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  402d3783
04 Jan, 2025 2 commits
- Update bnb.md with example for OpenAI (#11718) · d1d49397
  Alberto Ferrer authored Jan 04, 2025
  
  d1d49397
- Update tool_calling.md (#11701) · 9c93636d
  Hust_YangXian authored Jan 04, 2025
  
  9c93636d
03 Jan, 2025 1 commit
- Update default max_num_batch_tokens for chunked prefill (#11694) · 2f1e8e8f
  Sachin Varghese authored Jan 02, 2025
  
  2f1e8e8f
02 Jan, 2025 1 commit
- According to vllm.EngineArgs, the name should be distributed_executor_backend (#11689) · 84c35c37
  Chunyang Wen authored Jan 03, 2025
  
  84c35c37
01 Jan, 2025 1 commit

[VLM] Add max-count checking in data parser for single image models (#11661) · 365801fe

Cyrus Leung authored Jan 01, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

365801fe

31 Dec, 2024 2 commits

[V1][VLM] V1 support for selected single-image models. (#11632) · e7c7c5e8

Roger Wang authored Dec 31, 2024


Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Isotr0py <2037008807@qq.com>

e7c7c5e8

[Model][LoRA]LoRA support added for MolmoForCausalLM (#11439) · a2a40bcd

Matthias Vogler authored Dec 31, 2024


Signed-off-by: Matthias Vogler <matthias.vogler@joesecurity.org>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Matthias Vogler <matthias.vogler@joesecurity.org>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

a2a40bcd

30 Dec, 2024 1 commit
- [platforms] enable platform plugins (#11602) · b12e87f9
  youkaichao authored Dec 30, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  b12e87f9
29 Dec, 2024 1 commit
- [Doc] Convert list tables to MyST (#11594) · 32b4c63f
  Cyrus Leung authored Dec 29, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  32b4c63f
28 Dec, 2024 3 commits
- [bugfix] interleaving sliding window for cohere2 model (#11583) · 328841d0
  youkaichao authored Dec 29, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  328841d0
- [Doc] Minor documentation fixes (#11580) · d427e5cf
  Cyrus Leung authored Dec 28, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d427e5cf
- [Model] Support InternLM2 Reward models (#11571) · d34be24b
  Isotr0py authored Dec 28, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  d34be24b
27 Dec, 2024 5 commits
- [VLM] Support caching in merged multi-modal processor (#11396) · 10141809
  Cyrus Leung authored Dec 28, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  10141809
- [Doc] Add xgrammar in doc (#11549) · 5ce4627a
  Chen1022 authored Dec 27, 2024
```
Signed-off-by: ccjincong <chenjincong11@gmail.com>
```
  5ce4627a
- Update deploying_with_k8s.md with AMD ROCm GPU example (#11465) · d003f3ea
  AlexHe99 authored Dec 27, 2024
```
Signed-off-by: Alex He <alehe@amd.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  d003f3ea
- Update openai_compatible_server.md (#11536) · 0c0c2015
  Robert Shaw authored Dec 26, 2024
```
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  0c0c2015
- [Docs] Document Deepseek V3 support (#11535) · 82d24f7a
  Simon Mo authored Dec 26, 2024
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  82d24f7a
26 Dec, 2024 2 commits
- [Doc] Add video example to openai client for multimodal (#11521) · b85a9778
  Isotr0py authored Dec 27, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  b85a9778
- [Doc] Add `QVQ` and `QwQ` to the list of supported models (#11509) · 7492a362
  Roger Wang authored Dec 26, 2024
```
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  7492a362
25 Dec, 2024 1 commit
- [Doc] Improve GitHub links (#11491) · 6ad909fd
  Cyrus Leung authored Dec 26, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6ad909fd
24 Dec, 2024 2 commits
- [Model] Automatic conversion of classification and reward models (#11469) · 3f3e92e1
  Cyrus Leung authored Dec 25, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3f3e92e1
- [Frontend] Online Pooling API (#11457) · 9edca6bf
  Cyrus Leung authored Dec 24, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9edca6bf
23 Dec, 2024 2 commits
- [Docs] Convert rST to MyST (Markdown) (#11145) · 32aa2059
  Rafael Vasquez authored Dec 23, 2024
```
Signed-off-by: Rafael Vasquez <rafvasq21@gmail.com>
```
  32aa2059
- [Bugfix] torch nightly version in ROCm installation guide (#11423) · 2e726680
  Yuan Tang authored Dec 23, 2024
```
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
```
  2e726680
20 Dec, 2024 2 commits
- [doc] explain nccl requirements for rlhf (#11381) · 5d2248d8
  youkaichao authored Dec 20, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  5d2248d8
- [Core] Loading model from S3 using RunAI Model Streamer as optional loader (#10192) · 995f5623
  omer-dayan authored Dec 20, 2024
```
Signed-off-by: OmerD <omer@run.ai>
```
  995f5623