Commits · d93d2d74fd807a091add17c2065ee8869339f76a · OpenDAS / vllm_cscc

06 Jan, 2025 5 commits
- [V1] Extend beyond image modality and support mixed-modality inference with... · 91b361ae
  Roger Wang authored Jan 06, 2025
```
[V1] Extend beyond image modality and support mixed-modality inference with Llava-OneVision (#11685)
Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  91b361ae
- [doc] explain how to add interleaving sliding window support (#11771) · 4ca5d40a
  youkaichao authored Jan 06, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  4ca5d40a
- [Doc][2/N] Reorganize Models and Usage sections (#11755) · ee77fdb5
  Cyrus Leung authored Jan 06, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ee77fdb5
- k8s-config: Update the secret to use stringData (#11679) · 2a622d70
  Suraj Deshmukh authored Jan 06, 2025
```
Signed-off-by: Suraj Deshmukh <surajd.service@gmail.com>
```
  2a622d70
- [Doc] [1/N] Reorganize Getting Started section (#11645) · 402d3783
  Cyrus Leung authored Jan 06, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  402d3783
04 Jan, 2025 2 commits
- Update bnb.md with example for OpenAI (#11718) · d1d49397
  Alberto Ferrer authored Jan 04, 2025
  
  d1d49397
- Update tool_calling.md (#11701) · 9c93636d
  Hust_YangXian authored Jan 04, 2025
  
  9c93636d
03 Jan, 2025 1 commit
- Update default max_num_batch_tokens for chunked prefill (#11694) · 2f1e8e8f
  Sachin Varghese authored Jan 02, 2025
  
  2f1e8e8f
02 Jan, 2025 1 commit
- According to vllm.EngineArgs, the name should be distributed_executor_backend (#11689) · 84c35c37
  Chunyang Wen authored Jan 03, 2025
  
  84c35c37
01 Jan, 2025 1 commit

[VLM] Add max-count checking in data parser for single image models (#11661) · 365801fe

Cyrus Leung authored Jan 01, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

365801fe

31 Dec, 2024 2 commits

[V1][VLM] V1 support for selected single-image models. (#11632) · e7c7c5e8

Roger Wang authored Dec 31, 2024


Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Isotr0py <2037008807@qq.com>

e7c7c5e8

[Model][LoRA]LoRA support added for MolmoForCausalLM (#11439) · a2a40bcd

Matthias Vogler authored Dec 31, 2024


Signed-off-by: Matthias Vogler <matthias.vogler@joesecurity.org>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Matthias Vogler <matthias.vogler@joesecurity.org>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

a2a40bcd

30 Dec, 2024 1 commit
- [platforms] enable platform plugins (#11602) · b12e87f9
  youkaichao authored Dec 30, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  b12e87f9
29 Dec, 2024 1 commit
- [Doc] Convert list tables to MyST (#11594) · 32b4c63f
  Cyrus Leung authored Dec 29, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  32b4c63f
28 Dec, 2024 3 commits
- [bugfix] interleaving sliding window for cohere2 model (#11583) · 328841d0
  youkaichao authored Dec 29, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  328841d0
- [Doc] Minor documentation fixes (#11580) · d427e5cf
  Cyrus Leung authored Dec 28, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d427e5cf
- [Model] Support InternLM2 Reward models (#11571) · d34be24b
  Isotr0py authored Dec 28, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  d34be24b
27 Dec, 2024 5 commits
- [VLM] Support caching in merged multi-modal processor (#11396) · 10141809
  Cyrus Leung authored Dec 28, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  10141809
- [Doc] Add xgrammar in doc (#11549) · 5ce4627a
  Chen1022 authored Dec 27, 2024
```
Signed-off-by: ccjincong <chenjincong11@gmail.com>
```
  5ce4627a
- Update deploying_with_k8s.md with AMD ROCm GPU example (#11465) · d003f3ea
  AlexHe99 authored Dec 27, 2024
```
Signed-off-by: Alex He <alehe@amd.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  d003f3ea
- Update openai_compatible_server.md (#11536) · 0c0c2015
  Robert Shaw authored Dec 26, 2024
```
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  0c0c2015
- [Docs] Document Deepseek V3 support (#11535) · 82d24f7a
  Simon Mo authored Dec 26, 2024
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  82d24f7a
26 Dec, 2024 2 commits
- [Doc] Add video example to openai client for multimodal (#11521) · b85a9778
  Isotr0py authored Dec 27, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  b85a9778
- [Doc] Add `QVQ` and `QwQ` to the list of supported models (#11509) · 7492a362
  Roger Wang authored Dec 26, 2024
```
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  7492a362
25 Dec, 2024 1 commit
- [Doc] Improve GitHub links (#11491) · 6ad909fd
  Cyrus Leung authored Dec 26, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6ad909fd
24 Dec, 2024 2 commits
- [Model] Automatic conversion of classification and reward models (#11469) · 3f3e92e1
  Cyrus Leung authored Dec 25, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3f3e92e1
- [Frontend] Online Pooling API (#11457) · 9edca6bf
  Cyrus Leung authored Dec 24, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9edca6bf
23 Dec, 2024 2 commits
- [Docs] Convert rST to MyST (Markdown) (#11145) · 32aa2059
  Rafael Vasquez authored Dec 23, 2024
```
Signed-off-by: Rafael Vasquez <rafvasq21@gmail.com>
```
  32aa2059
- [Bugfix] torch nightly version in ROCm installation guide (#11423) · 2e726680
  Yuan Tang authored Dec 23, 2024
```
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
```
  2e726680
20 Dec, 2024 4 commits
- [doc] explain nccl requirements for rlhf (#11381) · 5d2248d8
  youkaichao authored Dec 20, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  5d2248d8
- [Core] Loading model from S3 using RunAI Model Streamer as optional loader (#10192) · 995f5623
  omer-dayan authored Dec 20, 2024
```
Signed-off-by: OmerD <omer@run.ai>
```
  995f5623
- [doc] backward compatibility for 0.6.4 (#11359) · 1ecc645b
  youkaichao authored Dec 19, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  1ecc645b
- [ci][gh200] dockerfile clean up (#11351) · 7801f56e
  youkaichao authored Dec 19, 2024
```
Signed-off-by: drikster80 <ed.sealing@gmail.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: drikster80 <ed.sealing@gmail.com>
Co-authored-by: cenzhiyao <2523403608@qq.com>
```
  7801f56e
19 Dec, 2024 2 commits

[Model] Add JambaForSequenceClassification model (#10860) · 6c7f8815

Yehoshua Cohen authored Dec 19, 2024


Signed-off-by: Yehoshua Cohen <yehoshuaco@ai21.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Yehoshua Cohen <yehoshuaco@ai21.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

6c7f8815

[Model] IBM Granite 3.1 (#11307) · 17ca9642
Travis Johnson authored Dec 18, 2024
```
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
```
17ca9642

17 Dec, 2024 2 commits
- [Frontend] Add OpenAI API support for input_audio (#11027) · 66d4b167
  kYLe authored Dec 17, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  66d4b167
- fix gh200 tests on main (#11246) · 35bae114
  youkaichao authored Dec 16, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  35bae114
16 Dec, 2024 3 commits
- [Docs] hint to enable use of GPU performance counters in profiling tools for... · 35ffa682
  bk-TurbaAI authored Dec 16, 2024
```
[Docs] hint to enable use of GPU performance counters in profiling tools for multi-node distributed serving (#11235)
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  35ffa682
- [Model] Support Cohere2ForCausalLM (Cohere R7B) (#11203) · bddbbcb1
  Jani Monoses authored Dec 16, 2024
  
  bddbbcb1
- WIP: [CI/Build] simplify Dockerfile build for ARM64 / GH200 (#11212) · b3b1526f
  cennn authored Dec 16, 2024
```
Signed-off-by: drikster80 <ed.sealing@gmail.com>
Co-authored-by: drikster80 <ed.sealing@gmail.com>
```
  b3b1526f