Commits · f0fe4fe86d45763cb5904ac256ac6241c5eb2fde · OpenDAS / vllm_cscc

14 Oct, 2024 1 commit

[Model] Molmo vLLM Integration (#9016) · dfe43a20

Reza Salehi authored Oct 14, 2024


Co-authored-by: sanghol <sanghol@allenai.org>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

dfe43a20

11 Oct, 2024 4 commits
- [Doc] Compatibility matrix for mutual exclusive features (#8512) · 8baf85e4
  Wallas Henrique authored Oct 11, 2024
```
Signed-off-by: Wallas Santos <wallashss@ibm.com>
```
  8baf85e4
- [Model] Add GLM-4v support and meet vllm==0.6.2 (#9242) · 6cf1167c
  sixgod authored Oct 12, 2024
  
  6cf1167c
- [Model] Support Mamba (#6484) · 7342a7d7
  Tyler Michael Smith authored Oct 11, 2024
  
  7342a7d7
- [Misc] Collect model support info in a single process per model (#9233) · e808156f
  Cyrus Leung authored Oct 11, 2024
  
  e808156f
10 Oct, 2024 1 commit
- [Model] support input image embedding for minicpmv (#9237) · 04de9057
  whyiug authored Oct 10, 2024
  
  04de9057
09 Oct, 2024 1 commit
- [Doc] Fix VLM prompt placeholder sample bug (#9170) · dc4aea67
  Jiangtao Hu authored Oct 09, 2024
  
  dc4aea67
08 Oct, 2024 1 commit
- [Doc] Update vlm.rst to include an example on videos (#9155) · 1874c6a1
  Sayak Paul authored Oct 08, 2024
```
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  1874c6a1
07 Oct, 2024 1 commit
- [Model] Support NVLM-D and fix QK Norm in InternViT (#9045) · 151ef4ef
  Cyrus Leung authored Oct 07, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  151ef4ef
06 Oct, 2024 2 commits
- [Model] PP support for embedding models and update docs (#9090) · b22b7984
  Cyrus Leung authored Oct 06, 2024
```
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
```
  b22b7984
- [Misc] Remove user-facing error for removed VLM args (#9104) · f22619fe
  Cyrus Leung authored Oct 06, 2024
  
  f22619fe
04 Oct, 2024 3 commits
- [Core][VLM] Test registration for OOT multimodal models (#8717) · 26aa325f
  Roger Wang authored Oct 04, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  26aa325f
- [Misc] Move registry to its own file (#9064) · 0e36fd49
  Cyrus Leung authored Oct 04, 2024
  
  0e36fd49
- [Models] Add remaining model PP support (#7168) · 0f6d7a9a
  Murali Andoorveedu authored Oct 03, 2024
```
Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
Signed-off-by: Murali Andoorveedu <muralidhar.andoorveedu@centml.ai>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0f6d7a9a
03 Oct, 2024 1 commit
- [Doc] Update Granite model docs (#9025) · 18c2e30c
  Nick Hill authored Oct 03, 2024
  
  18c2e30c
01 Oct, 2024 1 commit
- [Doc] Update list of supported models (#8987) · 4f341bd4
  Cyrus Leung authored Oct 02, 2024
  
  4f341bd4
30 Sep, 2024 1 commit
- [Model] support input embeddings for qwen2vl (#8856) · e01ab595
  whyiug authored Sep 30, 2024
  
  e01ab595
27 Sep, 2024 1 commit
- [Core] rename`PromptInputs` and `inputs` (#8876) · 3b00b9c2
  Cyrus Leung authored Sep 27, 2024
  
  3b00b9c2
26 Sep, 2024 1 commit
- [Misc] Update config loading for Qwen2-VL and remove Granite (#8837) · 4bb98f21
  Roger Wang authored Sep 26, 2024
  
  4bb98f21
25 Sep, 2024 4 commits
- [Doc] Update doc for Transformers 4.45 (#8817) · e2c6e0a8
  Roger Wang authored Sep 25, 2024
  
  e2c6e0a8
- [Model] Add support for the multi-modal Llama 3.2 model (#8811) · 770ec602
  Chen Zhang authored Sep 25, 2024
```
Co-authored-by: simon-mo <xmo@berkeley.edu>
Co-authored-by: Chang Su <chang.s.su@oracle.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  770ec602
- Revert "rename PromptInputs and inputs with backward compatibility (#8760) (#8810) · 4f1ba084
  Simon Mo authored Sep 25, 2024
  
  4f1ba084
- rename PromptInputs and inputs with backward compatibility (#8760) · 28e1299e
  Cyrus Leung authored Sep 26, 2024
  
  28e1299e
24 Sep, 2024 1 commit
- Revert "[Core] Rename `PromptInputs` to `PromptType`, and `inputs` to `prompt`" (#8750) · 3185fb0c
  Simon Mo authored Sep 23, 2024
  
  3185fb0c
22 Sep, 2024 1 commit

[Model][VLM] Add LLaVA-Onevision model support (#8486) · 5b595327

litianjian authored Sep 23, 2024


Co-authored-by: litianjian <litianjian@bytedance.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

5b595327

21 Sep, 2024 1 commit
- [Core] Rename `PromptInputs` and `inputs`(#8673) · 0057894e
  Cyrus Leung authored Sep 21, 2024
  
  0057894e
20 Sep, 2024 2 commits
- [Model] Add OLMoE (#7922) · 3b63de93
  Niklas Muennighoff authored Sep 20, 2024
  
  3b63de93
- [Core] Support Lora lineage and base model metadata management (#6315) · 260d40b5
  Jiaxin Shan authored Sep 19, 2024
  
  260d40b5
18 Sep, 2024 1 commit
- [Model] Support Solar Model (#8386) · e18749ff
  Geun, Lim authored Sep 19, 2024
```
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  e18749ff
14 Sep, 2024 1 commit
- [Model] support minicpm3 (#8297) · 8a0cf1dd
  ywfang authored Sep 14, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8a0cf1dd
13 Sep, 2024 1 commit
- [CI/Build] Reorganize models tests (#7820) · a84e598e
  Cyrus Leung authored Sep 14, 2024
  
  a84e598e
12 Sep, 2024 1 commit

[Model] Support multiple images for qwen-vl (#8247) · c6202dae

Alex Brooks authored Sep 12, 2024


Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

c6202dae

11 Sep, 2024 3 commits

Pixtral (#8377) · d394787e
Patrick von Platen authored Sep 11, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
d394787e

[Model][VLM] Add Qwen2-VL model support (#7905) · 3b7fea77

Yang Fan authored Sep 12, 2024


Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

3b7fea77

[model] Support for Llava-Next-Video model (#7559) · 6a512a00

Yangshen⚡Deng authored Sep 11, 2024


Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

6a512a00

07 Sep, 2024 2 commits
- [Model][VLM] Support multi-images inputs for InternVL2 models (#8201) · e8071259
  Isotr0py authored Sep 07, 2024
  
  e8071259
- [Model] Multi-input support for LLaVA (#8238) · 2f707fcb
  Cyrus Leung authored Sep 07, 2024
  
  2f707fcb
06 Sep, 2024 1 commit
- [Core] Support load and unload LoRA in api server (#6566) · db3bf7c9
  Jiaxin Shan authored Sep 05, 2024
```
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  db3bf7c9
05 Sep, 2024 2 commits
- [Documentation][Spec Decode] Add documentation about lossless guarantees in... · 2febcf27
  sroy745 authored Sep 05, 2024
```
[Documentation][Spec Decode] Add documentation about lossless guarantees in Speculative Decoding in vLLM (#7962)
```
  2febcf27
- [MODEL] Qwen Multimodal Support (Qwen-VL / Qwen-VL-Chat) (#8029) · 9da25a88
  Alex Brooks authored Sep 05, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9da25a88