Commits · 3945c82346dae3129213607663bfd17edd905fef · OpenDAS / vllm_cscc · GitLab

06 Nov, 2024 2 commits

[Model] Add Idefics3 support (#9767) · a5bba7d2

Jee Jee Li authored Nov 06, 2024


Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: B-201 <Joy25810@foxmail.com>
Co-authored-by: B-201 <Joy25810@foxmail.com>

a5bba7d2

[Misc] Sort the list of embedding models (#10037) · 82bfc38d
Cyrus Leung authored Nov 06, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
82bfc38d

05 Nov, 2024 1 commit
- [Core] Make encoder-decoder inputs a nested structure to be more composable (#9604) · bbc3619d
  Cyrus Leung authored Nov 05, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  bbc3619d
04 Nov, 2024 1 commit

[Model] Add support for H2OVL-Mississippi models (#9747) · 54597724

shanshan wang authored Nov 03, 2024


Signed-off-by: Shanshan Wang <shanshan.wang@h2o.ai>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

54597724

30 Oct, 2024 1 commit
- [Model] Support math-shepherd-mistral-7b-prm model (#9697) · 81f09cfd
  Went-Liang authored Oct 31, 2024
```
Signed-off-by: Went-Liang <wenteng_liang@163.com>
```
  81f09cfd
29 Oct, 2024 2 commits
- [Model] Add LlamaEmbeddingModel as an embedding Implementation of LlamaModel (#9806) · ac3d748d
  Junichi Sato authored Oct 30, 2024
  
  ac3d748d
- [Bugfix] Use temporary directory in registry (#9721) · eae3d481
  Cyrus Leung authored Oct 29, 2024
  
  eae3d481
28 Oct, 2024 1 commit
- [Hardware][ROCM] using current_platform.is_rocm (#9642) · 4e2d95e3
  wangshuai09 authored Oct 28, 2024
```
Signed-off-by: wangshuai09 <391746016@qq.com>
```
  4e2d95e3
26 Oct, 2024 1 commit
- [Model] Add classification Task with Qwen2ForSequenceClassification (#9704) · 6650e6a9
  kakao-kevin-us authored Oct 27, 2024
```
Signed-off-by: Kevin-Yang <ykcha9@gmail.com>
Co-authored-by: Kevin-Yang <ykcha9@gmail.com>
```
  6650e6a9
23 Oct, 2024 4 commits
- [Model] Add Qwen2-Audio model support (#9248) · fc6c2746
  Yunfei Chu authored Oct 24, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  fc6c2746
- [misc] comment to avoid future confusion about baichuan (#9620) · dbdd3b5e
  youkaichao authored Oct 23, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  dbdd3b5e
- [Model] Initialize Florence-2 language backbone support (#9555) · 3ff57ebf
  Isotr0py authored Oct 23, 2024
  
  3ff57ebf
- [Model] Support E5-V (#9576) · 831540cf
  Cyrus Leung authored Oct 23, 2024
  
  831540cf
22 Oct, 2024 1 commit
- [Model][VLM] Initialize support for Mono-InternVL model (#9528) · bb392ea2
  Isotr0py authored Oct 23, 2024
  
  bb392ea2
21 Oct, 2024 1 commit
- [Model] FalconMamba Support (#9325) · f6b97293
  Dhia Eddine Rhaiem authored Oct 21, 2024
  
  f6b97293
17 Oct, 2024 1 commit

Support `BERTModel` (first `encoder-only` embedding model) (#9056) · 343f8e09

Robert Shaw authored Oct 17, 2024


Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Andrew Feldman <afeldman@neuralmagic.com>
Co-authored-by: afeldman-nm <156691304+afeldman-nm@users.noreply.github.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: laishzh <laishengzhang@gmail.com>
Co-authored-by: Max de Bayser <maxdebayser@gmail.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

343f8e09

16 Oct, 2024 1 commit
- [Model] VLM2Vec, the first multimodal embedding model in vLLM (#9303) · 7abba39e
  Cyrus Leung authored Oct 16, 2024
  
  7abba39e
14 Oct, 2024 1 commit

[Model] Molmo vLLM Integration (#9016) · dfe43a20

Reza Salehi authored Oct 14, 2024


Co-authored-by: sanghol <sanghol@allenai.org>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

dfe43a20

11 Oct, 2024 3 commits
- [Model] Add GLM-4v support and meet vllm==0.6.2 (#9242) · 6cf1167c
  sixgod authored Oct 12, 2024
  
  6cf1167c
- [Model] Support Mamba (#6484) · 7342a7d7
  Tyler Michael Smith authored Oct 11, 2024
  
  7342a7d7
- [Misc] Collect model support info in a single process per model (#9233) · e808156f
  Cyrus Leung authored Oct 11, 2024
  
  e808156f
10 Oct, 2024 1 commit
- [misc] improve model support check in another process (#9208) · de895f16
  youkaichao authored Oct 09, 2024
  
  de895f16
07 Oct, 2024 2 commits
- [Model] Support NVLM-D and fix QK Norm in InternViT (#9045) · 151ef4ef
  Cyrus Leung authored Oct 07, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  151ef4ef
- [Model] Explicit interface for vLLM models and support OOT embedding models (#9108) · 8c6de96e
  Cyrus Leung authored Oct 07, 2024
  
  8c6de96e
05 Oct, 2024 1 commit
- [Model] Support Gemma2 embedding model (#9004) · 15986f59
  Xin Yang authored Oct 04, 2024
  
  15986f59
04 Oct, 2024 3 commits
- [Core][VLM] Test registration for OOT multimodal models (#8717) · 26aa325f
  Roger Wang authored Oct 04, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  26aa325f
- [Misc] Move registry to its own file (#9064) · 0e36fd49
  Cyrus Leung authored Oct 04, 2024
  
  0e36fd49
- [Models] Add remaining model PP support (#7168) · 0f6d7a9a
  Murali Andoorveedu authored Oct 03, 2024
```
Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
Signed-off-by: Murali Andoorveedu <muralidhar.andoorveedu@centml.ai>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0f6d7a9a
03 Oct, 2024 1 commit
- [Model] Adding Granite MoE. (#8206) · 19f0d257
  Shawn Tan authored Oct 02, 2024
```
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
```
  19f0d257
01 Oct, 2024 1 commit
- [Doc] Update list of supported models (#8987) · 4f341bd4
  Cyrus Leung authored Oct 02, 2024
  
  4f341bd4
29 Sep, 2024 1 commit
- [Model] Support Qwen2.5-Math-RM-72B (#8896) · bc2ef1f7
  Zilin Zhu authored Sep 29, 2024
  
  bc2ef1f7
25 Sep, 2024 1 commit

[Model] Add support for the multi-modal Llama 3.2 model (#8811) · 770ec602

Chen Zhang authored Sep 25, 2024


Co-authored-by: simon-mo <xmo@berkeley.edu>
Co-authored-by: Chang Su <chang.s.su@oracle.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

770ec602

22 Sep, 2024 1 commit

[Model][VLM] Add LLaVA-Onevision model support (#8486) · 5b595327

litianjian authored Sep 23, 2024


Co-authored-by: litianjian <litianjian@bytedance.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

5b595327

20 Sep, 2024 2 commits
- [Model] Add OLMoE (#7922) · 3b63de93
  Niklas Muennighoff authored Sep 20, 2024
  
  3b63de93
- [Bugfix] Fix Phi3.5 mini and MoE LoRA inference (#8571) · 18ae428a
  Amit Garg authored Sep 19, 2024
  
  18ae428a
18 Sep, 2024 1 commit
- [Model] Support Solar Model (#8386) · e18749ff
  Geun, Lim authored Sep 19, 2024
```
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  e18749ff
14 Sep, 2024 1 commit
- [Model] support minicpm3 (#8297) · 8a0cf1dd
  ywfang authored Sep 14, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8a0cf1dd
12 Sep, 2024 1 commit
- [Hotfix][Core][VLM] Disable chunked prefill by default and prefix caching for... · c1636945
  Roger Wang authored Sep 12, 2024
```
[Hotfix][Core][VLM] Disable chunked prefill by default and prefix caching for multimodal models (#8425)
```
  c1636945
11 Sep, 2024 2 commits

Pixtral (#8377) · d394787e
Patrick von Platen authored Sep 11, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
d394787e

[Model][VLM] Add Qwen2-VL model support (#7905) · 3b7fea77

Yang Fan authored Sep 12, 2024


Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

3b7fea77