Commits · 5fc5ce0fe45f974fc8840175e8321652238400f0 · OpenDAS / vllm_cscc

28 Nov, 2024 1 commit

[Model] Added GLM-4 series hf format model support vllm==0.6.4 (#10561) · 5fc5ce0f

sixgod authored Nov 28, 2024


Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

5fc5ce0f

27 Nov, 2024 1 commit

[Model] Support telechat2 (#10311) · 1209261e

shunxing12345 authored Nov 27, 2024


Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: xiangw2 <xiangw2@chinatelecom.cn>
Co-authored-by: Isotr0py <2037008807@qq.com>

1209261e

25 Nov, 2024 3 commits

[Model] Add OLMo November 2024 model (#10503) · 9db713a1
Shane A authored Nov 25, 2024

9db713a1

[Model]: Add support for Aria model (#10514) · b1d92053

zhou fan authored Nov 26, 2024


Signed-off-by: xffxff <1247714429@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

b1d92053

Support Cross encoder models (#10400) · 214efc2c

Maximilien de Bayser authored Nov 24, 2024


Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Signed-off-by: Flavia Beo <flavia.beo@ibm.com>
Co-authored-by: Flavia Beo <flavia.beo@ibm.com>

214efc2c

15 Nov, 2024 2 commits
- [Model] Support Qwen2 embeddings and use tags to select model tests (#10184) · b40cf640
  Cyrus Leung authored Nov 15, 2024
  
  b40cf640
- [Bugfix] Fix unable to load some models (#10312) · 972112d8
  Cyrus Leung authored Nov 15, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  972112d8
14 Nov, 2024 1 commit

Support Roberta embedding models (#9387) · 4a18fd14

Maximilien de Bayser authored Nov 14, 2024


Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Signed-off-by: Flavia Beo <flavia.beo@ibm.com>
Co-authored-by: Flavia Beo <flavia.beo@ibm.com>

4a18fd14

13 Nov, 2024 1 commit
- [Model] Adding Support for Qwen2VL as an Embedding Model. Using MrLight/dse-qwen2-2b-mrl-v1 (#9944) · 1b886aa1
  Austin Veselka authored Nov 13, 2024
```
Signed-off-by: FurtherAI <austin.veselka@lighton.ai>
Co-authored-by: FurtherAI <austin.veselka@lighton.ai>
```
  1b886aa1
06 Nov, 2024 2 commits

[Model] Add Idefics3 support (#9767) · a5bba7d2

Jee Jee Li authored Nov 06, 2024


Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: B-201 <Joy25810@foxmail.com>
Co-authored-by: B-201 <Joy25810@foxmail.com>

a5bba7d2

[Misc] Sort the list of embedding models (#10037) · 82bfc38d
Cyrus Leung authored Nov 06, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
82bfc38d

05 Nov, 2024 1 commit
- [Core] Make encoder-decoder inputs a nested structure to be more composable (#9604) · bbc3619d
  Cyrus Leung authored Nov 05, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  bbc3619d
04 Nov, 2024 1 commit

[Model] Add support for H2OVL-Mississippi models (#9747) · 54597724

shanshan wang authored Nov 03, 2024


Signed-off-by: Shanshan Wang <shanshan.wang@h2o.ai>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

54597724

30 Oct, 2024 1 commit
- [Model] Support math-shepherd-mistral-7b-prm model (#9697) · 81f09cfd
  Went-Liang authored Oct 31, 2024
```
Signed-off-by: Went-Liang <wenteng_liang@163.com>
```
  81f09cfd
29 Oct, 2024 2 commits
- [Model] Add LlamaEmbeddingModel as an embedding Implementation of LlamaModel (#9806) · ac3d748d
  Junichi Sato authored Oct 30, 2024
  
  ac3d748d
- [Bugfix] Use temporary directory in registry (#9721) · eae3d481
  Cyrus Leung authored Oct 29, 2024
  
  eae3d481
28 Oct, 2024 1 commit
- [Hardware][ROCM] using current_platform.is_rocm (#9642) · 4e2d95e3
  wangshuai09 authored Oct 28, 2024
```
Signed-off-by: wangshuai09 <391746016@qq.com>
```
  4e2d95e3
26 Oct, 2024 1 commit
- [Model] Add classification Task with Qwen2ForSequenceClassification (#9704) · 6650e6a9
  kakao-kevin-us authored Oct 27, 2024
```
Signed-off-by: Kevin-Yang <ykcha9@gmail.com>
Co-authored-by: Kevin-Yang <ykcha9@gmail.com>
```
  6650e6a9
23 Oct, 2024 4 commits
- [Model] Add Qwen2-Audio model support (#9248) · fc6c2746
  Yunfei Chu authored Oct 24, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  fc6c2746
- [misc] comment to avoid future confusion about baichuan (#9620) · dbdd3b5e
  youkaichao authored Oct 23, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  dbdd3b5e
- [Model] Initialize Florence-2 language backbone support (#9555) · 3ff57ebf
  Isotr0py authored Oct 23, 2024
  
  3ff57ebf
- [Model] Support E5-V (#9576) · 831540cf
  Cyrus Leung authored Oct 23, 2024
  
  831540cf
22 Oct, 2024 1 commit
- [Model][VLM] Initialize support for Mono-InternVL model (#9528) · bb392ea2
  Isotr0py authored Oct 23, 2024
  
  bb392ea2
21 Oct, 2024 1 commit
- [Model] FalconMamba Support (#9325) · f6b97293
  Dhia Eddine Rhaiem authored Oct 21, 2024
  
  f6b97293
17 Oct, 2024 1 commit

Support `BERTModel` (first `encoder-only` embedding model) (#9056) · 343f8e09

Robert Shaw authored Oct 17, 2024


Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Andrew Feldman <afeldman@neuralmagic.com>
Co-authored-by: afeldman-nm <156691304+afeldman-nm@users.noreply.github.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: laishzh <laishengzhang@gmail.com>
Co-authored-by: Max de Bayser <maxdebayser@gmail.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

343f8e09

16 Oct, 2024 1 commit
- [Model] VLM2Vec, the first multimodal embedding model in vLLM (#9303) · 7abba39e
  Cyrus Leung authored Oct 16, 2024
  
  7abba39e
14 Oct, 2024 1 commit

[Model] Molmo vLLM Integration (#9016) · dfe43a20

Reza Salehi authored Oct 14, 2024


Co-authored-by: sanghol <sanghol@allenai.org>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

dfe43a20

11 Oct, 2024 3 commits
- [Model] Add GLM-4v support and meet vllm==0.6.2 (#9242) · 6cf1167c
  sixgod authored Oct 12, 2024
  
  6cf1167c
- [Model] Support Mamba (#6484) · 7342a7d7
  Tyler Michael Smith authored Oct 11, 2024
  
  7342a7d7
- [Misc] Collect model support info in a single process per model (#9233) · e808156f
  Cyrus Leung authored Oct 11, 2024
  
  e808156f
10 Oct, 2024 1 commit
- [misc] improve model support check in another process (#9208) · de895f16
  youkaichao authored Oct 09, 2024
  
  de895f16
07 Oct, 2024 2 commits
- [Model] Support NVLM-D and fix QK Norm in InternViT (#9045) · 151ef4ef
  Cyrus Leung authored Oct 07, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  151ef4ef
- [Model] Explicit interface for vLLM models and support OOT embedding models (#9108) · 8c6de96e
  Cyrus Leung authored Oct 07, 2024
  
  8c6de96e
05 Oct, 2024 1 commit
- [Model] Support Gemma2 embedding model (#9004) · 15986f59
  Xin Yang authored Oct 04, 2024
  
  15986f59
04 Oct, 2024 3 commits
- [Core][VLM] Test registration for OOT multimodal models (#8717) · 26aa325f
  Roger Wang authored Oct 04, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  26aa325f
- [Misc] Move registry to its own file (#9064) · 0e36fd49
  Cyrus Leung authored Oct 04, 2024
  
  0e36fd49
- [Models] Add remaining model PP support (#7168) · 0f6d7a9a
  Murali Andoorveedu authored Oct 03, 2024
```
Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
Signed-off-by: Murali Andoorveedu <muralidhar.andoorveedu@centml.ai>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0f6d7a9a
03 Oct, 2024 1 commit
- [Model] Adding Granite MoE. (#8206) · 19f0d257
  Shawn Tan authored Oct 02, 2024
```
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
```
  19f0d257
01 Oct, 2024 1 commit
- [Doc] Update list of supported models (#8987) · 4f341bd4
  Cyrus Leung authored Oct 02, 2024
  
  4f341bd4
29 Sep, 2024 1 commit
- [Model] Support Qwen2.5-Math-RM-72B (#8896) · bc2ef1f7
  Zilin Zhu authored Sep 29, 2024
  
  bc2ef1f7