Commits · 415f76a9cbcdec9346661e5b6f04c35a4d8eb3f4 · OpenDAS / vllm_cscc · GitLab

16 Oct, 2024 2 commits
- [Core] Rename input data types (#8688) · cee711fd
  Cyrus Leung authored Oct 16, 2024
  
  cee711fd
- [Model] VLM2Vec, the first multimodal embedding model in vLLM (#9303) · 7abba39e
  Cyrus Leung authored Oct 16, 2024
  
  7abba39e
14 Oct, 2024 1 commit
- [Model] Make llama3.2 support multiple and interleaved images (#9095) · f0fe4fe8
  Xiang Xu authored Oct 14, 2024
  
  f0fe4fe8
11 Oct, 2024 2 commits
- [Model] Add GLM-4v support and meet vllm==0.6.2 (#9242) · 6cf1167c
  sixgod authored Oct 12, 2024
  
  6cf1167c
- [Model] Support Mamba (#6484) · 7342a7d7
  Tyler Michael Smith authored Oct 11, 2024
  
  7342a7d7
07 Oct, 2024 3 commits
- [Core] Refactor GGUF parameters packing and forwarding (#8859) · f19da648
  Isotr0py authored Oct 07, 2024
  
  f19da648
- [Hardware][CPU] Cross-attention and Encoder-Decoder models support on CPU backend (#9089) · 4f95ffee
  Isotr0py authored Oct 07, 2024
  
  4f95ffee
- [Model] Explicit interface for vLLM models and support OOT embedding models (#9108) · 8c6de96e
  Cyrus Leung authored Oct 07, 2024
  
  8c6de96e
05 Oct, 2024 2 commits
- [Bugfix] Deprecate registration of custom configs to huggingface (#9083) · cfadb9c6
  Chen Zhang authored Oct 05, 2024
  
  cfadb9c6
- [Model] Support Gemma2 embedding model (#9004) · 15986f59
  Xin Yang authored Oct 04, 2024
  
  15986f59
04 Oct, 2024 3 commits
- [Core][VLM] Test registration for OOT multimodal models (#8717) · 26aa325f
  Roger Wang authored Oct 04, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  26aa325f
- [Misc] Move registry to its own file (#9064) · 0e36fd49
  Cyrus Leung authored Oct 04, 2024
  
  0e36fd49
- [Models] Add remaining model PP support (#7168) · 0f6d7a9a
  Murali Andoorveedu authored Oct 03, 2024
```
Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
Signed-off-by: Murali Andoorveedu <muralidhar.andoorveedu@centml.ai>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0f6d7a9a
03 Oct, 2024 1 commit
- [Model] Adding Granite MoE. (#8206) · 19f0d257
  Shawn Tan authored Oct 02, 2024
```
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
```
  19f0d257
29 Sep, 2024 2 commits
- [Kernel][Model] Varlen prefill + Prefill chunking support for mamba kernels and Jamba model (#8533) · f13a07b1
  Mor Zusman authored Sep 30, 2024
  
  f13a07b1
- [CI/Build] Add test decorator for minimum GPU memory (#8925) · 26a68d5d
  Cyrus Leung authored Sep 29, 2024
  
  26a68d5d
28 Sep, 2024 1 commit
- [CI/Build] Update models tests & examples (#8874) · e1a3f5e8
  Cyrus Leung authored Sep 29, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  e1a3f5e8
27 Sep, 2024 1 commit
- [Bugfix][VLM] Fix Fuyu batching inference with `max_num_seqs>1` (#8892) · 6d792d2f
  Isotr0py authored Sep 27, 2024
  
  6d792d2f
26 Sep, 2024 1 commit
- [BugFix] Fix test breakages from transformers 4.45 upgrade (#8829) · 4b377d6f
  Nick Hill authored Sep 27, 2024
  
  4b377d6f
25 Sep, 2024 1 commit

[Model] Add support for the multi-modal Llama 3.2 model (#8811) · 770ec602

Chen Zhang authored Sep 25, 2024


Co-authored-by: simon-mo <xmo@berkeley.edu>
Co-authored-by: Chang Su <chang.s.su@oracle.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

770ec602

24 Sep, 2024 1 commit

[Model] Expose Phi3v num_crops as a mm_processor_kwarg (#8658) · 8ff7ced9

Alex Brooks authored Sep 24, 2024


Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

8ff7ced9

23 Sep, 2024 1 commit
- [Core][Frontend] Support Passing Multimodal Processor Kwargs (#8657) · 9b8c8ba1
  Alex Brooks authored Sep 23, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  9b8c8ba1
22 Sep, 2024 1 commit

[Model][VLM] Add LLaVA-Onevision model support (#8486) · 5b595327

litianjian authored Sep 23, 2024


Co-authored-by: litianjian <litianjian@bytedance.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

5b595327

20 Sep, 2024 1 commit
- [Bugfix][Core] Fix tekken edge case for mistral tokenizer (#8640) · b4e4eda9
  Patrick von Platen authored Sep 20, 2024
  
  b4e4eda9
18 Sep, 2024 2 commits
- [Core] *Prompt* logprobs support in Multi-step (#8199) · a8c1d161
  afeldman-nm authored Sep 18, 2024
  
  a8c1d161
- [CI/Build] Avoid CUDA initialization (#8534) · 6ffa3f31
  Cyrus Leung authored Sep 18, 2024
  
  6ffa3f31
17 Sep, 2024 1 commit
- [Model] Add mistral function calling format to all models loaded with "mistral" format (#8515) · a54ed802
  Patrick von Platen authored Sep 17, 2024
```
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  a54ed802
14 Sep, 2024 1 commit
- [Model] support minicpm3 (#8297) · 8a0cf1dd
  ywfang authored Sep 14, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8a0cf1dd
13 Sep, 2024 2 commits
- [CI/Build] Reorganize models tests (#7820) · a84e598e
  Cyrus Leung authored Sep 14, 2024
  
  a84e598e
- [CI/Build] Update pixtral tests to use JSON (#8436) · 84275504
  Cyrus Leung authored Sep 13, 2024
  
  84275504
12 Sep, 2024 3 commits
- [Hotfix][Pixtral] Fix multiple images bugs (#8415) · d31174a4
  Patrick von Platen authored Sep 13, 2024
  
  d31174a4
- [Model] Support multiple images for qwen-vl (#8247) · c6202dae
  Alex Brooks authored Sep 12, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c6202dae
- [Bugfix] Fix InternVL2 inference with various num_patches (#8375) · e56bf277
  Isotr0py authored Sep 13, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e56bf277
11 Sep, 2024 5 commits
- Pixtral (#8377) · d394787e
  Patrick von Platen authored Sep 11, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  d394787e
- [Kernel][Misc] register ops to prevent graph breaks (#6917) · 73202dbe
  bnellnm authored Sep 11, 2024
```
Co-authored-by: Sage Moore <sage@neuralmagic.com>
```
  73202dbe
- [Model][VLM] Add Qwen2-VL model support (#7905) · 3b7fea77
  Yang Fan authored Sep 12, 2024
```
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3b7fea77
- [model] Support for Llava-Next-Video model (#7559) · 6a512a00
  Yangshen⚡Deng authored Sep 11, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  6a512a00
- [Hardware][NV] Add support for ModelOpt static scaling checkpoints. (#6112) · efcf946a
  Pavani Majety authored Sep 10, 2024
  
  efcf946a
07 Sep, 2024 2 commits
- [Model][VLM] Support multi-images inputs for InternVL2 models (#8201) · e8071259
  Isotr0py authored Sep 07, 2024
  
  e8071259
- [Model] Multi-input support for LLaVA (#8238) · 2f707fcb
  Cyrus Leung authored Sep 07, 2024
  
  2f707fcb