Commits · eed11ebee93e9d137ac74d8e6e97427354bd3797 · OpenDAS / vllm_cscc

04 Jan, 2025 1 commit
- [VLM] Merged multi-modal processors for LLaVA-NeXT-Video and LLaVA-OneVision (#11717) · eed11ebe
  Cyrus Leung authored Jan 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  eed11ebe
02 Jan, 2025 1 commit
- [VLM] Merged multi-modal processor for LLaVA-NeXT (#11682) · 8c38ee70
  Cyrus Leung authored Jan 03, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8c38ee70
04 Dec, 2024 1 commit
- [Model] Consolidate ViTs attention implementation without mask (#10893) · 10398b47
  Isotr0py authored Dec 05, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  10398b47
21 Nov, 2024 1 commit

[Model] Add Support for Multimodal Granite Models (#10291) · 1cfde82f

Alex Brooks authored Nov 21, 2024


Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

1cfde82f

18 Nov, 2024 2 commits
- [Model] Remove transformers attention porting in VITs (#10414) · e7ebb662
  Isotr0py authored Nov 18, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  e7ebb662
- [Misc] Add uninitialized params tracking for `AutoWeightsLoader` (#10327) · c4e46433
  Isotr0py authored Nov 18, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  c4e46433
01 Nov, 2024 1 commit
- [Core][VLM] Add precise multi-modal placeholder tracking (#8346) · 6c0b7f54
  Peter Salas authored Nov 01, 2024
```
Signed-off-by: Peter Salas <peter@fixie.ai>
```
  6c0b7f54
28 Oct, 2024 1 commit

[Model][VLM] Add multi-video support for LLaVA-Onevision (#8905) · 5f8d8075

litianjian authored Oct 29, 2024


Co-authored-by: litianjian <litianjian@bytedance.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

5f8d8075

23 Oct, 2024 1 commit
- [VLM] Enable overriding whether post layernorm is used in vision encoder + fix quant args (#9217) · c18e1a34
  Cyrus Leung authored Oct 23, 2024
```
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  c18e1a34
16 Oct, 2024 1 commit
- [Core] Rename input data types (#8688) · cee711fd
  Cyrus Leung authored Oct 16, 2024
  
  cee711fd
04 Oct, 2024 1 commit

[Models] Add remaining model PP support (#7168) · 0f6d7a9a

Murali Andoorveedu authored Oct 03, 2024

Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
Signed-off-by: Murali Andoorveedu <muralidhar.andoorveedu@centml.ai>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

0f6d7a9a

22 Sep, 2024 2 commits

[Model][VLM] Add LLaVA-Onevision model support (#8486) · 5b595327

litianjian authored Sep 23, 2024


Co-authored-by: litianjian <litianjian@bytedance.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

5b595327

[Model] Refactor BLIP/BLIP-2 to support composite model loading (#8407) · 06ed2815
Cyrus Leung authored Sep 22, 2024

06ed2815

21 Sep, 2024 1 commit
- [VLM] Use `SequenceData.from_token_counts` to create dummy data (#8687) · 5e85f4f8
  Cyrus Leung authored Sep 21, 2024
  
  5e85f4f8
10 Sep, 2024 1 commit
- [Bugfix] Fix missing `post_layernorm` in CLIP (#8155) · da1a844e
  Cyrus Leung authored Sep 10, 2024
  
  da1a844e
07 Sep, 2024 2 commits
- [Model][VLM] Decouple weight loading logic for `Paligemma` (#8269) · 36bf8150
  Isotr0py authored Sep 08, 2024
  
  36bf8150
- [Model] Multi-input support for LLaVA (#8238) · 2f707fcb
  Cyrus Leung authored Sep 07, 2024
  
  2f707fcb
04 Sep, 2024 1 commit
- [Bugfix] remove post_layernorm in siglip (#8106) · d3311562
  wnma authored Sep 04, 2024
  
  d3311562
03 Sep, 2024 1 commit
- [Bugfix][VLM] Add fallback to SDPA for ViT model running on CPU backend (#8061) · ec266536
  Isotr0py authored Sep 03, 2024
  
  ec266536
30 Aug, 2024 1 commit

[VLM][Model] TP support for ViTs (#7186) · f97be32d

Jungho Christopher Cho authored Aug 31, 2024


Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

f97be32d

27 Aug, 2024 1 commit
- [Model] Add multi-image input support for LLaVA-Next offline inference (#7230) · 5340a2dc
  zifeitong authored Aug 27, 2024
  
  5340a2dc
21 Aug, 2024 1 commit
- [Model] Add UltravoxModel and UltravoxConfig (#7615) · 1ca0d4f8
  Peter Salas authored Aug 21, 2024
  
  1ca0d4f8
19 Aug, 2024 1 commit
- [Core] Optimize SPMD architecture with delta + serialization optimization (#7109) · ff7ec82c
  SangBin Cho authored Aug 18, 2024
  
  ff7ec82c
14 Aug, 2024 1 commit
- [VLM][Core] Support profiling with multiple multi-modal inputs per prompt (#7126) · 3f674a49
  Cyrus Leung authored Aug 15, 2024
  
  3f674a49
12 Aug, 2024 1 commit
- [Core][VLM] Support image embeddings as input (#6613) · e6e42e4b
  Roger Wang authored Aug 12, 2024
  
  e6e42e4b
06 Aug, 2024 1 commit
- [Model] Support SigLIP encoder and alternative decoders for LLaVA models (#7153) · 1f26efbb
  Cyrus Leung authored Aug 06, 2024
```
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
```
  1f26efbb
05 Aug, 2024 1 commit
- [Model] SiglipVisionModel ported from transformers (#6942) · c0d8f163
  Jungho Christopher Cho authored Aug 05, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  c0d8f163