Commits · d151fde8341d34592e1e5e14d2152d067421cf63 · OpenDAS / vllm_cscc

23 Oct, 2024 1 commit
- [VLM] Enable overriding whether post layernorm is used in vision encoder + fix quant args (#9217) · c18e1a34
  Cyrus Leung authored Oct 23, 2024
```
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  c18e1a34
16 Oct, 2024 1 commit
- [Core] Rename input data types (#8688) · cee711fd
  Cyrus Leung authored Oct 16, 2024
  
  cee711fd
22 Sep, 2024 1 commit
- [Model] Refactor BLIP/BLIP-2 to support composite model loading (#8407) · 06ed2815
  Cyrus Leung authored Sep 22, 2024
  
  06ed2815
21 Sep, 2024 1 commit
- [VLM] Use `SequenceData.from_token_counts` to create dummy data (#8687) · 5e85f4f8
  Cyrus Leung authored Sep 21, 2024
  
  5e85f4f8
03 Sep, 2024 1 commit
- [Bugfix][VLM] Add fallback to SDPA for ViT model running on CPU backend (#8061) · ec266536
  Isotr0py authored Sep 03, 2024
  
  ec266536
30 Aug, 2024 1 commit

[VLM][Model] TP support for ViTs (#7186) · f97be32d

Jungho Christopher Cho authored Aug 31, 2024


Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

f97be32d

21 Aug, 2024 1 commit
- [Model] Add UltravoxModel and UltravoxConfig (#7615) · 1ca0d4f8
  Peter Salas authored Aug 21, 2024
  
  1ca0d4f8
19 Aug, 2024 1 commit
- [Core] Optimize SPMD architecture with delta + serialization optimization (#7109) · ff7ec82c
  SangBin Cho authored Aug 18, 2024
  
  ff7ec82c
14 Aug, 2024 1 commit
- [VLM][Core] Support profiling with multiple multi-modal inputs per prompt (#7126) · 3f674a49
  Cyrus Leung authored Aug 15, 2024
  
  3f674a49
27 Jul, 2024 1 commit
- [Model] Initial support for BLIP-2 (#5920) · 1ad86acf
  Cyrus Leung authored Jul 27, 2024
```
Co-authored-by: ywang96 <ywang@roblox.com>
```
  1ad86acf
15 Jul, 2024 1 commit
- [VLM] Minor space optimization for `ClipVisionModel` (#6436) · 6ae1597d
  Roger Wang authored Jul 15, 2024
  
  6ae1597d
04 Jul, 2024 1 commit
- [VLM] Calculate maximum number of multi-modal tokens by model (#6121) · ae96ef8f
  Cyrus Leung authored Jul 05, 2024
  
  ae96ef8f
03 Jul, 2024 1 commit

[Core] Dynamic image size support for VLMs (#5276) · 9831aec4

Cyrus Leung authored Jul 03, 2024


Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
Co-authored-by: Xiaowei Jiang <xwjiang2010@gmail.com>
Co-authored-by: ywang96 <ywang@roblox.com>
Co-authored-by: xwjiang2010 <87673679+xwjiang2010@users.noreply.github.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>

9831aec4

02 Jul, 2024 1 commit

[VLM] Remove `image_input_type` from VLM config (#5852) · 98d6682c

xwjiang2010 authored Jul 02, 2024


Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

98d6682c

28 Jun, 2024 1 commit
- [Core] Registry for processing model inputs (#5214) · 5cbe8d15
  Cyrus Leung authored Jun 28, 2024
```
Co-authored-by: ywang96 <ywang@roblox.com>
```
  5cbe8d15
20 Jun, 2024 1 commit
- [Model] Port over CLIPVisionModel for VLMs (#5591) · ad137cd1
  Roger Wang authored Jun 20, 2024
  
  ad137cd1