Commits · 4d3a2c284ecc47748273664c9a6ef302ff3adcbe · OpenDAS / vllm_cscc

01 Dec, 2024 1 commit
- [Model] Replace embedding models with pooling adapter (#10769) · 13370712
  Cyrus Leung authored Dec 01, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  13370712
26 Nov, 2024 1 commit
- [V1] Refactor model executable interface for multimodal models (#10570) · 2f0a0a17
  Roger Wang authored Nov 26, 2024
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  2f0a0a17
18 Nov, 2024 1 commit
- [Misc] Add uninitialized params tracking for `AutoWeightsLoader` (#10327) · c4e46433
  Isotr0py authored Nov 18, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  c4e46433
14 Nov, 2024 1 commit
- [misc] error early for old-style class (#10304) · 504ac53d
  youkaichao authored Nov 13, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  504ac53d
11 Nov, 2024 1 commit
- [6/N] pass whole config to inner model (#10205) · f89d18ff
  youkaichao authored Nov 10, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  f89d18ff
09 Nov, 2024 1 commit
- [5/N] pass the whole config to model (#9983) · 1a95f10e
  youkaichao authored Nov 08, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  1a95f10e
07 Nov, 2024 1 commit

Online video support for VLMs (#10020) · 28b2877d

litianjian authored Nov 08, 2024


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: litianjian <litianjian@bytedance.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

28b2877d

06 Nov, 2024 1 commit
- [V1] Make v1 more testable (#9888) · d58268c5
  Joe Runde authored Nov 06, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  d58268c5
01 Nov, 2024 1 commit
- [Core][VLM] Add precise multi-modal placeholder tracking (#8346) · 6c0b7f54
  Peter Salas authored Nov 01, 2024
```
Signed-off-by: Peter Salas <peter@fixie.ai>
```
  6c0b7f54
29 Oct, 2024 1 commit
- [Bugfix] Fix prefix strings for quantized VLMs (#9772) · bc73e982
  Michael Goin authored Oct 29, 2024
  
  bc73e982
28 Oct, 2024 1 commit

[Model][VLM] Add multi-video support for LLaVA-Onevision (#8905) · 5f8d8075

litianjian authored Oct 29, 2024


Co-authored-by: litianjian <litianjian@bytedance.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

5f8d8075

24 Oct, 2024 1 commit
- [Bugfix]Disable the post_norm layer of the vision encoder for LLaVA models (#9653) · f5845496
  litianjian authored Oct 24, 2024
  
  f5845496
23 Oct, 2024 1 commit
- [VLM] Enable overriding whether post layernorm is used in vision encoder + fix quant args (#9217) · c18e1a34
  Cyrus Leung authored Oct 23, 2024
```
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  c18e1a34
16 Oct, 2024 1 commit
- [Core] Rename input data types (#8688) · cee711fd
  Cyrus Leung authored Oct 16, 2024
  
  cee711fd
09 Oct, 2024 1 commit
- [Bugfix] fix composite weight loading and EAGLE weight loading (#9160) · 8bfaa4e3
  Cyrus Leung authored Oct 09, 2024
  
  8bfaa4e3
04 Oct, 2024 1 commit

[Models] Add remaining model PP support (#7168) · 0f6d7a9a

Murali Andoorveedu authored Oct 03, 2024

Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
Signed-off-by: Murali Andoorveedu <muralidhar.andoorveedu@centml.ai>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

0f6d7a9a

22 Sep, 2024 3 commits
- [Model][VLM] Add LLaVA-Onevision model support (#8486) · 5b595327
  litianjian authored Sep 23, 2024
```
Co-authored-by: litianjian <litianjian@bytedance.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5b595327
- [Model] Refactor BLIP/BLIP-2 to support composite model loading (#8407) · 06ed2815
  Cyrus Leung authored Sep 22, 2024
  
  06ed2815
- [Bugfix] Refactor composite weight loading logic (#8656) · 13d88d41
  Isotr0py authored Sep 22, 2024
  
  13d88d41
20 Sep, 2024 1 commit
- [Bugfix] Fix incorrect llava next feature size calculation (#8496) · 0f961b3c
  zyddnys authored Sep 20, 2024
  
  0f961b3c
07 Sep, 2024 1 commit
- [Model] Multi-input support for LLaVA (#8238) · 2f707fcb
  Cyrus Leung authored Sep 07, 2024
  
  2f707fcb
30 Aug, 2024 1 commit
- [Core] Logprobs support in Multi-step (#7652) · 428dd144
  afeldman-nm authored Aug 29, 2024
  
  428dd144
28 Aug, 2024 2 commits
- [Bugfix][VLM] Fix incompatibility between #7902 and #7230 (#7948) · ef9baee3
  Cyrus Leung authored Aug 28, 2024
  
  ef9baee3
- [Core][VLM] Stack multimodal tensors to represent multiple images within each prompt (#7902) · fab5f53e
  Peter Salas authored Aug 27, 2024
  
  fab5f53e
27 Aug, 2024 1 commit
- [Model] Add multi-image input support for LLaVA-Next offline inference (#7230) · 5340a2dc
  zifeitong authored Aug 27, 2024
  
  5340a2dc
20 Aug, 2024 1 commit
- [Bugfix] support `tie_word_embeddings` for all models (#5724) · f4fc7337
  Zijian Hu authored Aug 19, 2024
  
  f4fc7337
14 Aug, 2024 1 commit
- [VLM][Core] Support profiling with multiple multi-modal inputs per prompt (#7126) · 3f674a49
  Cyrus Leung authored Aug 15, 2024
  
  3f674a49
13 Aug, 2024 2 commits
- [Frontend][Core] Add plumbing to support audio language models (#7446) · 00c3d68e
  Peter Salas authored Aug 13, 2024
  
  00c3d68e
- [Bugfix] Fix weight loading for Chameleon when TP>1 (#7410) · 7025b11d
  Cyrus Leung authored Aug 13, 2024
  
  7025b11d
12 Aug, 2024 1 commit
- [Core][VLM] Support image embeddings as input (#6613) · e6e42e4b
  Roger Wang authored Aug 12, 2024
  
  e6e42e4b
06 Aug, 2024 1 commit
- [Model] Support SigLIP encoder and alternative decoders for LLaVA models (#7153) · 1f26efbb
  Cyrus Leung authored Aug 06, 2024
```
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
```
  1f26efbb
31 Jul, 2024 1 commit
- [Bugfix] Fix feature size calculation for LLaVA-NeXT (#6982) · daed30c4
  Cyrus Leung authored Jul 31, 2024
  
  daed30c4
22 Jul, 2024 1 commit
- [Bugfix] Fix `vocab_size` field access in `llava_next.py` (#6624) · 89c1c6a1
  Jae-Won Chung authored Jul 22, 2024
  
  89c1c6a1
15 Jul, 2024 1 commit
- [VLM] Minor space optimization for `ClipVisionModel` (#6436) · 6ae1597d
  Roger Wang authored Jul 15, 2024
  
  6ae1597d
11 Jul, 2024 1 commit
- [bug fix] Fix llava next feature size calculation. (#6339) · 1df43de9
  xwjiang2010 authored Jul 11, 2024
```
Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
```
  1df43de9
05 Jul, 2024 2 commits
- [VLM] Cleanup validation and update docs (#6149) · ea4b5704
  Cyrus Leung authored Jul 05, 2024
  
  ea4b5704
- [VLM] Improve consistency between feature size calculation and dummy data for profiling (#6146) · a41357e9
  Roger Wang authored Jul 04, 2024
  
  a41357e9
04 Jul, 2024 1 commit
- [VLM] Calculate maximum number of multi-modal tokens by model (#6121) · ae96ef8f
  Cyrus Leung authored Jul 05, 2024
  
  ae96ef8f
03 Jul, 2024 2 commits

[vlm] Remove vision language config. (#6089) · d9e98f42

xwjiang2010 authored Jul 03, 2024


Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

d9e98f42

[Core] Dynamic image size support for VLMs (#5276) · 9831aec4

Cyrus Leung authored Jul 03, 2024


Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
Co-authored-by: Xiaowei Jiang <xwjiang2010@gmail.com>
Co-authored-by: ywang96 <ywang@roblox.com>
Co-authored-by: xwjiang2010 <87673679+xwjiang2010@users.noreply.github.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>

9831aec4