Commits · 91c9ebbb1bfc39e98aa2bd444b9569e5f2f92c9e · OpenDAS / vllm_cscc

02 Nov, 2024 1 commit
- [torch.compile] Adding torch compile to vision-language models (#9946) · ae5279a1
  Yongzao authored Nov 03, 2024
  
  ae5279a1
01 Nov, 2024 2 commits
- [Core][VLM] Add precise multi-modal placeholder tracking (#8346) · 6c0b7f54
  Peter Salas authored Nov 01, 2024
```
Signed-off-by: Peter Salas <peter@fixie.ai>
```
  6c0b7f54
- [Model] Support bitsandbytes for MiniCPMV (#9891) · 93a76dd2
  Michael Goin authored Nov 01, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  93a76dd2
29 Oct, 2024 1 commit
- [Bugfix] Fix prefix strings for quantized VLMs (#9772) · bc73e982
  Michael Goin authored Oct 29, 2024
  
  bc73e982
23 Oct, 2024 1 commit
- [VLM] Enable overriding whether post layernorm is used in vision encoder + fix quant args (#9217) · c18e1a34
  Cyrus Leung authored Oct 23, 2024
```
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  c18e1a34
16 Oct, 2024 1 commit
- [Core] Rename input data types (#8688) · cee711fd
  Cyrus Leung authored Oct 16, 2024
  
  cee711fd
10 Oct, 2024 1 commit
- [Model] support input image embedding for minicpmv (#9237) · 04de9057
  whyiug authored Oct 10, 2024
  
  04de9057
04 Oct, 2024 1 commit

[Models] Add remaining model PP support (#7168) · 0f6d7a9a

Murali Andoorveedu authored Oct 03, 2024

Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
Signed-off-by: Murali Andoorveedu <muralidhar.andoorveedu@centml.ai>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

0f6d7a9a

01 Oct, 2024 1 commit

[Bugfix] Fix Token IDs Reference for MiniCPM-V When Images are Provided With... · 1fe0a426

Alex Brooks authored Oct 01, 2024


[Bugfix] Fix Token IDs Reference for MiniCPM-V When Images are Provided With No Placeholders (#8991)
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>

1fe0a426

30 Sep, 2024 1 commit
- [Model][LoRA]LoRA support added for MiniCPMV2.6 (#8943) · 8e60afa1
  Jee Jee Li authored Sep 30, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8e60afa1
29 Sep, 2024 1 commit
- [Model][LoRA]LoRA support added for MiniCPMV2.5 (#7199) · 3d49776b
  Jee Jee Li authored Sep 29, 2024
  
  3d49776b
25 Sep, 2024 1 commit
- [BugFix] Propagate 'trust_remote_code' setting in internvl and minicpmv (#8250) · e3dd0692
  zifeitong authored Sep 24, 2024
  
  e3dd0692
22 Sep, 2024 1 commit
- [Model] Refactor BLIP/BLIP-2 to support composite model loading (#8407) · 06ed2815
  Cyrus Leung authored Sep 22, 2024
  
  06ed2815
21 Sep, 2024 1 commit
- [VLM] Use `SequenceData.from_token_counts` to create dummy data (#8687) · 5e85f4f8
  Cyrus Leung authored Sep 21, 2024
  
  5e85f4f8
18 Sep, 2024 1 commit

[CI/Build] Update Ruff version (#8469) · 9d104b5b

Aaron Pham authored Sep 18, 2024


Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

9d104b5b

05 Sep, 2024 1 commit
- [MODEL] Qwen Multimodal Support (Qwen-VL / Qwen-VL-Chat) (#8029) · 9da25a88
  Alex Brooks authored Sep 05, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9da25a88
30 Aug, 2024 1 commit
- [Core] Logprobs support in Multi-step (#7652) · 428dd144
  afeldman-nm authored Aug 29, 2024
  
  428dd144
28 Aug, 2024 1 commit
- [Core][VLM] Stack multimodal tensors to represent multiple images within each prompt (#7902) · fab5f53e
  Peter Salas authored Aug 27, 2024
  
  fab5f53e
21 Aug, 2024 1 commit
- [Model] Add UltravoxModel and UltravoxConfig (#7615) · 1ca0d4f8
  Peter Salas authored Aug 21, 2024
  
  1ca0d4f8
20 Aug, 2024 1 commit
- [Bugfix] support `tie_word_embeddings` for all models (#5724) · f4fc7337
  Zijian Hu authored Aug 19, 2024
  
  f4fc7337
19 Aug, 2024 1 commit
- [Core] Optimize SPMD architecture with delta + serialization optimization (#7109) · ff7ec82c
  SangBin Cho authored Aug 18, 2024
  
  ff7ec82c
14 Aug, 2024 1 commit
- [VLM][Core] Support profiling with multiple multi-modal inputs per prompt (#7126) · 3f674a49
  Cyrus Leung authored Aug 15, 2024
  
  3f674a49
13 Aug, 2024 3 commits
- [Frontend][Core] Add plumbing to support audio language models (#7446) · 00c3d68e
  Peter Salas authored Aug 13, 2024
  
  00c3d68e
- [Bugfix] Fix weight loading for Chameleon when TP>1 (#7410) · 7025b11d
  Cyrus Leung authored Aug 13, 2024
  
  7025b11d
- [mypy] Misc. typing improvements (#7417) · 9ba85bc1
  Cyrus Leung authored Aug 13, 2024
  
  9ba85bc1
08 Aug, 2024 1 commit
- [Model] Rename MiniCPMVQwen2 to MiniCPMV2.6 (#7273) · 757ac70a
  Jee Jee Li authored Aug 08, 2024
  
  757ac70a
05 Aug, 2024 1 commit

[Model] Add multi-image support for minicpmv (#7122) · 7b86e7c9

Alphi authored Aug 05, 2024


Co-authored-by: hezhihui <hzh7269@modelbest.cn>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

7b86e7c9

04 Aug, 2024 1 commit
- [Model]Refactor MiniCPMV (#7020) · 179a6a36
  Jee Jee Li authored Aug 04, 2024
```
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  179a6a36
31 Jul, 2024 1 commit

[Bugfix] Clean up MiniCPM-V (#6939) · 2f4e108f

Alphi authored Jul 31, 2024


Co-authored-by: hezhihui <hzh7269@modelbest.cn>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

2f4e108f

25 Jul, 2024 1 commit
- [Model] Adding support for MiniCPM-V (#4087) · 9e169a4c
  Alphi authored Jul 25, 2024
  
  9e169a4c