Commits · ed70f3c64f684750edea087e286cbf264e7cc3f3 · OpenDAS / vllm_cscc

01 Jul, 2025 1 commit

Add GLM4.1V model (Draft) (#19331) · ed70f3c6

Yuxuan Zhang authored Jul 01, 2025


Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

ed70f3c6

30 Jun, 2025 1 commit
- [Core] [Bugfix] [Multimodal] Fix multimodal profiling and generation for SFT/PTQed models (#20058) · d8cf819a
  Kyle Sayers authored Jun 30, 2025
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  d8cf819a
21 Jun, 2025 2 commits

[Multimodal] Optimize Qwen2/2.5-VL startup time (#19756) · 2c5302fa

Woosuk Kwon authored Jun 21, 2025


Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Roger Wang <hey@rogerw.me>

2c5302fa

[New model support]Support Tarsier2 (#19887) · c3bf9bad
汪志鹏 authored Jun 21, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
c3bf9bad

19 Jun, 2025 1 commit
- [Bugfix] Fix the linter (#19826) · b1098b40
  Lu Fang authored Jun 19, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  b1098b40
18 Jun, 2025 2 commits
- [Multimodal] Use fast processor for Qwen2/2.5-VL (#19789) · d49adea1
  Woosuk Kwon authored Jun 18, 2025
  
  d49adea1
- [Core] More fixes to MultiModalEmbeddings type handling (#19715) · 14fdd21d
  Russell Bryant authored Jun 18, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  14fdd21d
16 Jun, 2025 1 commit
- [V1] Change return type on get_multimodal_embeddings() (#19446) · 90f9c2eb
  Russell Bryant authored Jun 16, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  90f9c2eb
14 Jun, 2025 1 commit
- [Bugfix] Fix auto dtype casting for BatchFeature (#19316) · 2db9044a
  Isotr0py authored Jun 14, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  2db9044a
03 Jun, 2025 2 commits
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
- [Misc] Update `WeightsMapper` for qwen2-vl/qwen2.5-vl (#19054) · ec2dcd80
  Isotr0py authored Jun 03, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  ec2dcd80
01 Jun, 2025 1 commit

[LoRA] Support dynamically initialize `packed_modules_mapping` for VLM with... · a35ca765

Isotr0py authored Jun 01, 2025


[LoRA] Support dynamically initialize `packed_modules_mapping` for VLM with arbitrary components (#18987)
Signed-off-by: isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <2037008807@qq.com>

a35ca765

15 May, 2025 1 commit
- Update deprecated type hinting in `models` (#18132) · 26d04193
  Harry Mellor authored May 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  26d04193
08 May, 2025 1 commit
- [Bugfix] `use_fast` failing to be propagated to Qwen2-VL image processor (#17838) · 015815fe
  Cyrus Leung authored May 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  015815fe
07 May, 2025 1 commit
- [Misc] Use `apply_rotary_emb` from vllm_flash_attn for Qwen2-VL vision RoPE (#17726) · c3e9d506
  Isotr0py authored May 07, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  c3e9d506
29 Apr, 2025 1 commit
- [Misc] Move config fields to MultiModalConfig (#17343) · ebb3930d
  Cyrus Leung authored Apr 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ebb3930d
27 Apr, 2025 1 commit
- [Bugfix] Fix QWen2 VL multimodal mapping (#17240) · 4283a28c
  Jee Jee Li authored Apr 27, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  4283a28c
24 Apr, 2025 1 commit
- [Chore] Remove Sampler from Model Code (#17084) · b411418f
  Woosuk Kwon authored Apr 24, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  b411418f
12 Apr, 2025 1 commit
- [V1] Enable multi-input by default (#15799) · d9fc8cd9
  Cyrus Leung authored Apr 12, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d9fc8cd9
10 Apr, 2025 2 commits
- [VLM] Avoid unnecessary dummy multimodal data during processing (#16416) · 56d4aefa
  Cyrus Leung authored Apr 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  56d4aefa
- [VLM] Remove `BaseProcessingInfo.get_mm_max_tokens_per_item` (#16408) · 83b824c8
  Cyrus Leung authored Apr 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  83b824c8
09 Apr, 2025 1 commit
- [Model] Add `SupportsMultiModal.get_language_model` interface (#16007) · d55244df
  Nicolò Lucchesi authored Apr 09, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  d55244df
30 Mar, 2025 1 commit
- [V1] Override `mm_counts` for dummy data creation (#15703) · 803d5c35
  Cyrus Leung authored Mar 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  803d5c35
21 Mar, 2025 1 commit
- [Misc] Add attention mask pre-computation optimization back to Qwen2.5-VL (#15273) · 47c71262
  Isotr0py authored Mar 21, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  47c71262
14 Mar, 2025 1 commit
- [Misc] Clean up type annotation for `SupportsMultiModal` (#14794) · 601bd326
  Cyrus Leung authored Mar 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  601bd326
11 Mar, 2025 1 commit
- [Perf]:Optimize qwen2-vl to reduce cudaMemcpyAsync (#14377) · 70b808fe
  yexin(叶鑫) authored Mar 11, 2025
```
Signed-off-by: cynthieye <987073381@qq.com>
```
  70b808fe
07 Mar, 2025 1 commit
- [Bugfix] Clean up multi-modal processors (#14417) · 05fb6718
  Cyrus Leung authored Mar 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  05fb6718
28 Feb, 2025 1 commit
- [Bugfix] Initialize attention bias on the same device as Query/Key/Value for QwenVL Series (#14031) · 9b61dd41
  Yang Liu authored Feb 28, 2025
  
  9b61dd41
27 Feb, 2025 1 commit
- [VLM] Generalized prompt updates for multi-modal processor (#13964) · f1579b22
  Cyrus Leung authored Feb 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f1579b22
25 Feb, 2025 1 commit
- Remove unused kwargs from model definitions (#13555) · cdc1fa12
  Harry Mellor authored Feb 25, 2025
  
  cdc1fa12
22 Feb, 2025 1 commit
- [Misc] Reduce LoRA-related static variable (#13166) · 105b8ce4
  Jee Jee Li authored Feb 22, 2025
  
  105b8ce4
19 Feb, 2025 1 commit
- [VLM][Bugfix] Pass processor kwargs properly on init (#13516) · 377d10bd
  Cyrus Leung authored Feb 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  377d10bd
17 Feb, 2025 1 commit
- [VLM] Check required fields before initializing field config in `DictEmbeddingItems` (#13380) · 7b623fca
  Cyrus Leung authored Feb 17, 2025
  
  7b623fca
15 Feb, 2025 1 commit
- [Bugfix] Fix qwen2.5-vl image processor (#13286) · 7fdaaf48
  Isotr0py authored Feb 15, 2025
  
  7fdaaf48
14 Feb, 2025 1 commit
- [VLM] Keep track of whether prompt replacements have been applied (#13215) · 4da1f667
  Cyrus Leung authored Feb 14, 2025
  
  4da1f667
13 Feb, 2025 1 commit
- [Misc] Qwen2.5-VL Optimization (#13155) · 02ed8a1f
  燃 authored Feb 13, 2025
  
  02ed8a1f
12 Feb, 2025 1 commit
- [Bugfix] Fix num video tokens calculation for Qwen2-VL (#13148) · 985b4a2b
  Cyrus Leung authored Feb 12, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  985b4a2b
10 Feb, 2025 1 commit
- [Bugfix] Clean up and fix multi-modal processors (#13012) · 51f0b5f7
  Cyrus Leung authored Feb 10, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  51f0b5f7
05 Feb, 2025 1 commit
- [VLM] Qwen2.5-VL · bf3b79ef
  Roger Wang authored Feb 05, 2025
  
  bf3b79ef
04 Feb, 2025 1 commit

[VLM] Merged multi-modal processor for InternVL-based models (#12553) · d1ca7df8

Cyrus Leung authored Feb 04, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

d1ca7df8