Commits · 58eee5f2e05b74eb2cb1a3bbda9c04df4805e4cc · OpenDAS / vllm_cscc

01 Aug, 2025 2 commits
- [Bugfix] Fix glm4.1v video inference issue (#22067) · 3f8e9521
  Isotr0py authored Aug 02, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  3f8e9521
- [Misc] Automatically resolve HF processor init kwargs (#22005) · 82de9b9d
  Cyrus Leung authored Aug 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  82de9b9d
30 Jul, 2025 1 commit
- [Bugfix] Fix OOM tests in initialization test (#21921) · 6e599eeb
  Isotr0py authored Jul 30, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  6e599eeb
28 Jul, 2025 2 commits
- [Bugfix] Fix glm4.1v video_grid_thw tensor shape scheme (#21744) · 0ae970ed
  Isotr0py authored Jul 28, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  0ae970ed
- Migrate Glm4vImageInputs, Glm4vVideoInputs to TensorSchema (#21678) · 88e46c7c
  Benji Beck authored Jul 27, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  88e46c7c
08 Jul, 2025 1 commit
- [Bugfix] Fix GLM-4.1-V video prompt update (#20635) · b9fca832
  Isotr0py authored Jul 09, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  b9fca832
04 Jul, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#20428) · 1caca5a5
  Jee Jee Li authored Jul 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1caca5a5
03 Jul, 2025 2 commits
- [Misc] Remove _maybe_ignore_quant_config from GLM4.1v (#20432) · 2f2fcb31
  Yuxuan Zhang authored Jul 04, 2025
```
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
```
  2f2fcb31
- [Core] Move multimodal placeholder from chat utils to model definition (#20355) · b024a42e
  Cyrus Leung authored Jul 03, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b024a42e
01 Jul, 2025 1 commit

Add GLM4.1V model (Draft) (#19331) · ed70f3c6

Yuxuan Zhang authored Jul 01, 2025


Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

ed70f3c6

30 Jun, 2025 1 commit
- [Core] [Bugfix] [Multimodal] Fix multimodal profiling and generation for SFT/PTQed models (#20058) · d8cf819a
  Kyle Sayers authored Jun 30, 2025
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  d8cf819a
21 Jun, 2025 2 commits

[Multimodal] Optimize Qwen2/2.5-VL startup time (#19756) · 2c5302fa

Woosuk Kwon authored Jun 21, 2025


Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Roger Wang <hey@rogerw.me>

2c5302fa

[New model support]Support Tarsier2 (#19887) · c3bf9bad
汪志鹏 authored Jun 21, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
c3bf9bad

19 Jun, 2025 1 commit
- [Bugfix] Fix the linter (#19826) · b1098b40
  Lu Fang authored Jun 19, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  b1098b40
18 Jun, 2025 2 commits
- [Multimodal] Use fast processor for Qwen2/2.5-VL (#19789) · d49adea1
  Woosuk Kwon authored Jun 18, 2025
  
  d49adea1
- [Core] More fixes to MultiModalEmbeddings type handling (#19715) · 14fdd21d
  Russell Bryant authored Jun 18, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  14fdd21d
16 Jun, 2025 1 commit
- [V1] Change return type on get_multimodal_embeddings() (#19446) · 90f9c2eb
  Russell Bryant authored Jun 16, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  90f9c2eb
14 Jun, 2025 1 commit
- [Bugfix] Fix auto dtype casting for BatchFeature (#19316) · 2db9044a
  Isotr0py authored Jun 14, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  2db9044a
03 Jun, 2025 2 commits
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
- [Misc] Update `WeightsMapper` for qwen2-vl/qwen2.5-vl (#19054) · ec2dcd80
  Isotr0py authored Jun 03, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  ec2dcd80
01 Jun, 2025 1 commit

[LoRA] Support dynamically initialize `packed_modules_mapping` for VLM with... · a35ca765

Isotr0py authored Jun 01, 2025


[LoRA] Support dynamically initialize `packed_modules_mapping` for VLM with arbitrary components (#18987)
Signed-off-by: isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <2037008807@qq.com>

a35ca765

15 May, 2025 1 commit
- Update deprecated type hinting in `models` (#18132) · 26d04193
  Harry Mellor authored May 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  26d04193
08 May, 2025 1 commit
- [Bugfix] `use_fast` failing to be propagated to Qwen2-VL image processor (#17838) · 015815fe
  Cyrus Leung authored May 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  015815fe
07 May, 2025 1 commit
- [Misc] Use `apply_rotary_emb` from vllm_flash_attn for Qwen2-VL vision RoPE (#17726) · c3e9d506
  Isotr0py authored May 07, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  c3e9d506
29 Apr, 2025 1 commit
- [Misc] Move config fields to MultiModalConfig (#17343) · ebb3930d
  Cyrus Leung authored Apr 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ebb3930d
27 Apr, 2025 1 commit
- [Bugfix] Fix QWen2 VL multimodal mapping (#17240) · 4283a28c
  Jee Jee Li authored Apr 27, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  4283a28c
24 Apr, 2025 1 commit
- [Chore] Remove Sampler from Model Code (#17084) · b411418f
  Woosuk Kwon authored Apr 24, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  b411418f
12 Apr, 2025 1 commit
- [V1] Enable multi-input by default (#15799) · d9fc8cd9
  Cyrus Leung authored Apr 12, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d9fc8cd9
10 Apr, 2025 2 commits
- [VLM] Avoid unnecessary dummy multimodal data during processing (#16416) · 56d4aefa
  Cyrus Leung authored Apr 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  56d4aefa
- [VLM] Remove `BaseProcessingInfo.get_mm_max_tokens_per_item` (#16408) · 83b824c8
  Cyrus Leung authored Apr 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  83b824c8
09 Apr, 2025 1 commit
- [Model] Add `SupportsMultiModal.get_language_model` interface (#16007) · d55244df
  Nicolò Lucchesi authored Apr 09, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  d55244df
30 Mar, 2025 1 commit
- [V1] Override `mm_counts` for dummy data creation (#15703) · 803d5c35
  Cyrus Leung authored Mar 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  803d5c35
21 Mar, 2025 1 commit
- [Misc] Add attention mask pre-computation optimization back to Qwen2.5-VL (#15273) · 47c71262
  Isotr0py authored Mar 21, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  47c71262
14 Mar, 2025 1 commit
- [Misc] Clean up type annotation for `SupportsMultiModal` (#14794) · 601bd326
  Cyrus Leung authored Mar 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  601bd326
11 Mar, 2025 1 commit
- [Perf]:Optimize qwen2-vl to reduce cudaMemcpyAsync (#14377) · 70b808fe
  yexin(叶鑫) authored Mar 11, 2025
```
Signed-off-by: cynthieye <987073381@qq.com>
```
  70b808fe
07 Mar, 2025 1 commit
- [Bugfix] Clean up multi-modal processors (#14417) · 05fb6718
  Cyrus Leung authored Mar 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  05fb6718
28 Feb, 2025 1 commit
- [Bugfix] Initialize attention bias on the same device as Query/Key/Value for QwenVL Series (#14031) · 9b61dd41
  Yang Liu authored Feb 28, 2025
  
  9b61dd41
27 Feb, 2025 1 commit
- [VLM] Generalized prompt updates for multi-modal processor (#13964) · f1579b22
  Cyrus Leung authored Feb 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f1579b22
25 Feb, 2025 1 commit
- Remove unused kwargs from model definitions (#13555) · cdc1fa12
  Harry Mellor authored Feb 25, 2025
  
  cdc1fa12
22 Feb, 2025 1 commit
- [Misc] Reduce LoRA-related static variable (#13166) · 105b8ce4
  Jee Jee Li authored Feb 22, 2025
  
  105b8ce4