Commits · e20c92bb618384ce8d0013e0c9ad273d0c23d65b · OpenDAS / vllm_cscc

"vllm/perf/benchmark_throughput.py" did not exist on "49bfe4cb5f365a532f9ee383c963bbdedcd15e02"

06 Jan, 2025 4 commits
- [Kernel] Move attn_type to Attention.__init__() (#11690) · e20c92bb
  Chen Zhang authored Jan 07, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  e20c92bb
- [Bugfix][V1] Fix molmo text-only inputs (#11676) · 32c9eff2
  Jee Jee Li authored Jan 06, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  32c9eff2
- [Bugfix] Fix max image size for LLaVA-Onevision (#11769) · 9279b9f8
  Roger Wang authored Jan 06, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  9279b9f8
- [VLM] Separate out profiling-related logic (#11746) · 996357e4
  Cyrus Leung authored Jan 06, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  996357e4
04 Jan, 2025 3 commits
- [Model] Remove unnecessary weight initialization logic (#11736) · 65c08928
  Cyrus Leung authored Jan 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  65c08928
- [Bugfix] Fix precision error in LLaVA-NeXT (#11735) · ba214dff
  Cyrus Leung authored Jan 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ba214dff
- [VLM] Merged multi-modal processors for LLaVA-NeXT-Video and LLaVA-OneVision (#11717) · eed11ebe
  Cyrus Leung authored Jan 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  eed11ebe
03 Jan, 2025 2 commits

[Misc]Add BNB quantization for Qwen2VL (#11719) · a655eb30

Jee Jee Li authored Jan 04, 2025


Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

a655eb30

[Model] Whisper model implementation (#11280) · e1a5c2f0
Aurick Qiao authored Jan 03, 2025
```
Co-authored-by: Aurick Qiao <aurick.qiao@snowflake.com>
```
e1a5c2f0

02 Jan, 2025 2 commits
- [Bugfix] Change kv scaling factor by param json on nvidia gpu (#11688) · 187e3299
  bjmsong authored Jan 03, 2025
```
Signed-off-by: bjmsong <bjmsong@126.com>
Co-authored-by: bjmsong <bjmsong@126.com>
```
  187e3299
- [VLM] Merged multi-modal processor for LLaVA-NeXT (#11682) · 8c38ee70
  Cyrus Leung authored Jan 03, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8c38ee70
01 Jan, 2025 3 commits

[VLM] Move supported limits and max tokens to merged multi-modal processor (#11669) · a115ac46

Cyrus Leung authored Jan 01, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

a115ac46

[Misc] Optimize Qwen2-VL LoRA test (#11663) · 11d8a091
Jee Jee Li authored Jan 01, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
11d8a091

[VLM] Add max-count checking in data parser for single image models (#11661) · 365801fe

Cyrus Leung authored Jan 01, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

365801fe

31 Dec, 2024 2 commits

[V1][VLM] V1 support for selected single-image models. (#11632) · e7c7c5e8

Roger Wang authored Dec 31, 2024


Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Isotr0py <2037008807@qq.com>

e7c7c5e8

[Model][LoRA]LoRA support added for MolmoForCausalLM (#11439) · a2a40bcd

Matthias Vogler authored Dec 31, 2024


Signed-off-by: Matthias Vogler <matthias.vogler@joesecurity.org>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Matthias Vogler <matthias.vogler@joesecurity.org>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

a2a40bcd

30 Dec, 2024 3 commits
- [Bugfix] Validate and concatenate image embeddings in MiniCPMVBaseModel (#11631) · 36e76700
  whyiug authored Dec 31, 2024
  
  36e76700
- [VLM] Abstract out multi-modal data parsing in merged processor (#11620) · 8d9b6721
  Cyrus Leung authored Dec 30, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8d9b6721
- [platforms] enable platform plugins (#11602) · b12e87f9
  youkaichao authored Dec 30, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  b12e87f9
28 Dec, 2024 3 commits
- [bugfix] interleaving sliding window for cohere2 model (#11583) · 328841d0
  youkaichao authored Dec 29, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  328841d0
- [Model] Remove hardcoded image tokens ids from Pixtral (#11582) · b7dcc003
  Roger Wang authored Dec 28, 2024
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  b7dcc003
- [Model] Support InternLM2 Reward models (#11571) · d34be24b
  Isotr0py authored Dec 28, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  d34be24b
27 Dec, 2024 6 commits
- [Misc]Add BNB quantization for MolmoForCausalLM (#11551) · 0240402c
  Jee Jee Li authored Dec 28, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  0240402c
- [MODEL] LoRA support for Jamba model (#11209) · 55509c21
  ErezSC42 authored Dec 27, 2024
```
Signed-off-by: Erez Schwartz <erezs@ai21.com>
```
  55509c21
- [VLM] Support caching in merged multi-modal processor (#11396) · 10141809
  Cyrus Leung authored Dec 28, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  10141809
- [Bugfix] Fix TeleChat2ForCausalLM weights mapper (#11546) · 2c9b8ea2
  Jee Jee Li authored Dec 27, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  2c9b8ea2
- [Platform] Move model arch check to platform (#11503) · 6c6f7fe8
  Mengqing Cao authored Dec 27, 2024
```
Signed-off-by: Mengqing Cao <cmq0113@163.com>
```
  6c6f7fe8
- Deepseek v3 (#11502) · f49777ba
  Simon Mo authored Dec 26, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
Co-authored-by: mgoin <michael@neuralmagic.com>
Co-authored-by: robertgshaw2-neuralmagic <rshaw@neuralmagic.com>
```
  f49777ba
26 Dec, 2024 1 commit
- [Model] Modify MolmoForCausalLM MLP (#11510) · f57ee565
  Jee Jee Li authored Dec 26, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  f57ee565
24 Dec, 2024 3 commits
- [Model] Automatic conversion of classification and reward models (#11469) · 3f3e92e1
  Cyrus Leung authored Dec 25, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3f3e92e1
- [Misc] Move weights mapper (#11443) · 196c34b0
  Jee Jee Li authored Dec 24, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  196c34b0
- [Bugfix] Fix Qwen2-VL LoRA weight loading (#11430) · b1b1038f
  Jee Jee Li authored Dec 24, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  b1b1038f
23 Dec, 2024 1 commit
- [Bugfix] Add kv cache scales to gemma2.py (#11269) · 60fb4f3b
  Michael Goin authored Dec 23, 2024
  
  60fb4f3b
21 Dec, 2024 1 commit
- [Bugfix] Fix issues for `Pixtral-Large-Instruct-2411` (#11393) · c2d1b075
  Roger Wang authored Dec 21, 2024
```
Signed-off-by: ywang96 <ywang@example.com>
Co-authored-by: ywang96 <ywang@example.com>
```
  c2d1b075
19 Dec, 2024 5 commits

[Model] Refactor Qwen2-VL to use merged multimodal processor (#11258) · e24113a8

Isotr0py authored Dec 20, 2024


Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

e24113a8

[V1] Fix multimodal profiling for `Molmo` (#11325) · 7379b3d4
Roger Wang authored Dec 19, 2024
```
Signed-off-by: ywang96 <ywang@example.com>
Co-authored-by: ywang96 <ywang@example.com>
```
7379b3d4

[Model] Add JambaForSequenceClassification model (#10860) · 6c7f8815

Yehoshua Cohen authored Dec 19, 2024


Signed-off-by: Yehoshua Cohen <yehoshuaco@ai21.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Yehoshua Cohen <yehoshuaco@ai21.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

6c7f8815

[Bugfix] Cleanup Pixtral HF code (#11333) · a0f7d53b
Cyrus Leung authored Dec 19, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
a0f7d53b
[VLM] Merged multimodal processor for Qwen2-Audio (#11303) · 6142ef0a
Cyrus Leung authored Dec 19, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
6142ef0a

18 Dec, 2024 1 commit
- [Bugfix] Fix broken phi3-v mm_processor_kwargs tests (#11263) · 996aa70f
  Isotr0py authored Dec 19, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  996aa70f