Commits · c0c25e25fa93ee7c3f279abbba5597c0fafa74ee · OpenDAS / vllm_cscc

12 Mar, 2025 4 commits
- [Model] Add support for Gemma 3 (#14660) · c0c25e25
  Woosuk Kwon authored Mar 12, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c0c25e25
- [Kernel] Add ModelOpt FP4 Checkpoint Support (#12520) · debd6bbf
  Pavani Majety authored Mar 11, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  debd6bbf
- [Core] Refactor `QKVCrossParallelLinear` implementation to support BNB 4-bit quantization (#14545) · e392d858
  Isotr0py authored Mar 12, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  e392d858
- [Model] Extend Ultravox to accept audio longer than 30s (#13631) · 80e78d02
  Farzad Abdolhosseini authored Mar 11, 2025
```
Signed-off-by: Farzad Abdolhosseini <farzad@fixie.ai>
```
  80e78d02
11 Mar, 2025 1 commit
- [Bugfix] Update `--hf-overrides` for `Alibaba-NLP/gte-Qwen2` (#14609) · af295e9b
  Cyrus Leung authored Mar 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  af295e9b
06 Mar, 2025 1 commit

[Model] Update Paligemma multimodal processing with PromptUpdate (#14015) · 17699280

kYLe authored Mar 06, 2025


Signed-off-by: Kyle Huang <kylhuang@nvidia.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

17699280

05 Mar, 2025 1 commit
- [Model] New model support for Phi-4-multimodal-instruct (#14119) · 0a995d54
  Congcong Chen authored Mar 04, 2025
  
  0a995d54
04 Mar, 2025 1 commit

[Model] Add support for GraniteMoeShared models (#13313) · c060b714

Travis Johnson authored Mar 03, 2025


Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

c060b714

03 Mar, 2025 1 commit
- Update deprecated Python 3.8 typing (#13971) · cf069aa8
  Harry Mellor authored Mar 03, 2025
  
  cf069aa8
28 Feb, 2025 2 commits
- Use smaller embedding model when not testing model specifically (#13891) · 76c89fca
  Harry Mellor authored Feb 28, 2025
  
  76c89fca
- [Bugfix] Check that number of images matches number of <|image|> tokens with mllama (#13911) · 73e0225e
  Travis Johnson authored Feb 27, 2025
```
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
```
  73e0225e
27 Feb, 2025 1 commit
- [VLM] Support multimodal inputs for Florence-2 models (#13320) · edf309eb
  Isotr0py authored Feb 27, 2025
  
  edf309eb
26 Feb, 2025 3 commits
- [Bugfix] Add test example for Ultravox v0.5 (#13890) · 7b700ec8
  Cyrus Leung authored Feb 26, 2025
  
  7b700ec8
- [Misc] Fix input processing for Ultravox (#13871) · 7ca1da02
  Roger Wang authored Feb 25, 2025
  
  7ca1da02
- [Model] Support Grok1 (#13795) · 07c43530
  Michael Goin authored Feb 25, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  07c43530
23 Feb, 2025 2 commits
- [LMM] Implement merged multimodal processor for whisper (#13278) · ba5106e5
  Isotr0py authored Feb 23, 2025
  
  ba5106e5
- [ci] Use env var to control whether to use S3 bucket in CI (#13634) · 2c5e637b
  Kevin H. Luu authored Feb 22, 2025
  
  2c5e637b
19 Feb, 2025 4 commits
- [VLM][Bugfix] Pass processor kwargs properly on init (#13516) · 377d10bd
  Cyrus Leung authored Feb 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  377d10bd
- [Model][Speculative Decoding] DeepSeek MTP spec decode (#12755) · f525c0be
  Lucia Fang authored Feb 19, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
Co-authored-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>
```
  f525c0be
- [Bugfix] Fix Positive Feature Layers in Llava Models (#13514) · 983a40a8
  Alex Brooks authored Feb 19, 2025
```
Signed-off-by: Alex-Brooks <Alex.brooks@ibm.com>
```
  983a40a8
- [1/n][CI] Load models in CI from S3 instead of HF (#13205) · d5d214ac
  Kevin H. Luu authored Feb 18, 2025
```
Signed-off-by: <>
Co-authored-by: EC2 Default User <ec2-user@ip-172-31-20-117.us-west-2.compute.internal>
```
  d5d214ac
18 Feb, 2025 1 commit
- [Model] Enable quantization support for `transformers` backend (#12960) · 67ef8f66
  Isotr0py authored Feb 18, 2025
  
  67ef8f66
17 Feb, 2025 1 commit

[Model] Support Mamba2 (Codestral Mamba) (#9292) · 1f69c4a8

Tyler Michael Smith authored Feb 17, 2025


Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Yu Chin Fabian Lim <flim@sg.ibm.com>

1f69c4a8

14 Feb, 2025 1 commit
- Consolidate Llama model usage in tests (#13094) · f2b20fe4
  Harry Mellor authored Feb 14, 2025
  
  f2b20fe4
13 Feb, 2025 3 commits
- [VLM] Separate text-only and vision variants of the same model architecture (#13157) · 1bc3b5e7
  Cyrus Leung authored Feb 13, 2025
  
  1bc3b5e7
- [VLM] Merged multi-modal processor for Molmo (#12966) · c9d3ecf0
  Cyrus Leung authored Feb 13, 2025
  
  c9d3ecf0
- [VLM] Implement merged multimodal processor for Mllama (#11427) · bc55d130
  Isotr0py authored Feb 13, 2025
  
  bc55d130
12 Feb, 2025 1 commit
- [Model] IBM/NASA Prithvi Geospatial model (#12830) · 974dfd49
  Christian Pinto authored Feb 12, 2025
  
  974dfd49
10 Feb, 2025 2 commits
- [Model] Ultravox Model: Support v0.5 Release (#12912) · 08b2d845
  Farzad Abdolhosseini authored Feb 10, 2025
```
Signed-off-by: Farzad Abdolhosseini <farzad@fixie.ai>
```
  08b2d845
- [Bugfix] Clean up and fix multi-modal processors (#13012) · 51f0b5f7
  Cyrus Leung authored Feb 10, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  51f0b5f7
08 Feb, 2025 1 commit
- [VLM] Merged multi-modal processor for GLM4V (#12449) · 86222a3d
  Jee Jee Li authored Feb 09, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  86222a3d
06 Feb, 2025 2 commits

Add Bamba Model (#10909) · aff40457

Yu Chin Fabian Lim authored Feb 07, 2025


Signed-off-by: Yu Chin Fabian Lim <flim@sg.ibm.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

aff40457

[VLM] Update compatibility with transformers 4.49 · 75404d04
Cyrus Leung authored Feb 06, 2025

75404d04

05 Feb, 2025 1 commit
- [VLM] Qwen2.5-VL · bf3b79ef
  Roger Wang authored Feb 05, 2025
  
  bf3b79ef
04 Feb, 2025 4 commits
- [Bugfix] Fix CI failures for InternVL and Mantis models (#12728) · 18016a5e
  Cyrus Leung authored Feb 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  18016a5e
- [VLM] merged multimodal processor and V1 support for idefics3 (#12660) · 815079de
  Isotr0py authored Feb 04, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  815079de
- [VLM] Merged multi-modal processor for InternVL-based models (#12553) · d1ca7df8
  Cyrus Leung authored Feb 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  d1ca7df8
- [Doc] Replace ibm-fms with ibm-ai-platform (#12709) · bb392af4
  Thomas Parnell authored Feb 04, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  bb392af4
03 Feb, 2025 2 commits

[Misc] Fix improper placement of SPDX header in scripts (#12694) · 33e0602e
Russell Bryant authored Feb 03, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
33e0602e

[Model]: Add `transformers` backend support (#11330) · a1a2aaad

Arthur authored Feb 03, 2025

# Adds support for `transformers` as a backend

Following https://github.com/huggingface/transformers/pull/35235

, a
bunch of models should already be supported, we are ramping up support
for more models.

Thanks @Isotr0py for the TP support, and @hmellor for his help as well!
This includes: 
- `trust_remote_code=True` support: any model on the hub, if it
implements attention the correct way can be natively supported!!
- tensor parallel support

---------
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <41363108+Isotr0py@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

a1a2aaad