Commits · 60c872d4b665786ce4b4e1e9b82bacc0ca8e8cc2 · OpenDAS / vllm_cscc

14 Mar, 2025 1 commit
- [Doc] Fix small typo in Transformers fallback (#14791) · 60c872d4
  Chen Zhang authored Mar 14, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  60c872d4
13 Mar, 2025 2 commits

[VLM] Support loading InternVideo2.5 models as original InternVLChatModel (#14738) · b1cc4dfe
Isotr0py authored Mar 13, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
b1cc4dfe

[VLM] Support pan-and-scan for Gemma3 multi-modal processor (#14672) · 38240392

Cyrus Leung authored Mar 13, 2025


Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Roger Wang <ywang@roblox.com>

38240392

12 Mar, 2025 1 commit

[Model] Add support for Gemma 3 (#14660) · c0c25e25

Woosuk Kwon authored Mar 12, 2025


Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

c0c25e25

11 Mar, 2025 1 commit
- [Bugfix] Update `--hf-overrides` for `Alibaba-NLP/gte-Qwen2` (#14609) · af295e9b
  Cyrus Leung authored Mar 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  af295e9b
10 Mar, 2025 2 commits
- [Doc] Update PaliGemma note to a warning (#14565) · 001a9c7b
  Cyrus Leung authored Mar 10, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  001a9c7b
- [Docs] Mention `model_impl` arg when explaining Transformers fallback (#14552) · 60a98b2d
  Harry Mellor authored Mar 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  60a98b2d
06 Mar, 2025 3 commits
- [Doc] Correct beam_search using in generative_models.md (#14363) · 4f27044a
  Irina Yuryeva authored Mar 06, 2025
  
  4f27044a
- [V1][VLM][Pixtral-HF] Support Pixtral-HF on V1 (#14275) · 5d802522
  lkchen authored Mar 06, 2025
```
Signed-off-by: Linkun Chen <github@lkchen.net>
```
  5d802522
- [Model] Update Paligemma multimodal processing with PromptUpdate (#14015) · 17699280
  kYLe authored Mar 06, 2025
```
Signed-off-by: Kyle Huang <kylhuang@nvidia.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  17699280
05 Mar, 2025 1 commit
- [Model] New model support for Phi-4-multimodal-instruct (#14119) · 0a995d54
  Congcong Chen authored Mar 04, 2025
  
  0a995d54
04 Mar, 2025 1 commit

[Model] Add support for GraniteMoeShared models (#13313) · c060b714

Travis Johnson authored Mar 03, 2025


Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

c060b714

03 Mar, 2025 1 commit
- Improve the docs for `TransformersModel` (#14147) · 98175b28
  Harry Mellor authored Mar 03, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  98175b28
02 Mar, 2025 1 commit
- [Model] Add LoRA support for TransformersModel (#13770) · cc5e8f6d
  Jee Jee Li authored Mar 02, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  cc5e8f6d
27 Feb, 2025 1 commit
- [VLM] Support multimodal inputs for Florence-2 models (#13320) · edf309eb
  Isotr0py authored Feb 27, 2025
  
  edf309eb
26 Feb, 2025 1 commit
- [Model] Support Grok1 (#13795) · 07c43530
  Michael Goin authored Feb 25, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  07c43530
21 Feb, 2025 1 commit
- [FEATURE] Enables /score endpoint for embedding models (#12846) · 1c3c9757
  Gabriel Marinho authored Feb 21, 2025
  
  1c3c9757
20 Feb, 2025 2 commits
- Merge similar examples in `offline_inference` into single `basic` example (#12737) · 992e5c3d
  Harry Mellor authored Feb 20, 2025
  
  992e5c3d
- [Misc] Qwen2.5 VL support LoRA (#13261) · 512368e3
  Jee Jee Li authored Feb 20, 2025
  
  512368e3
19 Feb, 2025 1 commit
- [Doc] Add clarification note regarding paligemma (#13511) · fd84857f
  Roger Wang authored Feb 18, 2025
  
  fd84857f
18 Feb, 2025 2 commits
- [Doc]: Improve feature tables (#13224) · 2358ca52
  Harry Mellor authored Feb 18, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2358ca52
- [Model] Enable quantization support for `transformers` backend (#12960) · 67ef8f66
  Isotr0py authored Feb 18, 2025
  
  67ef8f66
16 Feb, 2025 1 commit
- [V1] Update doc and examples for H2O-VL (#13349) · b7d30986
  Roger Wang authored Feb 16, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  b7d30986
15 Feb, 2025 1 commit
- [Bugfix][Docs] Fix offline Whisper (#13274) · 579d7a63
  Nicolò Lucchesi authored Feb 15, 2025
  
  579d7a63
13 Feb, 2025 2 commits
- [VLM] Separate text-only and vision variants of the same model architecture (#13157) · 1bc3b5e7
  Cyrus Leung authored Feb 13, 2025
  
  1bc3b5e7
- [VLM] Merged multi-modal processor for Molmo (#12966) · c9d3ecf0
  Cyrus Leung authored Feb 13, 2025
  
  c9d3ecf0
10 Feb, 2025 1 commit
- [Model] Ultravox Model: Support v0.5 Release (#12912) · 08b2d845
  Farzad Abdolhosseini authored Feb 10, 2025
```
Signed-off-by: Farzad Abdolhosseini <farzad@fixie.ai>
```
  08b2d845
08 Feb, 2025 2 commits
- [VLM] Merged multi-modal processor for GLM4V (#12449) · 86222a3d
  Jee Jee Li authored Feb 09, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  86222a3d
- [Doc] Correct HF repository for TeleChat2 models (#12949) · 256a2d29
  Jun Duan authored Feb 08, 2025
  
  256a2d29
06 Feb, 2025 2 commits
- [Model] LoRA Support for Ultravox model (#11253) · d88506dd
  Sumit Vij authored Feb 05, 2025
  
  d88506dd
- [VLM] Update compatibility with transformers 4.49 · 75404d04
  Cyrus Leung authored Feb 06, 2025
  
  75404d04
05 Feb, 2025 1 commit
- [VLM] Qwen2.5-VL · bf3b79ef
  Roger Wang authored Feb 05, 2025
  
  bf3b79ef
04 Feb, 2025 2 commits

[VLM] merged multimodal processor and V1 support for idefics3 (#12660) · 815079de
Isotr0py authored Feb 04, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
815079de

[VLM] Merged multi-modal processor for InternVL-based models (#12553) · d1ca7df8

Cyrus Leung authored Feb 04, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

d1ca7df8

03 Feb, 2025 1 commit

[Model]: Add `transformers` backend support (#11330) · a1a2aaad

Arthur authored Feb 03, 2025

# Adds support for `transformers` as a backend

Following https://github.com/huggingface/transformers/pull/35235

, a
bunch of models should already be supported, we are ramping up support
for more models.

Thanks @Isotr0py for the TP support, and @hmellor for his help as well!
This includes: 
- `trust_remote_code=True` support: any model on the hub, if it
implements attention the correct way can be natively supported!!
- tensor parallel support

---------
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <41363108+Isotr0py@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

a1a2aaad

29 Jan, 2025 2 commits

[Model] Refactoring of MiniCPM-V and add MiniCPM-o-2.6 support for vLLM (#12069) · d93bf4da

Alphi authored Jan 29, 2025


Signed-off-by: hzh <hezhihui_thu@163.com>
Signed-off-by: Sungjae Lee <33976427+llsj14@users.noreply.github.com>
Signed-off-by: shaochangxu.scx <shaochangxu.scx@antgroup.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: Rafael Vasquez <rafvasq21@gmail.com>
Signed-off-by: Akshat Tripathi <akshat@krai.ai>
Signed-off-by: Oleg Mosalov <oleg@krai.ai>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Signed-off-by: Yida Wu <yidawu@alumni.cmu.edu>
Signed-off-by: Chenguang Li <757486878@qq.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Alex-Brooks <Alex.brooks@ibm.com>
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Shanshan Shen <467638484@qq.com>
Signed-off-by: elijah <f1renze.142857@gmail.com>
Signed-off-by: Yikun <yikunkero@gmail.com>
Signed-off-by: mgoin <michael@neuralmagic.com>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Konrad Zawora <kzawora@habana.ai>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
Co-authored-by: Sungjae Lee <33976427+llsj14@users.noreply.github.com>
Co-authored-by: shaochangxu <85155497+shaochangxu@users.noreply.github.com>
Co-authored-by: shaochangxu.scx <shaochangxu.scx@antgroup.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
Co-authored-by: sixgod <evethwillbeok@outlook.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: Rafael Vasquez <rafvasq21@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Akshat Tripathi <Akshat.tripathi6568@gmail.com>
Co-authored-by: Oleg Mosalov <oleg@krai.ai>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Avshalom Manevich <12231371+avshalomman@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-neuralmagic@users.noreply.github.com>
Co-authored-by: Yangcheng Li <liyangcheng.lyc@alibaba-inc.com>
Co-authored-by: Siyuan Li <94890248+liaoyanqing666@users.noreply.github.com>
Co-authored-by: Concurrensee <yida.wu@amd.com>
Co-authored-by: Chenguang Li <757486878@qq.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Alex Brooks <alex.brooks@ibm.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Shanshan Shen <467638484@qq.com>
Co-authored-by: elijah <30852919+e1ijah1@users.noreply.github.com>
Co-authored-by: Yikun Jiang <yikunkero@gmail.com>
Co-authored-by: Steve Luo <36296769+SunflowerAries@users.noreply.github.com>
Co-authored-by: mgoin <michael@neuralmagic.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Konrad Zawora <kzawora@habana.ai>
Co-authored-by: TJian <tunjian1996@gmail.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: wangxiyuan <wangxiyuan1007@gmail.com>
Co-authored-by: maang-h <55082429+maang-h@users.noreply.github.com>
Co-authored-by: Elfie Guo <164945471+elfiegg@users.noreply.github.com>
Co-authored-by: Rui Qiao <161574667+ruisearch42@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>