Commits · 186aced5ffb62b62b41eb1beaf2a598ada43351b · OpenDAS / vllm_cscc

"deploy/cloud/vscode:/vscode.git/clone" did not exist on "5816c08289f14ac83b9adbc0c87f991e756547f5"

28 Aug, 2025 2 commits

[Feature] models: pass layer prefix to replace_linear_class for per-layer... · 1b7b161a

Shrey Gupta authored Aug 28, 2025


[Feature] models: pass layer prefix to replace_linear_class for per-layer quantization routing. Addresses #23239 (#23556)
Signed-off-by: Shrey Gupta <shreyg1303@gmail.com>

1b7b161a

Migrate Qwen inputs to TensorSchema (#23473) · a69693e3
Benji Beck authored Aug 27, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
a69693e3

27 Aug, 2025 14 commits

[V1][Mamba] - Enable V1 by default for Mamba Models (#23650) · 853c371f
Asaf Joseph Gardin authored Aug 27, 2025
```
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
```
853c371f
[Multimodal] Generate mm_hash based on request metadata when caching is turned off (#23690) · 8bf6266a
Roger Wang authored Aug 27, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
8bf6266a
Disable `torch.compile` for dynamic rope models in Transformers backend (#23738) · 0585a9e7
Harry Mellor authored Aug 27, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
0585a9e7
[V1] [Hybrid] Enable compile and piecewise CUDA graph for MiniMax-Text models (#22589) · dd589322
Thomas Parnell authored Aug 27, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
dd589322
[Model] Merge `SupportsMultiModalWithRawInput` with `SupportsMultiModal` (#23749) · 52883ed0
Cyrus Leung authored Aug 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
52883ed0
[Model] Enable native HF format InternVL support (#23742) · 84149043
Isotr0py authored Aug 27, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
84149043

[Model] Interface to enable batch-level DP support (#23733) · fe8d7b6f

Cyrus Leung authored Aug 27, 2025

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

fe8d7b6f

[Model] Explicit `default_pooling_type` interface (#23736) · 5eeef1b9
Cyrus Leung authored Aug 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
5eeef1b9
[V1] [Hybrid] Disable prefix caching by default for hybrid or mamba-based models (#23716) · 704432af
Thomas Parnell authored Aug 27, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
704432af

[model] Support MiniCPM-V 4.5 (#23586) · 9d30de44

tc-mb authored Aug 27, 2025


Signed-off-by: tc-mb <caitianchi@modelbest.cn>
Signed-off-by: Xin Yang <xyangx@amazon.com>
Signed-off-by: Abatom <abzhonghua@gmail.com>
Signed-off-by: chzhang <chaojun.zhang@intel.com>
Signed-off-by: Pate Motter <patemotter@google.com>
Signed-off-by: Terrencezzj <terrence@cohere.ai>
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
Signed-off-by: simon-mo <simon.mo@hey.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Siyuan Fu <siyuanf@nvidia.com>
Signed-off-by: siyuanf <siyuanf@nvidia.com>
Signed-off-by: Weiliang Liu <weiliangl@nvidia.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Signed-off-by: Zijing Liu <liuzijing2014@gmail.com>
Signed-off-by: Zijing Liu <liuzijing2014@users.noreply.github.com>
Signed-off-by: jiabin.00 <jiabin.00@bytedance.com>
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: tc-mb <157115220+tc-mb@users.noreply.github.com>
Signed-off-by: Roger Wang <hey@rogerw.me>
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Huy Do <huydhn@gmail.com>
Signed-off-by: Matúš Námešný <matus.namesny@ameria.com>
Signed-off-by: Guillaume Calmettes <gcalmettes@scaleway.com>
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: oye93 <en.ouyang93@outlook.com>
Signed-off-by: Julien Lin <jullin@nvidia.com>
Signed-off-by: Didier Durand <durand.didier@gmail.com>
Signed-off-by: Tianyu Li <tianyu.li@arm.com>
Signed-off-by: Hongxia Yang <hongxia.yang@amd.com>
Signed-off-by: Yuekai Zhang <zhangyuekai@foxmail.com>
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Signed-off-by: Zerohertz <ohg3417@gmail.com>
Signed-off-by: Hyogeun Oh (오효근) <ohg3417@gmail.com>
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Huzaifa Sidhpurwala <huzaifas@redhat.com>
Signed-off-by: Federico <65908512+coval3nte@users.noreply.github.com>
Signed-off-by: Zixuan Zhang <zixuanzhang@bytedance.com>
Signed-off-by: wuhang <wuhang6@huawei.com>
Signed-off-by: czhu-cohere <conway.zhu@cohere.com>
Signed-off-by: Wei Wei <wwei6@meta.com>
Signed-off-by: Yiheng Xu <charlesyihengxu@gmail.com>
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: wangyafeng <wangyafeng@baidu.com>
Co-authored-by: Xin Yang <105740670+xyang16@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Zhonghua Deng <abzhonghua@gmail.com>
Co-authored-by: Chaojun Zhang <chaojun.zhang@intel.com>
Co-authored-by: Pate Motter <p@temotter.com>
Co-authored-by: Terrence Zhao <32208165+Terrencezzj@users.noreply.github.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Simon Mo <simon.mo@hey.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: weiliang <weiliangl@nvidia.com>
Co-authored-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Copilot <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ProExpertProg <11367180+ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Zijing Liu <liuzijing2014@users.noreply.github.com>
Co-authored-by: Bin Jia <45593998+FoolPlayer@users.noreply.github.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Raghavan <oneraghavan@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.me>
Co-authored-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Co-authored-by: Huy Do <huydhn@gmail.com>
Co-authored-by: Matúš Námešný <matus@namesny.com>
Co-authored-by: Guillaume Calmettes <gcalmettes@scaleway.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: En Ouyang <en.ouyang93@outlook.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
Co-authored-by: nvjullin <jullin@nvidia.com>
Co-authored-by: Didier Durand <2927957+didier-durand@users.noreply.github.com>
Co-authored-by: TianyuLi0 <116711075+TianyuLi0@users.noreply.github.com>
Co-authored-by: Hongxia Yang <62075498+hongxiayang@users.noreply.github.com>
Co-authored-by: Yuekai Zhang <zhangyuekai@foxmail.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: Hyogeun Oh (오효근) <ohg3417@gmail.com>
Co-authored-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Lukas Geiger <lukas.geiger94@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Huzaifa Sidhpurwala <huzaifas@redhat.com>
Co-authored-by: Federico <65908512+coval3nte@users.noreply.github.com>
Co-authored-by: zixuanzhang226 <zixuanzhang@bytedance.com>
Co-authored-by: wuhang <wuhang6@huawei.com>
Co-authored-by: yzds <41983536+youzhedian@users.noreply.github.com>
Co-authored-by: hongchao <hongchao@msh.team>
Co-authored-by: czhu-cohere <conway.zhu@cohere.com>
Co-authored-by: Wei <weiweinpu@gmail.com>
Co-authored-by: Yiheng Xu <charlesyihengxu@gmail.com>
Co-authored-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: Chenheli Hua <huachenheli@outlook.com>
Co-authored-by: CSWYF3634076 <58356743+CSWYF3634076@users.noreply.github.com>

9d30de44

[Core] Use key-only cache for `BaseMultiModalProcessor` (#23018) · 69244e67
Cyrus Leung authored Aug 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
69244e67
[Model] Add Ernie4.5 VL Model Support (#22514) · 644d57d5
CSWYF3634076 authored Aug 27, 2025
```
Signed-off-by: wangyafeng <wangyafeng@baidu.com>
```
644d57d5
[Core] Asynchronous h2d in merge_multimodal_embeddings via pinned memory. (#23686) · c905684c
Chenheli Hua authored Aug 26, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
c905684c
[Bugfix][gpt-oss] passing the cache config in gpt-oss (#23613) · fecbb7c7
Wei authored Aug 26, 2025
```
Signed-off-by: Wei Wei <wwei6@meta.com>
```
fecbb7c7

26 Aug, 2025 6 commits
- [V1] [Hybrid] Enable Full CUDA graph by default for hybrid models in V1 (#22594) · 5f1af97f
  Thomas Parnell authored Aug 27, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  5f1af97f
- [Model] Enable video support for InternVL3.5 models (#23658) · 9816b81f
  Isotr0py authored Aug 27, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  9816b81f
- [model] support qwen2audio embedding input (#23625) · 9d4183dd
  Yuekai Zhang authored Aug 26, 2025
```
Signed-off-by: Yuekai Zhang <zhangyuekai@foxmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  9d4183dd
- [Model] fix DeepSeek e_score_correction_bias dtype to fp32 (#23640) · fdeb3dac
  Jee Jee Li authored Aug 26, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  fdeb3dac
- [Bugfix] Fix Qwen25VL packed_modules_mapping (#23604) · 9b5f6423
  Jee Jee Li authored Aug 26, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  9b5f6423
- [mypy] Fix incorrect type hint for EAGLE3 support (#23617) · 7d67a9d9
  Cyrus Leung authored Aug 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7d67a9d9
25 Aug, 2025 10 commits
- [Bugfix] Fix Qwen3 MoE GPTQ inference (#23490) · a9082a4d
  Isotr0py authored Aug 25, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  a9082a4d
- [Refactor] Pass `tokenizer` explicitly instead of binding to prompt update (#23542) · 6879cd80
  Cyrus Leung authored Aug 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6879cd80
- [Attention] Unify mamba and attention backend selection (#23171) · 5c4b6e66
  Ayush Satyam authored Aug 25, 2025
```
Signed-off-by: Ayush Satyam <ayushsatyam146@gmail.com>
```
  5c4b6e66
- [Bugfix] Allow dynamic number of patches for llava_onevision (#23525) · ebafb093
  Cyrus Leung authored Aug 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ebafb093
- [Refactor] Dynamic `target` and `content` for prompt updates (#23411) · 712d0f88
  Cyrus Leung authored Aug 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  712d0f88
- [Bugfix] Fix Dense module loading for sentence-transformers embedding models... · c9abb104
  LIYIFAN_liyifan authored Aug 24, 2025
```
[Bugfix] Fix Dense module loading for sentence-transformers embedding models (simplified V2) (#23408)
Signed-off-by: FFFfff1FFFfff <yifanli0919@gmail.com>
```
  c9abb104
- Migrate DonutImagePixelInputs to TensorSchema (#23509) · 787cdb38
  Benji Beck authored Aug 24, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  787cdb38
- Migrate skyworkr1v inputs to TensorSchema (#23499) · a5203d04
  Benji Beck authored Aug 24, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  a5203d04
- Migrate tarsier inputs to TensorSchema (#23500) · 99f80944
  Benji Beck authored Aug 24, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  99f80944
- [Bugfix] Fix Qwen2.5-VL quantized model weights loading (#23512) · a71e4765
  zifeitong authored Aug 24, 2025
```
Signed-off-by: Zifei Tong <zifeitong@gmail.com>
```
  a71e4765
24 Aug, 2025 4 commits
- [Model] Enable BLOOM on V1 (#23488) · e2db1164
  Cyrus Leung authored Aug 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e2db1164
- [New Model]Donut model (#23229) · 416f0592
  汪志鹏 authored Aug 24, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  416f0592
- Migrate Paligemma inputs to TensorSchema (#23470) · a7527728
  Benji Beck authored Aug 23, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  a7527728
- Migrate Pixtral inputs to TensorSchema (#23472) · 053278a5
  Benji Beck authored Aug 23, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  053278a5
23 Aug, 2025 1 commit
- [Model] Support DP for ViT on MiniCPM-V-4 (#23327) · 23c939fd
  WeiQing Chen authored Aug 23, 2025
```
Signed-off-by: ycyaw66 <497410282@qq.com>
Co-authored-by: ycyaw66 <497410282@qq.com>
```
  23c939fd
22 Aug, 2025 3 commits

[Bugfix] Fix broken Florence-2 model (#23426) · cd7a3df2

Isotr0py authored Aug 23, 2025


Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com>

cd7a3df2

[Model] Add Ovis2.5 PP support (#23405) · 32d2b406
Isotr0py authored Aug 23, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
32d2b406

[BugFix] Fix the issue where image embeddings were incorrectly split.… (#23366) · 424fb7a5

bppps authored Aug 23, 2025


Signed-off-by: bppps <bpppsaka@gmail.com>
Co-authored-by: zouyu.zzx <zouyu.zzx@alibaba-inc.com>
Co-authored-by: bppps <bpppsaka@gmail.com>

424fb7a5