Commits · 9d30de44698e1e337e4736ff62b83ebe1bbd4d40 · OpenDAS / vllm_cscc

"vllm/model_executor/models/AXK1.py" did not exist on "5e5646e2064f925f97ff533aa688a43834e9ff96"

27 Aug, 2025 22 commits

[model] Support MiniCPM-V 4.5 (#23586) · 9d30de44

tc-mb authored Aug 27, 2025


Signed-off-by: tc-mb <caitianchi@modelbest.cn>
Signed-off-by: Xin Yang <xyangx@amazon.com>
Signed-off-by: Abatom <abzhonghua@gmail.com>
Signed-off-by: chzhang <chaojun.zhang@intel.com>
Signed-off-by: Pate Motter <patemotter@google.com>
Signed-off-by: Terrencezzj <terrence@cohere.ai>
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
Signed-off-by: simon-mo <simon.mo@hey.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Siyuan Fu <siyuanf@nvidia.com>
Signed-off-by: siyuanf <siyuanf@nvidia.com>
Signed-off-by: Weiliang Liu <weiliangl@nvidia.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Signed-off-by: Zijing Liu <liuzijing2014@gmail.com>
Signed-off-by: Zijing Liu <liuzijing2014@users.noreply.github.com>
Signed-off-by: jiabin.00 <jiabin.00@bytedance.com>
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: tc-mb <157115220+tc-mb@users.noreply.github.com>
Signed-off-by: Roger Wang <hey@rogerw.me>
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Huy Do <huydhn@gmail.com>
Signed-off-by: Matúš Námešný <matus.namesny@ameria.com>
Signed-off-by: Guillaume Calmettes <gcalmettes@scaleway.com>
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: oye93 <en.ouyang93@outlook.com>
Signed-off-by: Julien Lin <jullin@nvidia.com>
Signed-off-by: Didier Durand <durand.didier@gmail.com>
Signed-off-by: Tianyu Li <tianyu.li@arm.com>
Signed-off-by: Hongxia Yang <hongxia.yang@amd.com>
Signed-off-by: Yuekai Zhang <zhangyuekai@foxmail.com>
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Signed-off-by: Zerohertz <ohg3417@gmail.com>
Signed-off-by: Hyogeun Oh (오효근) <ohg3417@gmail.com>
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Huzaifa Sidhpurwala <huzaifas@redhat.com>
Signed-off-by: Federico <65908512+coval3nte@users.noreply.github.com>
Signed-off-by: Zixuan Zhang <zixuanzhang@bytedance.com>
Signed-off-by: wuhang <wuhang6@huawei.com>
Signed-off-by: czhu-cohere <conway.zhu@cohere.com>
Signed-off-by: Wei Wei <wwei6@meta.com>
Signed-off-by: Yiheng Xu <charlesyihengxu@gmail.com>
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: wangyafeng <wangyafeng@baidu.com>
Co-authored-by: Xin Yang <105740670+xyang16@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Zhonghua Deng <abzhonghua@gmail.com>
Co-authored-by: Chaojun Zhang <chaojun.zhang@intel.com>
Co-authored-by: Pate Motter <p@temotter.com>
Co-authored-by: Terrence Zhao <32208165+Terrencezzj@users.noreply.github.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Simon Mo <simon.mo@hey.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: weiliang <weiliangl@nvidia.com>
Co-authored-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Copilot <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ProExpertProg <11367180+ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Zijing Liu <liuzijing2014@users.noreply.github.com>
Co-authored-by: Bin Jia <45593998+FoolPlayer@users.noreply.github.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Raghavan <oneraghavan@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.me>
Co-authored-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Co-authored-by: Huy Do <huydhn@gmail.com>
Co-authored-by: Matúš Námešný <matus@namesny.com>
Co-authored-by: Guillaume Calmettes <gcalmettes@scaleway.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: En Ouyang <en.ouyang93@outlook.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
Co-authored-by: nvjullin <jullin@nvidia.com>
Co-authored-by: Didier Durand <2927957+didier-durand@users.noreply.github.com>
Co-authored-by: TianyuLi0 <116711075+TianyuLi0@users.noreply.github.com>
Co-authored-by: Hongxia Yang <62075498+hongxiayang@users.noreply.github.com>
Co-authored-by: Yuekai Zhang <zhangyuekai@foxmail.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: Hyogeun Oh (오효근) <ohg3417@gmail.com>
Co-authored-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Lukas Geiger <lukas.geiger94@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Huzaifa Sidhpurwala <huzaifas@redhat.com>
Co-authored-by: Federico <65908512+coval3nte@users.noreply.github.com>
Co-authored-by: zixuanzhang226 <zixuanzhang@bytedance.com>
Co-authored-by: wuhang <wuhang6@huawei.com>
Co-authored-by: yzds <41983536+youzhedian@users.noreply.github.com>
Co-authored-by: hongchao <hongchao@msh.team>
Co-authored-by: czhu-cohere <conway.zhu@cohere.com>
Co-authored-by: Wei <weiweinpu@gmail.com>
Co-authored-by: Yiheng Xu <charlesyihengxu@gmail.com>
Co-authored-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: Chenheli Hua <huachenheli@outlook.com>
Co-authored-by: CSWYF3634076 <58356743+CSWYF3634076@users.noreply.github.com>

9d30de44

[XPU] Fix OOM issue for data parallel with Ray backend (#22500) · 8f0d7eae

Fanli Lin authored Aug 27, 2025


Signed-off-by: Fanli Lin <fanli.lin@intel.com>
Signed-off-by: Fanli Lin <fanli0116@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

8f0d7eae

[FlashInfer] Cache hyper params in metadata builder (#23732) · 11eddf02
Woosuk Kwon authored Aug 27, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
11eddf02
[Misc] Move CpuGpuBuffer to vllm/v1/utils.py (#23728) · 04ff1e43
Woosuk Kwon authored Aug 27, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
04ff1e43
Optimize input preparation for FlashInfer [2/N] (#23174) · 6578e873
Woosuk Kwon authored Aug 27, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
6578e873
[XPU]fix cuda event used in XPU model runner (#23708) · 64466778
Kunshang Ji authored Aug 27, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
64466778
[Core] Use key-only cache for `BaseMultiModalProcessor` (#23018) · 69244e67
Cyrus Leung authored Aug 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
69244e67
[Bugfix] fix when config.yaml config value is list parse error (#23528) · 8dbf6ed7
rongfu.leng authored Aug 27, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
8dbf6ed7
[XPU] Add xpu torch.compile support (#22609) · fce10dbe
Kunshang Ji authored Aug 27, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
fce10dbe
[Quantization] Expand compressed-tensors MoE matching logic to support NFP4 + FP8 MoEs (#22674) · d272415e
Dipika Sikka authored Aug 27, 2025
```
Signed-off-by: Dipika Sikka <dipikasikka1@gmail.com>
Signed-off-by: Dipika <dipikasikka1@gmail.com>
```
d272415e
[Frontend] Optimize beam search performance by limiting concurrency (#23599) · 142ac080
Chen Zhang authored Aug 26, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
142ac080
[Frontend] Add --log-error-stack to print stack trace for error response (#22960) · 32102644
Chen Zhang authored Aug 26, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
32102644
[Model] Add Ernie4.5 VL Model Support (#22514) · 644d57d5
CSWYF3634076 authored Aug 27, 2025
```
Signed-off-by: wangyafeng <wangyafeng@baidu.com>
```
644d57d5
[Core] Asynchronous h2d in merge_multimodal_embeddings via pinned memory. (#23686) · c905684c
Chenheli Hua authored Aug 26, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
c905684c

[Bugfix]: Qwen3 Coder Tool Parser (#23099) · 78683580

Yiheng Xu authored Aug 27, 2025


Signed-off-by: Yiheng Xu <charlesyihengxu@gmail.com>
Co-authored-by: Aaron Pham <contact@aarnphm.xyz>

78683580

[Bugfix][gpt-oss] passing the cache config in gpt-oss (#23613) · fecbb7c7
Wei authored Aug 26, 2025
```
Signed-off-by: Wei Wei <wwei6@meta.com>
```
fecbb7c7
[Bugfix] Lazy import gpt_oss_triton_kernels_moe for mxfp4 (#23678) · de02b07d
Michael Goin authored Aug 26, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
de02b07d
[quantization] use channel scales for w4a8 + misc fixes (#23570) · 2c2b140a
czhu-cohere authored Aug 26, 2025
```
Signed-off-by: czhu-cohere <conway.zhu@cohere.com>
```
2c2b140a
fix pynccl reduce_scatter (#23648) · c7c80af0
yzds authored Aug 27, 2025
```
Co-authored-by: hongchao <hongchao@msh.team>
```
c7c80af0
[Feature][Responses API] Support MCP tool in background mode (#23494) · 6891205b
wuhang authored Aug 27, 2025
```
Signed-off-by: wuhang <wuhang6@huawei.com>
```
6891205b
feat: add triton fused moe config for GLM-4.5-Air-FP8 on B200 (#23695) · b1625dbe
zixuanzhang226 authored Aug 26, 2025
```
Signed-off-by: Zixuan Zhang <zixuanzhang@bytedance.com>
```
b1625dbe
[Bugfix] UnboundLocalError when GptOss reasoning specified (#23054) · 585e0bde
Federico authored Aug 27, 2025
```
Signed-off-by: Federico <65908512+coval3nte@users.noreply.github.com>
```
585e0bde

26 Aug, 2025 18 commits
- [V1] [Hybrid] Enable Full CUDA graph by default for hybrid models in V1 (#22594) · 5f1af97f
  Thomas Parnell authored Aug 27, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  5f1af97f
- [V1][P/D]P2pNcclConnector supports flashinfer (#23536) · c3b0fd1e
  Zhonghua Deng authored Aug 27, 2025
```
Signed-off-by: Abatom <abzhonghua@gmail.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  c3b0fd1e
- [Model] Enable video support for InternVL3.5 models (#23658) · 9816b81f
  Isotr0py authored Aug 27, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  9816b81f
- [Bugfix] Fix incorrect original shape in hashing (#23672) · 9715f7bb
  Cyrus Leung authored Aug 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  9715f7bb
- [v1] Add cross-attention KV cache support for encoder-decoder models (#23664) · 98aa16ff
  Russell Bryant authored Aug 26, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  98aa16ff
- [Docs] Fix warnings in `mkdocs build` (#23649) · 730d0ac8
  Hyogeun Oh (오효근) authored Aug 27, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
Signed-off-by: Hyogeun Oh (오효근) <ohg3417@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  730d0ac8
- [Bugfix] Fix cuda event usage with CPU model runner (#23643) · 9b018700
  Li, Jiang authored Aug 27, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  9b018700
- [Misc] Add override for allreduce fusion thresholds (#23639) · 7ea22e42
  nvjullin authored Aug 26, 2025
```
Signed-off-by: Julien Lin <jullin@nvidia.com>
```
  7ea22e42
- [model] support qwen2audio embedding input (#23625) · 9d4183dd
  Yuekai Zhang authored Aug 26, 2025
```
Signed-off-by: Yuekai Zhang <zhangyuekai@foxmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  9d4183dd
- [Bugfix] fix bf16 multimodal model hash (#23623) · 513298f1
  Yuekai Zhang authored Aug 26, 2025
```
Signed-off-by: Yuekai Zhang <zhangyuekai@foxmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  513298f1
- [Docs] Reduce requirements for docs build (#23651) · 379f828f
  Harry Mellor authored Aug 26, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  379f828f
- [CPU] add cpu fused moe pytorch native implementation (#23146) · f58675bf
  TianyuLi0 authored Aug 26, 2025
```
Signed-off-by: Tianyu Li <tianyu.li@arm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
```
  f58675bf
- [Doc]: fix various spelling issues in multiple files (#23636) · 7c04779a
  Didier Durand authored Aug 26, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  7c04779a
- [Kernel] Added flashinfer fp8 per-tensor gemms (#22895) · f66673a3
  nvjullin authored Aug 26, 2025
```
Signed-off-by: Julien Lin <jullin@nvidia.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  f66673a3
- Support FlashAttention Backend for Hybrid SSM Models (#23299) · 2b4fc9bd
  Chen Zhang authored Aug 26, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  2b4fc9bd
- feat: add usage to TranscriptionResponse (text and json response_format) (#23576) · ebd5a77b
  Guillaume Calmettes authored Aug 26, 2025
```
Signed-off-by: Guillaume Calmettes <gcalmettes@scaleway.com>
```
  ebd5a77b
- [Bugfix] Add missing enable_log_outputs parameter to init_app_state function (#23634) · 384dd1b0
  Matúš Námešný authored Aug 26, 2025
```
Signed-off-by: Matúš Námešný <matus.namesny@ameria.com>
```
  384dd1b0
- [Model] fix DeepSeek e_score_correction_bias dtype to fp32 (#23640) · fdeb3dac
  Jee Jee Li authored Aug 26, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  fdeb3dac