Commits · 321938e9ac4000e0cb37e328359a7fd3026bc672 · OpenDAS / vllm_cscc

27 Aug, 2025 40 commits

[Feature] Add `VLLM_DISABLE_PAD_FOR_CUDAGRAPH` to Avoid Hang Issue (#23595) · 321938e9

Wentao Ye authored Aug 27, 2025

Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

321938e9

[Bugfix] Fix Marlin NVFP4 for modelopt (#23659) · f9ca2b40
Michael Goin authored Aug 27, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
f9ca2b40
DP/EP Support for gpt-oss with deepep-ht comm kernel on SM100 (#23608) · 082cc07e
Yongye Zhu authored Aug 27, 2025

082cc07e
[V1][Mamba] - Enable V1 by default for Mamba Models (#23650) · 853c371f
Asaf Joseph Gardin authored Aug 27, 2025
```
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
```
853c371f
[Multimodal] Generate mm_hash based on request metadata when caching is turned off (#23690) · 8bf6266a
Roger Wang authored Aug 27, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
8bf6266a
Disable `torch.compile` for dynamic rope models in Transformers backend (#23738) · 0585a9e7
Harry Mellor authored Aug 27, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
0585a9e7

ci: Add arm64 docker build to release pipeline (#23210) · 3c0ef769

Eli Uriegas authored Aug 27, 2025


Signed-off-by: Eli Uriegas <eliuriegas@meta.com>
Signed-off-by: Eli Uriegas <1700823+seemethere@users.noreply.github.com>

3c0ef769

[Docs] Fix warnings in `mkdocs build` (continued) (#23743) · 4e4d017b
Hyogeun Oh (오효근) authored Aug 28, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
Signed-off-by: Hyogeun Oh (오효근) <ohg3417@gmail.com>
```
4e4d017b
[V1] [Hybrid] Enable compile and piecewise CUDA graph for MiniMax-Text models (#22589) · dd589322
Thomas Parnell authored Aug 27, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
dd589322
[Model] Merge `SupportsMultiModalWithRawInput` with `SupportsMultiModal` (#23749) · 52883ed0
Cyrus Leung authored Aug 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
52883ed0
[BugFix] Fix topk_softmax assert (#19764) · 4f35be10
Luka Govedič authored Aug 27, 2025
```
Signed-off-by: Luka Govedic <lgovedic@redhat.com>
```
4f35be10
[Docs] Remove in-tree Gaudi install instructions (#23628) · 2b61d2e2
Harry Mellor authored Aug 27, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
2b61d2e2
[LogitsProcs] Deduplicate built-in LP implementation logic (#23362) · 3ce8285d
Nick Hill authored Aug 27, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
3ce8285d
[Doc]: upgrade version of crate-ci tool for improved typo detection (#23755) · 83f555f6
Didier Durand authored Aug 27, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
83f555f6
[Model] Enable native HF format InternVL support (#23742) · 84149043
Isotr0py authored Aug 27, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
84149043

[Feature] Add Hopper DeepGEMM E8M0 for DeepSeekV3.1 scale_fmt (#23666) · 3af47c3c

Wentao Ye authored Aug 27, 2025


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

3af47c3c

Only run `get_attr_docs` if generating help text (#23723) · 513c1fe2
Harry Mellor authored Aug 27, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
513c1fe2

[Model] Interface to enable batch-level DP support (#23733) · fe8d7b6f

Cyrus Leung authored Aug 27, 2025

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

fe8d7b6f

Fix pre-commit on main (#23747) · 16dc4052
Harry Mellor authored Aug 27, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
16dc4052

Add vLLM Korea Meetup in the README.md and meetups.md (#23746) · 8dd2baa5

rebel-hongseok authored Aug 27, 2025


Signed-off-by: rebel-hongseok <hongseok@rebellions.ai>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

8dd2baa5

[Model] Explicit `default_pooling_type` interface (#23736) · 5eeef1b9
Cyrus Leung authored Aug 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
5eeef1b9
[V1] [Hybrid] Disable prefix caching by default for hybrid or mamba-based models (#23716) · 704432af
Thomas Parnell authored Aug 27, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
704432af
[Misc] Remove unnecessary `_send_reconfig_message()` in `core_client.py` (#23127) · a403d0fa
Nick Hill authored Aug 27, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
a403d0fa
[Bugfix] Fix task field initialization when PYTHONOPTIMIZE is enabled (#23718) · 8c13820f
cndoit18 authored Aug 27, 2025
```
Signed-off-by: cndoit18 <cndoit18@outlook.com>
```
8c13820f

[model] Support MiniCPM-V 4.5 (#23586) · 9d30de44

tc-mb authored Aug 27, 2025


Signed-off-by: tc-mb <caitianchi@modelbest.cn>
Signed-off-by: Xin Yang <xyangx@amazon.com>
Signed-off-by: Abatom <abzhonghua@gmail.com>
Signed-off-by: chzhang <chaojun.zhang@intel.com>
Signed-off-by: Pate Motter <patemotter@google.com>
Signed-off-by: Terrencezzj <terrence@cohere.ai>
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
Signed-off-by: simon-mo <simon.mo@hey.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Siyuan Fu <siyuanf@nvidia.com>
Signed-off-by: siyuanf <siyuanf@nvidia.com>
Signed-off-by: Weiliang Liu <weiliangl@nvidia.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Signed-off-by: Zijing Liu <liuzijing2014@gmail.com>
Signed-off-by: Zijing Liu <liuzijing2014@users.noreply.github.com>
Signed-off-by: jiabin.00 <jiabin.00@bytedance.com>
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: tc-mb <157115220+tc-mb@users.noreply.github.com>
Signed-off-by: Roger Wang <hey@rogerw.me>
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Huy Do <huydhn@gmail.com>
Signed-off-by: Matúš Námešný <matus.namesny@ameria.com>
Signed-off-by: Guillaume Calmettes <gcalmettes@scaleway.com>
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: oye93 <en.ouyang93@outlook.com>
Signed-off-by: Julien Lin <jullin@nvidia.com>
Signed-off-by: Didier Durand <durand.didier@gmail.com>
Signed-off-by: Tianyu Li <tianyu.li@arm.com>
Signed-off-by: Hongxia Yang <hongxia.yang@amd.com>
Signed-off-by: Yuekai Zhang <zhangyuekai@foxmail.com>
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Signed-off-by: Zerohertz <ohg3417@gmail.com>
Signed-off-by: Hyogeun Oh (오효근) <ohg3417@gmail.com>
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Huzaifa Sidhpurwala <huzaifas@redhat.com>
Signed-off-by: Federico <65908512+coval3nte@users.noreply.github.com>
Signed-off-by: Zixuan Zhang <zixuanzhang@bytedance.com>
Signed-off-by: wuhang <wuhang6@huawei.com>
Signed-off-by: czhu-cohere <conway.zhu@cohere.com>
Signed-off-by: Wei Wei <wwei6@meta.com>
Signed-off-by: Yiheng Xu <charlesyihengxu@gmail.com>
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: wangyafeng <wangyafeng@baidu.com>
Co-authored-by: Xin Yang <105740670+xyang16@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Zhonghua Deng <abzhonghua@gmail.com>
Co-authored-by: Chaojun Zhang <chaojun.zhang@intel.com>
Co-authored-by: Pate Motter <p@temotter.com>
Co-authored-by: Terrence Zhao <32208165+Terrencezzj@users.noreply.github.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Simon Mo <simon.mo@hey.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: weiliang <weiliangl@nvidia.com>
Co-authored-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Copilot <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ProExpertProg <11367180+ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Zijing Liu <liuzijing2014@users.noreply.github.com>
Co-authored-by: Bin Jia <45593998+FoolPlayer@users.noreply.github.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Raghavan <oneraghavan@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.me>
Co-authored-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Co-authored-by: Huy Do <huydhn@gmail.com>
Co-authored-by: Matúš Námešný <matus@namesny.com>
Co-authored-by: Guillaume Calmettes <gcalmettes@scaleway.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: En Ouyang <en.ouyang93@outlook.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
Co-authored-by: nvjullin <jullin@nvidia.com>
Co-authored-by: Didier Durand <2927957+didier-durand@users.noreply.github.com>
Co-authored-by: TianyuLi0 <116711075+TianyuLi0@users.noreply.github.com>
Co-authored-by: Hongxia Yang <62075498+hongxiayang@users.noreply.github.com>
Co-authored-by: Yuekai Zhang <zhangyuekai@foxmail.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: Hyogeun Oh (오효근) <ohg3417@gmail.com>
Co-authored-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Lukas Geiger <lukas.geiger94@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Huzaifa Sidhpurwala <huzaifas@redhat.com>
Co-authored-by: Federico <65908512+coval3nte@users.noreply.github.com>
Co-authored-by: zixuanzhang226 <zixuanzhang@bytedance.com>
Co-authored-by: wuhang <wuhang6@huawei.com>
Co-authored-by: yzds <41983536+youzhedian@users.noreply.github.com>
Co-authored-by: hongchao <hongchao@msh.team>
Co-authored-by: czhu-cohere <conway.zhu@cohere.com>
Co-authored-by: Wei <weiweinpu@gmail.com>
Co-authored-by: Yiheng Xu <charlesyihengxu@gmail.com>
Co-authored-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: Chenheli Hua <huachenheli@outlook.com>
Co-authored-by: CSWYF3634076 <58356743+CSWYF3634076@users.noreply.github.com>

9d30de44

[Docs] Fix a 1-2-3 list and style issues in tpu.md (#23729) · 1f7a9c95
Michael Yao authored Aug 27, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
1f7a9c95

[XPU] Fix OOM issue for data parallel with Ray backend (#22500) · 8f0d7eae

Fanli Lin authored Aug 27, 2025


Signed-off-by: Fanli Lin <fanli.lin@intel.com>
Signed-off-by: Fanli Lin <fanli0116@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

8f0d7eae

[CI/Build] Reduce LoRA layer test cases (#23721) · e0394076
Jee Jee Li authored Aug 27, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
e0394076
[FlashInfer] Cache hyper params in metadata builder (#23732) · 11eddf02
Woosuk Kwon authored Aug 27, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
11eddf02
[Misc] Move CpuGpuBuffer to vllm/v1/utils.py (#23728) · 04ff1e43
Woosuk Kwon authored Aug 27, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
04ff1e43
Optimize input preparation for FlashInfer [2/N] (#23174) · 6578e873
Woosuk Kwon authored Aug 27, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
6578e873
[Docs] Fix an admonition important (#23726) · 5bd9f841
Michael Yao authored Aug 27, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
5bd9f841
[CI/Build] Remove redundant register in model init tests (#23715) · 91e382c9
Cyrus Leung authored Aug 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
91e382c9
[XPU]fix cuda event used in XPU model runner (#23708) · 64466778
Kunshang Ji authored Aug 27, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
64466778
[Core] Use key-only cache for `BaseMultiModalProcessor` (#23018) · 69244e67
Cyrus Leung authored Aug 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
69244e67
[Bugfix] fix when config.yaml config value is list parse error (#23528) · 8dbf6ed7
rongfu.leng authored Aug 27, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
8dbf6ed7
[CI/Build] Remove redundant LoRA model tests (#23706) · 9de25c29
Jee Jee Li authored Aug 27, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
9de25c29
[XPU] Add xpu torch.compile support (#22609) · fce10dbe
Kunshang Ji authored Aug 27, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
fce10dbe
[Quantization] Expand compressed-tensors MoE matching logic to support NFP4 + FP8 MoEs (#22674) · d272415e
Dipika Sikka authored Aug 27, 2025
```
Signed-off-by: Dipika Sikka <dipikasikka1@gmail.com>
Signed-off-by: Dipika <dipikasikka1@gmail.com>
```
d272415e
[Frontend] Optimize beam search performance by limiting concurrency (#23599) · 142ac080
Chen Zhang authored Aug 26, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
142ac080