Commits · 186aced5ffb62b62b41eb1beaf2a598ada43351b · OpenDAS / vllm_cscc

27 Aug, 2025 12 commits

[Docs] Remove in-tree Gaudi install instructions (#23628) · 2b61d2e2
Harry Mellor authored Aug 27, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
2b61d2e2
[Model] Enable native HF format InternVL support (#23742) · 84149043
Isotr0py authored Aug 27, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
84149043

[Model] Interface to enable batch-level DP support (#23733) · fe8d7b6f

Cyrus Leung authored Aug 27, 2025

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

fe8d7b6f

Fix pre-commit on main (#23747) · 16dc4052
Harry Mellor authored Aug 27, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
16dc4052

Add vLLM Korea Meetup in the README.md and meetups.md (#23746) · 8dd2baa5

rebel-hongseok authored Aug 27, 2025


Signed-off-by: rebel-hongseok <hongseok@rebellions.ai>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

8dd2baa5

[V1] [Hybrid] Disable prefix caching by default for hybrid or mamba-based models (#23716) · 704432af
Thomas Parnell authored Aug 27, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
704432af

[model] Support MiniCPM-V 4.5 (#23586) · 9d30de44

tc-mb authored Aug 27, 2025


Signed-off-by: tc-mb <caitianchi@modelbest.cn>
Signed-off-by: Xin Yang <xyangx@amazon.com>
Signed-off-by: Abatom <abzhonghua@gmail.com>
Signed-off-by: chzhang <chaojun.zhang@intel.com>
Signed-off-by: Pate Motter <patemotter@google.com>
Signed-off-by: Terrencezzj <terrence@cohere.ai>
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
Signed-off-by: simon-mo <simon.mo@hey.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Siyuan Fu <siyuanf@nvidia.com>
Signed-off-by: siyuanf <siyuanf@nvidia.com>
Signed-off-by: Weiliang Liu <weiliangl@nvidia.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Signed-off-by: Zijing Liu <liuzijing2014@gmail.com>
Signed-off-by: Zijing Liu <liuzijing2014@users.noreply.github.com>
Signed-off-by: jiabin.00 <jiabin.00@bytedance.com>
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: tc-mb <157115220+tc-mb@users.noreply.github.com>
Signed-off-by: Roger Wang <hey@rogerw.me>
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Huy Do <huydhn@gmail.com>
Signed-off-by: Matúš Námešný <matus.namesny@ameria.com>
Signed-off-by: Guillaume Calmettes <gcalmettes@scaleway.com>
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: oye93 <en.ouyang93@outlook.com>
Signed-off-by: Julien Lin <jullin@nvidia.com>
Signed-off-by: Didier Durand <durand.didier@gmail.com>
Signed-off-by: Tianyu Li <tianyu.li@arm.com>
Signed-off-by: Hongxia Yang <hongxia.yang@amd.com>
Signed-off-by: Yuekai Zhang <zhangyuekai@foxmail.com>
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Signed-off-by: Zerohertz <ohg3417@gmail.com>
Signed-off-by: Hyogeun Oh (오효근) <ohg3417@gmail.com>
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Huzaifa Sidhpurwala <huzaifas@redhat.com>
Signed-off-by: Federico <65908512+coval3nte@users.noreply.github.com>
Signed-off-by: Zixuan Zhang <zixuanzhang@bytedance.com>
Signed-off-by: wuhang <wuhang6@huawei.com>
Signed-off-by: czhu-cohere <conway.zhu@cohere.com>
Signed-off-by: Wei Wei <wwei6@meta.com>
Signed-off-by: Yiheng Xu <charlesyihengxu@gmail.com>
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: wangyafeng <wangyafeng@baidu.com>
Co-authored-by: Xin Yang <105740670+xyang16@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Zhonghua Deng <abzhonghua@gmail.com>
Co-authored-by: Chaojun Zhang <chaojun.zhang@intel.com>
Co-authored-by: Pate Motter <p@temotter.com>
Co-authored-by: Terrence Zhao <32208165+Terrencezzj@users.noreply.github.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Simon Mo <simon.mo@hey.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: weiliang <weiliangl@nvidia.com>
Co-authored-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Copilot <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ProExpertProg <11367180+ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Zijing Liu <liuzijing2014@users.noreply.github.com>
Co-authored-by: Bin Jia <45593998+FoolPlayer@users.noreply.github.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Raghavan <oneraghavan@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.me>
Co-authored-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Co-authored-by: Huy Do <huydhn@gmail.com>
Co-authored-by: Matúš Námešný <matus@namesny.com>
Co-authored-by: Guillaume Calmettes <gcalmettes@scaleway.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: En Ouyang <en.ouyang93@outlook.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
Co-authored-by: nvjullin <jullin@nvidia.com>
Co-authored-by: Didier Durand <2927957+didier-durand@users.noreply.github.com>
Co-authored-by: TianyuLi0 <116711075+TianyuLi0@users.noreply.github.com>
Co-authored-by: Hongxia Yang <62075498+hongxiayang@users.noreply.github.com>
Co-authored-by: Yuekai Zhang <zhangyuekai@foxmail.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: Hyogeun Oh (오효근) <ohg3417@gmail.com>
Co-authored-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Lukas Geiger <lukas.geiger94@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Huzaifa Sidhpurwala <huzaifas@redhat.com>
Co-authored-by: Federico <65908512+coval3nte@users.noreply.github.com>
Co-authored-by: zixuanzhang226 <zixuanzhang@bytedance.com>
Co-authored-by: wuhang <wuhang6@huawei.com>
Co-authored-by: yzds <41983536+youzhedian@users.noreply.github.com>
Co-authored-by: hongchao <hongchao@msh.team>
Co-authored-by: czhu-cohere <conway.zhu@cohere.com>
Co-authored-by: Wei <weiweinpu@gmail.com>
Co-authored-by: Yiheng Xu <charlesyihengxu@gmail.com>
Co-authored-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: Chenheli Hua <huachenheli@outlook.com>
Co-authored-by: CSWYF3634076 <58356743+CSWYF3634076@users.noreply.github.com>

9d30de44

[Docs] Fix a 1-2-3 list and style issues in tpu.md (#23729) · 1f7a9c95
Michael Yao authored Aug 27, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
1f7a9c95
[Docs] Fix an admonition important (#23726) · 5bd9f841
Michael Yao authored Aug 27, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
5bd9f841
[Core] Use key-only cache for `BaseMultiModalProcessor` (#23018) · 69244e67
Cyrus Leung authored Aug 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
69244e67
[Model] Add Ernie4.5 VL Model Support (#22514) · 644d57d5
CSWYF3634076 authored Aug 27, 2025
```
Signed-off-by: wangyafeng <wangyafeng@baidu.com>
```
644d57d5
[Docs] Fix math rendering in docs (#23676) · 6dab89b8
Harry Mellor authored Aug 27, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
6dab89b8

26 Aug, 2025 9 commits
- [Docs] Move quant supported hardware table to README (#23663) · 6421b66b
  Harry Mellor authored Aug 26, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6421b66b
- [doc] Hybrid KV Cache Manager design doc (#22688) · d696f86e
  Chen Zhang authored Aug 26, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d696f86e
- [Model] Enable video support for InternVL3.5 models (#23658) · 9816b81f
  Isotr0py authored Aug 27, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  9816b81f
- [Docs] [V1] [Hybrid] Update docs to remove FlashInfer constraint for hybrid models (#23665) · 227e231b
  Thomas Parnell authored Aug 26, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  227e231b
- [Docs] Reduce requirements for docs build (#23651) · 379f828f
  Harry Mellor authored Aug 26, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  379f828f
- [Doc]: fix various spelling issues in multiple files (#23636) · 7c04779a
  Didier Durand authored Aug 26, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  7c04779a
- [Docs] Fix broken links to `docs/api/summary.md` (#23637) · 164b2273
  Harry Mellor authored Aug 26, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  164b2273
- Fix CLI parameter documentation inconsistency in pooling_models.md (#23630) · ff77764f
  Raghavan authored Aug 26, 2025
  
  ff77764f
- [Docs] Fix titles for multi-file examples that are rendered in the docs (#23573) · bfc1edc9
  Harry Mellor authored Aug 26, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  bfc1edc9
25 Aug, 2025 4 commits

[Docs] Update Documentation of Cohere Command-A Models (#23584) · 7b6a8372

Terrence Zhao authored Aug 25, 2025


Signed-off-by: Terrencezzj <terrence@cohere.ai>
Signed-off-by: Abatom <abzhonghua@gmail.com>
Co-authored-by: Zhonghua Deng <abzhonghua@gmail.com>

7b6a8372

[Doc] Add caution for API server scale-out (#23550) · e269be2b
Cyrus Leung authored Aug 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
e269be2b
[misc] add shanghai meetup (#23535) · d0a4a3f6
youkaichao authored Aug 25, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
d0a4a3f6

[Doc: ]fix various typos in multiple files (#23487) · 47455c42

Didier Durand authored Aug 25, 2025

Signed-off-by: Didier Durand <durand.didier@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

47455c42

24 Aug, 2025 2 commits
- [Model] Enable BLOOM on V1 (#23488) · e2db1164
  Cyrus Leung authored Aug 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e2db1164
- [New Model]Donut model (#23229) · 416f0592
  汪志鹏 authored Aug 24, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  416f0592
23 Aug, 2025 2 commits
- Support DeepSeek-V3.1 tool call (#23454) · b8f17f5d
  Xu Wenqing authored Aug 23, 2025
```
Signed-off-by: Xu Wenqing <xuwq1993@qq.com>
```
  b8f17f5d
- [Model] Support DP for ViT on MiniCPM-V-4 (#23327) · 23c939fd
  WeiQing Chen authored Aug 23, 2025
```
Signed-off-by: ycyaw66 <497410282@qq.com>
Co-authored-by: ycyaw66 <497410282@qq.com>
```
  23c939fd
22 Aug, 2025 4 commits

[PERF] PyTorch Symmetric Memory All-Reduce (#20759) · 0313cf85

Ilya Markov authored Aug 22, 2025


Signed-off-by: ilmarkov <imarkov@redhat.com>
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

0313cf85

[Doc] Update the doc for log probs + prefix caching (#23399) · a073be6d

Chen Zhang authored Aug 22, 2025


Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

a073be6d

[New Model] Add Seed-Oss model (#23241) · 59640693

Bin Jia authored Aug 22, 2025


Signed-off-by: jiabin.00 <jiabin.00@bytedance.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

59640693

[Deprecation] Remove `prompt_token_ids` arg fallback in `LLM.generate` and `LLM.embed` (#18800) · 8896eb72
Cyrus Leung authored Aug 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
8896eb72

21 Aug, 2025 5 commits

[Doc] Fix batch-level DP example (#23325) · 5cc54f7c

Cyrus Leung authored Aug 21, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

5cc54f7c

[Model] Add LFM2 architecture (#22845) · 2e2000f3
Paul Pak authored Aug 21, 2025
```
Signed-off-by: Paul Pak <paulpak58@gmail.com>
```
2e2000f3

[Sampler] Support returning final logprobs (#22387) · f571ff8e

22quinn authored Aug 20, 2025


Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

f571ff8e

[Model][VLM] Support R-4B Model (#23246) · 655a09f6

杨奇(yann qi) authored Aug 21, 2025

Signed-off-by: yannqi <yannqi@qq.com>
Signed-off-by: 杨奇(yann qi) <51905299+yannqi@users.noreply.github.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: yannqiyang <yannqiyang@tencent.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

655a09f6

[V1][Mamba1] - Full CUDA and Piecewise CUDA Graphs Support (#23035) · 3663870c

Asaf Joseph Gardin authored Aug 21, 2025


Signed-off-by: asafg <asafg@ai21.com>
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
Co-authored-by: asafg <asafg@ai21.com>

3663870c

20 Aug, 2025 2 commits
- [CLI][Doc] Formalize `--mm-encoder-tp-mode` (#23190) · 5efd6905
  Cyrus Leung authored Aug 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5efd6905
- [Model] Improve olmo and olmo2 (#23228) · c6d80a7a
  Jee Jee Li authored Aug 20, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  c6d80a7a