Commits · eefa41c170d8b19e377b7adc22d591fa942cc0d1 · OpenDAS / vllm_cscc

24 Mar, 2026 1 commit
- sync v0.18.0 · eefa41c1
  zhuwenwen authored Mar 24, 2026
  
  eefa41c1
09 Mar, 2026 1 commit
- Allow `markdownlint` to run locally (#36398) · a0f44bb6
  Harry Mellor authored Mar 09, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a0f44bb6
06 Mar, 2026 1 commit

[docs][torch.compile] Add fusions.md — kernel/operator fusion reference page (#35538) · ce8546a1

Copilot authored Mar 06, 2026

Signed-off-by: ProExpertProg <luka.govedic@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ProExpertProg <11367180+ProExpertProg@users.noreply.github.com>
Co-authored-by: ProExpertProg <luka.govedic@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

ce8546a1

06 Feb, 2026 1 commit

[Docs] Add sections on process architecture and minimum CPU resources (#33940) · c39ee9ee

Michael Goin authored Feb 06, 2026



It seems users can be confused about vLLM's performance when running
with very small amounts of CPU cores available. We are missing a clear
overview of what vLLM's process architecture is, so I added this along with
some diagrams in arch_overview.md, and included a section on CPU resource
recommendations in optimization.md
Signed-off-by: mgoin <mgoin64@gmail.com>

c39ee9ee

05 Feb, 2026 1 commit
- sync v0.15.1 · c721b814
  zhuwenwen authored Feb 05, 2026
  
  c721b814
28 Jan, 2026 1 commit
- [7/N][Attention][Docs] Add documentation for attention backends (#32477) · 77c4f45c
  Matthew Bonanni authored Jan 28, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  77c4f45c
27 Jan, 2026 1 commit

[DOC]: Add warning about max_num_batched_tokens and max_model_len when chunked... · 0b53bec6

Vincent Gimenes authored Jan 27, 2026


[DOC]: Add warning about max_num_batched_tokens and max_model_len when chunked prefill is disabled (#33109)
Signed-off-by: Vincent Gimenes <147169146+VincentG1234@users.noreply.github.com>

0b53bec6

14 Dec, 2025 1 commit

[Doc]: fixing typos in various files (#30540) · 1a55cfaf

Didier Durand authored Dec 14, 2025

Signed-off-by: Didier Durand <durand.didier@gmail.com>
Signed-off-by: Didier Durand <2927957+didier-durand@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

1a55cfaf

23 Nov, 2025 1 commit
- [Doc] Update more docs with respect to V1 (#29188) · 389aa1b2
  Cyrus Leung authored Nov 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  389aa1b2
17 Oct, 2025 2 commits
- [Docs] Replace all explicit anchors with real links (#27087) · 483ea646
  Harry Mellor authored Oct 17, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  483ea646
- [Docs] Reduce custom syntax used in docs (#27009) · 4ffd6e89
  Harry Mellor authored Oct 17, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4ffd6e89
14 Oct, 2025 1 commit
- [Doc] ruff format some Python examples (#26767) · ef9676a1
  Cyrus Leung authored Oct 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ef9676a1
26 Sep, 2025 1 commit
- [Doc] Update Batch-level DP docs (#25757) · 633f943e
  Cyrus Leung authored Sep 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  633f943e
18 Sep, 2025 1 commit

[Model] enable data parallel for InternVL vision encoder (#23909) · 52bc9d5b

YiwenC authored Sep 17, 2025


Signed-off-by: Yiwen Chen <yiwen66@berkeley.edu>
Signed-off-by: YiwenC <54658925+666even666@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

52bc9d5b

12 Sep, 2025 1 commit
- [Core] Shared memory based object store for Multimodal data caching and IPC (#20452) · a5b84f1c
  dongluw authored Sep 12, 2025
```
Signed-off-by: donglu <donglu@cohere.com>
```
  a5b84f1c
03 Sep, 2025 1 commit
- fix some typos (#24071) · 1bd007f2
  co63oc authored Sep 03, 2025
```
Signed-off-by: co63oc <co63oc@users.noreply.github.com>
```
  1bd007f2
02 Sep, 2025 1 commit
- [Model] Support dp on ViT on GLM-4.5V (#23168) · 2f0bab3f
  WeiQing Chen authored Sep 02, 2025
```
Signed-off-by: David Chen <530634352@qq.com>
```
  2f0bab3f
01 Sep, 2025 1 commit

[Model] Support DP for ViT on Kimi-VL-A3B-Thinking-2506 (#23817) · a0e0efd6

WeiQing Chen authored Sep 02, 2025


Signed-off-by: Junhong <liujunhong11@huawei.com>
Signed-off-by: LJH-LBJ <98734602+LJH-LBJ@users.noreply.github.com>
Co-authored-by: Junhong <liujunhong11@huawei.com>
Co-authored-by: LJH-LBJ <98734602+LJH-LBJ@users.noreply.github.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

a0e0efd6

30 Aug, 2025 1 commit

[Model] Enable encoder DP for MiniCPM-V (#23948) · 3a6acad4

Jiangyun Zhu authored Aug 30, 2025


Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

3a6acad4

27 Aug, 2025 3 commits

[Model] Interface to enable batch-level DP support (#23733) · fe8d7b6f

Cyrus Leung authored Aug 27, 2025

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

fe8d7b6f

[Docs] Fix an admonition important (#23726) · 5bd9f841
Michael Yao authored Aug 27, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
5bd9f841
[Core] Use key-only cache for `BaseMultiModalProcessor` (#23018) · 69244e67
Cyrus Leung authored Aug 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
69244e67

26 Aug, 2025 1 commit
- [Doc]: fix various spelling issues in multiple files (#23636) · 7c04779a
  Didier Durand authored Aug 26, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  7c04779a
25 Aug, 2025 1 commit
- [Doc] Add caution for API server scale-out (#23550) · e269be2b
  Cyrus Leung authored Aug 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e269be2b
23 Aug, 2025 1 commit
- [Model] Support DP for ViT on MiniCPM-V-4 (#23327) · 23c939fd
  WeiQing Chen authored Aug 23, 2025
```
Signed-off-by: ycyaw66 <497410282@qq.com>
Co-authored-by: ycyaw66 <497410282@qq.com>
```
  23c939fd
21 Aug, 2025 1 commit

[Doc] Fix batch-level DP example (#23325) · 5cc54f7c

Cyrus Leung authored Aug 21, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

5cc54f7c

20 Aug, 2025 1 commit
- [CLI][Doc] Formalize `--mm-encoder-tp-mode` (#23190) · 5efd6905
  Cyrus Leung authored Aug 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5efd6905
19 Aug, 2025 1 commit
- [Doc] use power of 2 (#23172) · 2c3f557f
  Tialo authored Aug 19, 2025
  
  2c3f557f
07 Aug, 2025 2 commits
- [Frontend] Use engine argument to control MM cache size (#22441) · 139d1557
  Cyrus Leung authored Aug 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  139d1557
- [Core] Store only the keys for multi-modal data in P0 (#22198) · 766bc816
  Cyrus Leung authored Aug 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  766bc816
24 May, 2025 1 commit
- [Doc] Reorganize user guide (#18661) · 1cb194a0
  Cyrus Leung authored May 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1cb194a0
23 May, 2025 1 commit
- Migrate docs from Sphinx to MkDocs (#18145) · a1fe24d9
  Harry Mellor authored May 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a1fe24d9
30 Apr, 2025 1 commit
- [Docs] Update optimization.md doc (#17482) · 0b7e701d
  Michael Goin authored Apr 30, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  0b7e701d
28 Mar, 2025 1 commit

[doc] add missing imports (#15699) · 2914006f

Reid authored Mar 28, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

2914006f

01 Mar, 2025 1 commit
- [Docs] Add `pipeline_parallel_size` to optimization docs (#14059) · f64ffa8c
  Brayden Zhong authored Mar 01, 2025
```
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  f64ffa8c
12 Jan, 2025 1 commit
- [CI/Build] Add markdown linter (#11857) · 43f3d9e6
  Rafael Vasquez authored Jan 12, 2025
```
Signed-off-by: Rafael Vasquez <rafvasq21@gmail.com>
```
  43f3d9e6
06 Jan, 2025 1 commit
- [Doc][2/N] Reorganize Models and Usage sections (#11755) · ee77fdb5
  Cyrus Leung authored Jan 06, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ee77fdb5
03 Jan, 2025 1 commit
- Update default max_num_batch_tokens for chunked prefill (#11694) · 2f1e8e8f
  Sachin Varghese authored Jan 02, 2025
  
  2f1e8e8f
23 Dec, 2024 1 commit
- [Docs] Convert rST to MyST (Markdown) (#11145) · 32aa2059
  Rafael Vasquez authored Dec 23, 2024
```
Signed-off-by: Rafael Vasquez <rafvasq21@gmail.com>
```
  32aa2059
05 Dec, 2024 1 commit
- [Doc] Create a new "Usage" section (#10827) · aa39a8e1
  Cyrus Leung authored Dec 05, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  aa39a8e1