Commits · 006693ed43defb7827ef3a4d1a8b94000b010ca9 · OpenDAS / vllm_cscc

16 Nov, 2025 1 commit

[V1] Support MP Executor for multi node distributed inference (#23691) · b316ac65

Lucia Fang authored Nov 16, 2025


Signed-off-by: Lu Fang <fanglu@fb.com>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Signed-off-by: Lucia Fang <fanglu@fb.com>
Signed-off-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

b316ac65

15 Nov, 2025 1 commit

[compile] Enable sequence parallelism matching w/o custom ops enabled (#27126) · f36292db

Angela Yi authored Nov 15, 2025


Signed-off-by: angelayi <yiangela7@gmail.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Signed-off-by: ProExpertProg <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <luka.govedic@gmail.com>

f36292db

14 Nov, 2025 1 commit

[DCP] Support Decode Context Parallel (DCP) for GQA with Flashinfer (#25438) · 4516d44b

Jingchun Gao authored Nov 14, 2025


Signed-off-by: gaojc <1055866782@qq.com>
Signed-off-by: Jingchun Gao <gaojingchun1@huawei.com>
Signed-off-by: Jingchun Gao <63247409+gjc0824@users.noreply.github.com>
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Co-authored-by: gaojingchun (A) <g00955623@china.huawei.com>
Co-authored-by: Jingchun Gao <gaojingchun1@huawei.com>
Co-authored-by: QiuChunshuo <qiuchunshuo@huawei.com>

4516d44b

11 Nov, 2025 1 commit

[CI/Test Fix] Fix CP tests on Blackwell (#28404) · 39029d51

Lucas Wilkinson authored Nov 10, 2025

Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

39029d51

08 Nov, 2025 1 commit

[DCP] Support dcp kv_cache interleave size > 1 (#26696) · 2108a571

zhangsicheng5 authored Nov 09, 2025


Signed-off-by: zhangsicheng5 <zhangsicheng5@huawei.com>
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Signed-off-by: Qiu <qiuchunshuo@huawei.com>
Co-authored-by: QiuChunshuo <qiuchunshuo@huawei.com>

2108a571

05 Nov, 2025 1 commit

[BugFix] Support EP/DP + EPLB with MTP (#25311) · e50c4546

Ilya Markov authored Nov 05, 2025


Signed-off-by: ilmarkov <markovilya197@gmail.com>
Signed-off-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>

e50c4546

28 Oct, 2025 1 commit

[Bugfix] Fix allocation & free logic of SingleWriterShmRingBuffer (#27117) · 02af36df

Kero Liang authored Oct 28, 2025


Signed-off-by: Kero Liang <kerorek@outlook.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: donglu <donglu@cohere.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

02af36df

24 Oct, 2025 1 commit
- Fix EventPublisherFactory logic for disabled KV cache events (#27419) · c528b900
  usberkeley authored Oct 24, 2025
```
Signed-off-by: Bradley <bradley.b.pitt@gmail.com>
```
  c528b900
23 Oct, 2025 1 commit
- [CI/Build] Remove unnecessary flags from test registry (#27353) · fe2016de
  Cyrus Leung authored Oct 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  fe2016de
22 Oct, 2025 1 commit
- [Chore] Separate out system utilities from vllm.utils (#27201) · a0003b56
  dongbo910220 authored Oct 23, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  a0003b56
21 Oct, 2025 2 commits
- [V0 Deprecation] Remove V0 executors (#27142) · 647214f3
  Nick Hill authored Oct 21, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  647214f3
- create is_in_the_same_node on cpu (#26832) · 0eb8f2b8
  Lunwen He authored Oct 20, 2025
```
Co-authored-by: Lunwen He <lunwenh@meta.com>
```
  0eb8f2b8
19 Oct, 2025 1 commit

[Chore] Separate out `vllm.utils.network_utils` (#27164) · 7a6c8c3f

iAmir97 authored Oct 19, 2025


Signed-off-by: iAmir97 <Amir.balwel@embeddedllm.com>
Co-authored-by: iAmir97 <Amir.balwel@embeddedllm.com>

7a6c8c3f

18 Oct, 2025 1 commit
- [Chore] Clean up pytorch helper functions in `vllm.utils` (#26908) · 6ac5e06f
  Isotr0py authored Oct 19, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: isotr0py <2037008807@qq.com>
```
  6ac5e06f
16 Oct, 2025 3 commits

[CI] Replace large models with tiny alternatives in tests (#24057) · 43721bc6

Tahsin Tunan authored Oct 16, 2025


Signed-off-by: Tahsin Tunan <tahsintunan@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

43721bc6

[bugfix] Fix SP + PP without specifying compile size (#26955) · e19b16dd
Angela Yi authored Oct 15, 2025
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
e19b16dd

[ROCm][FEAT] Fuse DeepSeek shared experts into AITER fused_moe ops (#24097) · 13170343

kliuae authored Oct 16, 2025


Signed-off-by: chenjun <junchen2@amd.com>
Signed-off-by: kliuae <kuanfu.liu@embeddedllm.com>
Co-authored-by: valarLip <103567126+valarLip@users.noreply.github.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>

13170343

15 Oct, 2025 1 commit

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change ... · 96b9aa5a

Morrison Turnansky authored Oct 14, 2025


[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change  compilation level to compilation mode, deprecation compilation level (#26355)
Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

96b9aa5a

14 Oct, 2025 1 commit

[DCP] Support Decode Context Parallel (DCP) for GQA with FlashAttention (#24864) · ea97940d

Jaya Yuan authored Oct 14, 2025


Signed-off-by: yuanyongjie.yyj <yuanyongjie.yyj@antgroup.com>
Signed-off-by: FENP <32334296+FENP@users.noreply.github.com>
Signed-off-by: Jaya Yuan <yuanyongjie.yyj@antgroup.com>

ea97940d

13 Oct, 2025 1 commit

[Bugfix][Rocm] fix qr error when different inp shape (#25892) · 134f70b3

haoyangli-amd authored Oct 14, 2025


Signed-off-by: Haoyang Li <lihaoyang0109@gmail.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: ilmarkov <markovilya197@gmail.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

134f70b3

12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
08 Oct, 2025 1 commit
- Tidy `vllm/config/__init__.py` to only add classes and functions (#26405) · 2f99f2f5
  Harry Mellor authored Oct 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2f99f2f5
07 Oct, 2025 1 commit
- [V0 Deprecation] Remove `VLLM_USE_V1` from tests (#26341) · 1e4ecca1
  Cyrus Leung authored Oct 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1e4ecca1
06 Oct, 2025 1 commit
- Fix per file ruff ignores related to line length (#26262) · 6c046382
  Harry Mellor authored Oct 06, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6c046382
05 Oct, 2025 3 commits
- Fix per file ruff ignores related to simplification (#26259) · b893d661
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b893d661
- Remove all references to `yapf` as it's no longer used (#26251) · 4e256cad
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4e256cad
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
23 Sep, 2025 3 commits
- [CI/Build] Fix and re-enable v1 PP test on CI (#25496) · ae002924
  Isotr0py authored Sep 24, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  ae002924
- Enable symmetric memory all reduce by default only enabling for TP (#25070) · 8bdd8b5c
  Ilya Markov authored Sep 23, 2025
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  8bdd8b5c
- [core] add nccl symmetric memory for all reduce (#24532) · 8c1c81a3
  Amir Samani authored Sep 23, 2025
```
Signed-off-by: Amir Samani <asamani@nvidia.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  8c1c81a3
22 Sep, 2025 1 commit

[DP] support torchrun external launcher with Data Parallelism (#24899) · 922979bf

Lucia Fang authored Sep 22, 2025


Signed-off-by: Lu Fang <fanglu@fb.com>
Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>

922979bf

19 Sep, 2025 1 commit
- Move `ModelConfig` from `config/__init__.py` to `config/model.py` (#25252) · aed16879
  Harry Mellor authored Sep 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  aed16879
18 Sep, 2025 1 commit
- [V0 Deprecation] Skip PP test (#25128) · 7fb2a5be
  Woosuk Kwon authored Sep 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  7fb2a5be
16 Sep, 2025 4 commits

[CI] Add Decode Context Parallelism (DCP) test to CI (#24487) · 4e5affea
Ming Yang authored Sep 16, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
4e5affea

[Feat][EPLB] A novel static EPLB placement strategy for MoE models. (#23745) · 7ea5c73a

Chen Bruce authored Sep 16, 2025


Signed-off-by: bruceszchen <bruceszchen@tencent.com>
Signed-off-by: Chen Bruce <bruceszchen@tencent.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Chen Bruce <cszwwdz@vip.qq.com>
Co-authored-by: lemon412 <lemon412@foxmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

7ea5c73a

[Bugfix] Fix sequence parallelism bug when enable pipeline parallelism (#24021) · 17871983
cascade authored Sep 15, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
```
17871983
Remove V0 Encoder-Decoder Support (#24907) · 759ef49b
Woosuk Kwon authored Sep 15, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
759ef49b

14 Sep, 2025 1 commit
- [Hybrid Allocator] Support Pipeline Parallel (#23974) · 8e5cdcda
  Chen Zhang authored Sep 14, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  8e5cdcda
12 Sep, 2025 1 commit
- [Core] Shared memory based object store for Multimodal data caching and IPC (#20452) · a5b84f1c
  dongluw authored Sep 12, 2025
```
Signed-off-by: donglu <donglu@cohere.com>
```
  a5b84f1c
08 Sep, 2025 1 commit
- Move `KVEventsConfig` from `config/__init__.py` to `config/kv_events.py` (#24433) · 03dd652c
  Harry Mellor authored Sep 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  03dd652c