Commits · 3d2a026fd0317204752d7933408aff19aaa80cfd · OpenDAS / vllm_cscc

13 Feb, 2026 1 commit

[Feature] Pipeline Parallel Async send/recv, 2.9% E2E throughput improvement (#33368) · 3d2a026f

Wentao Ye authored Feb 13, 2026


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

3d2a026f

10 Feb, 2026 1 commit

[Perf] Move eplb rebalance algo to async thread (#30888) · 67132945

Ilya Markov authored Feb 10, 2026


Signed-off-by: ilmarkov <markovilya197@gmail.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>

67132945

06 Feb, 2026 1 commit

[torch.compile] Reorganize vllm/compilation and tests/compile (0/N for vLLM IR) (#33731) · ac32e66c

Luka Govedič authored Feb 06, 2026


Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: ProExpertProg <luka.govedic@gmail.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

ac32e66c

05 Feb, 2026 1 commit

[Feat][RL][1/2] Native Weight Syncing API: NCCL (#31943) · c1858b7e

Aaron Hao authored Feb 05, 2026


Signed-off-by: ahao-anyscale <ahao@anyscale.com>
Signed-off-by: Aaron Hao <ahao@anyscale.com>
Co-authored-by: SumanthRH <sumanthrh99@gmail.com>

c1858b7e

04 Feb, 2026 1 commit
- [Bugfix] Fix torchrun PP broadcast deadlock with async scheduling (#33701) · 02080179
  Isotr0py authored Feb 04, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  02080179
03 Feb, 2026 1 commit
- [CI/Build] Investigate torchrun distributed tests hanging issue (#33650) · 32e84fa1
  Isotr0py authored Feb 03, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  32e84fa1
30 Jan, 2026 1 commit

[CI][AMD] Skip 4 GPUs testgroup ray tests (#33305) · 070c811d

Ryan Rock authored Jan 29, 2026


Signed-off-by: Ryan Rock <ryan.rock@amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>

070c811d

29 Jan, 2026 1 commit
- [Multimodal] Simplify MM input definitions (#33331) · c6e7404c
  Cyrus Leung authored Jan 29, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c6e7404c
20 Jan, 2026 1 commit
- [Core] Cleanup shm based object store on engine shutdown (#32429) · 8be263c3
  Walter Beller-Morales authored Jan 20, 2026
```
Signed-off-by: walterbm <walter.beller.morales@gmail.com>
```
  8be263c3
12 Jan, 2026 1 commit
- [Refactor] EPLB rebalance algo to NumPy (#30697) · 1eb61ab3
  Ilya Markov authored Jan 12, 2026
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
```
  1eb61ab3
07 Jan, 2026 1 commit

[EPLB] Optimize EPLB with numpy (#29499) · 6170d47d

Ilya Markov authored Jan 07, 2026


Signed-off-by: ilmarkov <markovilya197@gmail.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

6170d47d

17 Dec, 2025 1 commit
- [Attention] Update tests to remove deprecated env vars (#30563) · 7eb6cb6c
  Matthew Bonanni authored Dec 17, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  7eb6cb6c
11 Dec, 2025 1 commit

[EPLB] Support EPLB w/ NVFP4 (#29804) · a00d8897

Andrew Briand authored Dec 11, 2025


Signed-off-by: Andrew Briand <abriand@nvidia.com>
Co-authored-by: Andrew Briand <abriand@nvidia.com>

a00d8897

09 Dec, 2025 2 commits
- [DCP][Bugfix][CI] Fix accuracy issue of DCP when using FLASH_ATTN_MLA (#30309) · 67475a6e
  Jaya Yuan authored Dec 09, 2025
```
Signed-off-by: FENP <yuanyongjie.yyj@antgroup.com>
```
  67475a6e
- kv_transfer: Rename the shared storage connectors (#30201) · 4c6fd258
  Or Ozeri authored Dec 09, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  4c6fd258
07 Dec, 2025 2 commits
- Revert "[Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145)" (#30199) · e83b7e37
  Cyrus Leung authored Dec 07, 2025
  
  e83b7e37
- [Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145) · 27f4c2fd
  Cyrus Leung authored Dec 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  27f4c2fd
06 Dec, 2025 1 commit
- [Model] Move `multimodal_cpu_fields` definition to field config (#30181) · 671427ef
  Cyrus Leung authored Dec 06, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  671427ef
05 Dec, 2025 1 commit
- [Misc] Rename CohereForAI references to CohereLabs (#30147) · 3633035a
  Russell Bryant authored Dec 05, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  3633035a
04 Dec, 2025 3 commits

Abstract eplb algo (#26471) · 1119f6e4

Mercykid-bash authored Dec 05, 2025

Signed-off-by: Che Ruan <cr623@ic.ac.uk>
Signed-off-by: mengxingkongzhouhan <117415539+mengxingkongzhouhan@users.noreply.github.com>
Signed-off-by: Mercykid-bash <ruanche0218@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Che Ruan <cr623@ic.ac.uk>
Co-authored-by: mengxingkongzhouhan <117415539+mengxingkongzhouhan@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

1119f6e4

[CI][DCP][Perf] reduce DCP CI execution time (#29858) · 46cbbca0
Qiu authored Dec 05, 2025
```
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
```
46cbbca0
[CI][AMD] Match Main CI Behavior By Skipping test_eplb_spec_decode In AMD CI (#30006) · 5430e110
Micah Williamson authored Dec 04, 2025
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
5430e110

03 Dec, 2025 1 commit

[Core] Rename PassConfig flags as per RFC #27995 (#29646) · d7284a26

Arpit Khandelwal authored Dec 02, 2025


Signed-off-by: arpitkh101 <arpit5khandelwal@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

d7284a26

02 Dec, 2025 1 commit
- [Bugfix][EPLB] Prevent user-provided EPLB config from being overwritten with defaults (#29911) · e6f114ac
  Sage Moore authored Dec 02, 2025
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  e6f114ac
24 Nov, 2025 1 commit
- [EPLB] Optimize EPLB for Async Rearrange Experts (#22179) · 2601f18a
  WeiQing Chen authored Nov 24, 2025
```
Signed-off-by: David Chen <530634352@qq.com>
Co-authored-by: SunChenxiang123 <1291824390@qq.com>
```
  2601f18a
23 Nov, 2025 1 commit
- [ROCm][CI] Fix "Cannot re-initialize CUDA in forked subprocess" in test_pynccl.py (#29119) · 55c21c88
  Micah Williamson authored Nov 22, 2025
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
  55c21c88
21 Nov, 2025 1 commit
- [BugFix] EPLB + B200 + DeepGEMM : Handle column-major scales tensor (#29162) · 3137991f
  Varun Sundar Rabindranath authored Nov 21, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  3137991f
20 Nov, 2025 2 commits
- [MODEL] Implement plamo3 (#28834) · c9e09311
  Shinichi Hemmi authored Nov 20, 2025
```
Signed-off-by: Shinichi Hemmi <50256998+Alnusjaponica@users.noreply.github.com>
```
  c9e09311
- [ci][amd] fix EPLB execution test (#28742) · 1e1c0678
  Bradley D authored Nov 19, 2025
```
Signed-off-by: Bradley Davis <bradleyhd@meta.com>
```
  1e1c0678
19 Nov, 2025 1 commit

[Feature] Prefill Context Parallel (PCP) basic support (#28718) · 2fd893b4

Qiu authored Nov 20, 2025


Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Signed-off-by: FENP <yuanyongjie.yyj@antgroup.com>
Signed-off-by: LookAround <lixushi@huawei.com>
Signed-off-by: Jingchun Gao <gaojingchun1@huawei.com>
Signed-off-by: zhenwenqi2024 <zhenwenqi_2022@qq.com>
Co-authored-by: FENP <yuanyongjie.yyj@antgroup.com>
Co-authored-by: LookAround <lixushi@huawei.com>
Co-authored-by: Jingchun Gao <gaojingchun1@huawei.com>
Co-authored-by: zhenwenqi2024 <zhenwenqi_2022@qq.com>
Co-authored-by: Jingchun Gao <63247409+gjc0824@users.noreply.github.com>

2fd893b4

16 Nov, 2025 1 commit

[V1] Support MP Executor for multi node distributed inference (#23691) · b316ac65

Lucia Fang authored Nov 16, 2025


Signed-off-by: Lu Fang <fanglu@fb.com>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Signed-off-by: Lucia Fang <fanglu@fb.com>
Signed-off-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

b316ac65

15 Nov, 2025 1 commit

[compile] Enable sequence parallelism matching w/o custom ops enabled (#27126) · f36292db

Angela Yi authored Nov 15, 2025


Signed-off-by: angelayi <yiangela7@gmail.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Signed-off-by: ProExpertProg <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <luka.govedic@gmail.com>

f36292db

14 Nov, 2025 1 commit

[DCP] Support Decode Context Parallel (DCP) for GQA with Flashinfer (#25438) · 4516d44b

Jingchun Gao authored Nov 14, 2025


Signed-off-by: gaojc <1055866782@qq.com>
Signed-off-by: Jingchun Gao <gaojingchun1@huawei.com>
Signed-off-by: Jingchun Gao <63247409+gjc0824@users.noreply.github.com>
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Co-authored-by: gaojingchun (A) <g00955623@china.huawei.com>
Co-authored-by: Jingchun Gao <gaojingchun1@huawei.com>
Co-authored-by: QiuChunshuo <qiuchunshuo@huawei.com>

4516d44b

11 Nov, 2025 1 commit

[CI/Test Fix] Fix CP tests on Blackwell (#28404) · 39029d51

Lucas Wilkinson authored Nov 10, 2025

Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

39029d51

08 Nov, 2025 1 commit

[DCP] Support dcp kv_cache interleave size > 1 (#26696) · 2108a571

zhangsicheng5 authored Nov 09, 2025


Signed-off-by: zhangsicheng5 <zhangsicheng5@huawei.com>
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Signed-off-by: Qiu <qiuchunshuo@huawei.com>
Co-authored-by: QiuChunshuo <qiuchunshuo@huawei.com>

2108a571

05 Nov, 2025 1 commit

[BugFix] Support EP/DP + EPLB with MTP (#25311) · e50c4546

Ilya Markov authored Nov 05, 2025


Signed-off-by: ilmarkov <markovilya197@gmail.com>
Signed-off-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>

e50c4546

28 Oct, 2025 1 commit

[Bugfix] Fix allocation & free logic of SingleWriterShmRingBuffer (#27117) · 02af36df

Kero Liang authored Oct 28, 2025


Signed-off-by: Kero Liang <kerorek@outlook.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: donglu <donglu@cohere.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

02af36df

24 Oct, 2025 1 commit
- Fix EventPublisherFactory logic for disabled KV cache events (#27419) · c528b900
  usberkeley authored Oct 24, 2025
```
Signed-off-by: Bradley <bradley.b.pitt@gmail.com>
```
  c528b900
23 Oct, 2025 1 commit
- [CI/Build] Remove unnecessary flags from test registry (#27353) · fe2016de
  Cyrus Leung authored Oct 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  fe2016de
22 Oct, 2025 1 commit
- [Chore] Separate out system utilities from vllm.utils (#27201) · a0003b56
  dongbo910220 authored Oct 23, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  a0003b56