Commits · 40bb17502736a9b6127cefc535303285b13e0630 · OpenDAS / vllm_cscc

01 Apr, 2026 1 commit

[vLLM IR] 1/N Implement IR skeleton and rms_norm op (#33825) · 40bb1750

Luka Govedič authored Mar 31, 2026


Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Xinyu Chen <xinyu1.chen@intel.com>
Signed-off-by: chzhang <chaojun.zhang@intel.com>
Signed-off-by: Luka Govedic <luka.govedic@gmail.com>
Co-authored-by: Xinyu Chen <xinyu1.chen@intel.com>
Co-authored-by: Chaojun Zhang <chaojun.zhang@intel.com>
Co-authored-by: Luka Govedič <ProExpertProg@h100-01.nemg-001.lab.rdu2.dc.redhat.com>

40bb1750

31 Mar, 2026 2 commits

[torch.compile] Refactor Attention Quant Fusion Pass and Remove Boilerplate (#37373) · 077a9a8e
BadrBasowid authored Apr 01, 2026
```
Signed-off-by: BadrBasowid <badr.basowid@gmail.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>
```
077a9a8e

replace cuda_device_count_stateless() to current_platform.device_count() (#37841) · 4dfad17e

wliao2 authored Mar 31, 2026


Signed-off-by: Liao, Wei <wei.liao@intel.com>
Signed-off-by: wliao2 <wei.liao@intel.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>

4dfad17e

30 Mar, 2026 1 commit

[Mamba][Bugfix] Raise on insufficient cache blocks instead of silently capping... · cc06b4e8

Nicolò Lucchesi authored Mar 30, 2026


[Mamba][Bugfix] Raise on insufficient cache blocks instead of silently capping cudagraph sizes (#38270)
Signed-off-by: NickLucche <nlucches@redhat.com>

cc06b4e8

26 Mar, 2026 1 commit
- [ROCm][CI] Fix flaky GPTQ compile correctness test (#38161) · f2d16207
  Andreas Karatzas authored Mar 26, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  f2d16207
25 Mar, 2026 3 commits
- [compile] Add some more startup tests for top models (#38046) · 6e37c46b
  Richard Zou authored Mar 25, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  6e37c46b
- [Mypy] Better fixes for the `mypy` issues in `vllm/config` (#37902) · d215d1ef
  Harry Mellor authored Mar 25, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d215d1ef
- [ROCm][Test] Fix ROCM_AITER_UNIFIED_ATTN attn+quant fusion test (#37640) · 42e95479
  vllmellm authored Mar 25, 2026
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  42e95479
24 Mar, 2026 3 commits
- [Perf] Disable inductor runtime asserts by default for serving perfor… (#37485) · 82580b10
  Terry Gao authored Mar 24, 2026
```
Signed-off-by: tianrengao <terrygao87@gmail.com>
Co-authored-by: Tianren Gao <tianren@fb.com>
```
  82580b10
- [BugFix] fix VLLM_USE_STANDALONE_COMPILE=0 (#38015) · 89f572db
  Richard Zou authored Mar 24, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  89f572db
- [V0 Deprecation] Refactor kv cache from list to element (#37487) · c59a132f
  Wentao Ye authored Mar 23, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c59a132f
22 Mar, 2026 1 commit
- [ROCm][CI] Fix MEGA_AOT_ARTIFACT fallback when PyTorch < 2.10.0 lacks AOT support (#37763) · 3b06c55c
  Andreas Karatzas authored Mar 22, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  3b06c55c
21 Mar, 2026 1 commit

[MoE Refactor] Mxfp4 oracle rebased (#37128) · 87bd9189

Yongye Zhu authored Mar 20, 2026


Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

87bd9189

20 Mar, 2026 3 commits
- [compile] Add compiled artifact counter for VLLM_USE_MEGA_AOT_ARTIFACT=1. (#37589) · 2e089b96
  Zhengxu Chen authored Mar 20, 2026
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  2e089b96
- [compile] Fix aot test failures with torch 2.12. (#37604) · c0f5fae6
  Zhengxu Chen authored Mar 20, 2026
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  c0f5fae6
- [compile][graph_partition]Add tensor size handling (#36038) · ea2c148f
  Xiao authored Mar 19, 2026
```
Signed-off-by: Xiao Fu <xiaofu@meta.com>
```
  ea2c148f
19 Mar, 2026 1 commit
- test Qwen/Qwen3-4B-Instruct-2507 for unbacked (#36064) · 112944fa
  Laith Sakka authored Mar 19, 2026
```
Signed-off-by: Laith Sakka <lsakka@meta.com>
```
  112944fa
18 Mar, 2026 2 commits
- [V0 Deprecation] Deprecate virtual engine (#37195) · 0d81a1fe
  Wentao Ye authored Mar 18, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  0d81a1fe
- [Perf] Eliminate padding and slicing op for GPT-OSS with Flashinfer MXFP4 MXFP8 MoE (#30647) · 296839a1
  elvischenv authored Mar 18, 2026
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  296839a1
16 Mar, 2026 1 commit
- [Custom Ops] Add functional + out variant for scaled_fp4_quant (#34389) · 3e6a1e16
  Terry Gao authored Mar 16, 2026
```
Signed-off-by: tianrengao <terrygao87@gmail.com>
```
  3e6a1e16
13 Mar, 2026 1 commit
- Enable RoPE+KV cache fusion for ROCm AITER FA (non-shuffle layout) (#35786) · a4ad9db5
  Rohan Potdar authored Mar 13, 2026
```
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
```
  a4ad9db5
12 Mar, 2026 1 commit
- [Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145) · 53ec16a7
  Kunshang Ji authored Mar 12, 2026
```
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  53ec16a7
11 Mar, 2026 3 commits
- [torch.compile] Add support for non-contiguous fused RMSNorm + group quant (#36551) · 9556af87
  Luka Govedič authored Mar 11, 2026
```
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Copilot <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ProExpertProg <11367180+ProExpertProg@users.noreply.github.com>
```
  9556af87
- [torch.compile] Use FakeTensors instead of real GPU tensors for single-size compilation (#36093) · 822e250a
  Richard Zou authored Mar 11, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  822e250a
- [compile] aot_compile should respect VLLM_DISABLE_COMPILE_CACHE (#36358) · 09b6f998
  Richard Zou authored Mar 11, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  09b6f998
10 Mar, 2026 1 commit
- [Bugfix] Avoid merging empty-only partitions into splitting-op subgraphs (#36595) · ca5fb4bb
  Jiangyun Zhu authored Mar 10, 2026
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  ca5fb4bb
09 Mar, 2026 2 commits

[torch.compile] Rename `compile_ranges_split_points` to `compile_ranges_endpoints` (#36027) · 4b87ffbe

Copilot authored Mar 09, 2026

Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ProExpertProg <11367180+ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

4b87ffbe

[cudagraph] fix cudagraph warning in deepseekv32 (#28044) · e5ff1402
Jiangyun Zhu authored Mar 09, 2026
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
e5ff1402

05 Mar, 2026 4 commits
- [compile] Consistent compiler config for saved/loaded vllm backends. (#35810) · a97954b6
  Zhengxu Chen authored Mar 05, 2026
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  a97954b6
- [Bugfix][CI] fix typos (#34934) · 6a895197
  Jiayi Yan authored Mar 06, 2026
```
Signed-off-by: 1195343015 <1195343015@qq.com>
Signed-off-by: Jiayi Yan <66017932+1195343015@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6a895197
- [Hardware] Replace `torch.cuda.synchronize()` api with `torch.accelerator.synchronize` (#36085) · 66a22096
  Kunshang Ji authored Mar 05, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  66a22096
- [compile] Fix extra cache save on warm start. (#35921) · dd6dbd93
  Zhengxu Chen authored Mar 04, 2026
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  dd6dbd93
04 Mar, 2026 5 commits
- [torch.compile] Stop lazily compiling (#35472) · 5569f521
  Richard Zou authored Mar 04, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  5569f521
- [CI] Add Blackwell AsyncTP correctness test (#35871) · d7166e74
  Stefano Castagnetta authored Mar 04, 2026
```
Signed-off-by: Stefano Castagnetta <scastagnetta@nvidia.com>
```
  d7166e74
- [Feature][CI]: compare `func` & `no_func` outputs in test_functionalization.py (#35481) · fb3e78ab
  Bhuminjay Soni authored Mar 04, 2026
```
Signed-off-by: Bhuminjay <bhuminjaysoni@gmail.com>
Signed-off-by: Bhuminjay Soni <Soni5Happy@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  fb3e78ab
- [Bugfix] Cap FULL decode cudagraph sizes for Mamba/hybrid models (#34094) (#34571) · d6e04f4c
  haosdent authored Mar 04, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
Co-authored-by: zjy0516 <riverclouds.zhu@qq.com>
```
  d6e04f4c
- [Hardware] Replace `torch.cuda.empty_cache` with `torch.accelerator.empty_cache` (#30681) · 16d2ad1d
  Kunshang Ji authored Mar 04, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  16d2ad1d
03 Mar, 2026 1 commit

[ROCm] [CI] Add new fusion test cases that are relevant to vLLM IR Ops (#34307) · fb7fdc49

TJian authored Mar 03, 2026


Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>

fb7fdc49

02 Mar, 2026 1 commit
- [torch.compile] Improve cold and warm start compile tests (#35709) · d1a6e96d
  Richard Zou authored Mar 02, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  d1a6e96d
28 Feb, 2026 1 commit

[1/N] Elastic EP Milestone 2 (#34861) · dea26833

Itay Alroy authored Feb 28, 2026


Signed-off-by: Yongji Wu <wuyongji317@gmail.com>
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: Ron Tourgeman <rtourgeman@nvidia.com>
Co-authored-by: Yongji Wu <wuyongji317@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Ron Tourgeman <rtourgeman@nvidia.com>

dea26833