Commits · 87bd91892f8c63ed9aeb2ad2e701472ead8be84c · OpenDAS / vllm_cscc

21 Mar, 2026 1 commit

[MoE Refactor] Mxfp4 oracle rebased (#37128) · 87bd9189

Yongye Zhu authored Mar 20, 2026


Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

87bd9189

20 Mar, 2026 3 commits
- [compile] Add compiled artifact counter for VLLM_USE_MEGA_AOT_ARTIFACT=1. (#37589) · 2e089b96
  Zhengxu Chen authored Mar 20, 2026
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  2e089b96
- [compile] Fix aot test failures with torch 2.12. (#37604) · c0f5fae6
  Zhengxu Chen authored Mar 20, 2026
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  c0f5fae6
- [compile][graph_partition]Add tensor size handling (#36038) · ea2c148f
  Xiao authored Mar 19, 2026
```
Signed-off-by: Xiao Fu <xiaofu@meta.com>
```
  ea2c148f
19 Mar, 2026 1 commit
- test Qwen/Qwen3-4B-Instruct-2507 for unbacked (#36064) · 112944fa
  Laith Sakka authored Mar 19, 2026
```
Signed-off-by: Laith Sakka <lsakka@meta.com>
```
  112944fa
18 Mar, 2026 2 commits
- [V0 Deprecation] Deprecate virtual engine (#37195) · 0d81a1fe
  Wentao Ye authored Mar 18, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  0d81a1fe
- [Perf] Eliminate padding and slicing op for GPT-OSS with Flashinfer MXFP4 MXFP8 MoE (#30647) · 296839a1
  elvischenv authored Mar 18, 2026
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  296839a1
16 Mar, 2026 1 commit
- [Custom Ops] Add functional + out variant for scaled_fp4_quant (#34389) · 3e6a1e16
  Terry Gao authored Mar 16, 2026
```
Signed-off-by: tianrengao <terrygao87@gmail.com>
```
  3e6a1e16
13 Mar, 2026 1 commit
- Enable RoPE+KV cache fusion for ROCm AITER FA (non-shuffle layout) (#35786) · a4ad9db5
  Rohan Potdar authored Mar 13, 2026
```
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
```
  a4ad9db5
12 Mar, 2026 1 commit
- [Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145) · 53ec16a7
  Kunshang Ji authored Mar 12, 2026
```
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  53ec16a7
11 Mar, 2026 3 commits
- [torch.compile] Add support for non-contiguous fused RMSNorm + group quant (#36551) · 9556af87
  Luka Govedič authored Mar 11, 2026
```
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Copilot <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ProExpertProg <11367180+ProExpertProg@users.noreply.github.com>
```
  9556af87
- [torch.compile] Use FakeTensors instead of real GPU tensors for single-size compilation (#36093) · 822e250a
  Richard Zou authored Mar 11, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  822e250a
- [compile] aot_compile should respect VLLM_DISABLE_COMPILE_CACHE (#36358) · 09b6f998
  Richard Zou authored Mar 11, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  09b6f998
10 Mar, 2026 1 commit
- [Bugfix] Avoid merging empty-only partitions into splitting-op subgraphs (#36595) · ca5fb4bb
  Jiangyun Zhu authored Mar 10, 2026
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  ca5fb4bb
09 Mar, 2026 2 commits

[torch.compile] Rename `compile_ranges_split_points` to `compile_ranges_endpoints` (#36027) · 4b87ffbe

Copilot authored Mar 09, 2026

Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ProExpertProg <11367180+ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

4b87ffbe

[cudagraph] fix cudagraph warning in deepseekv32 (#28044) · e5ff1402
Jiangyun Zhu authored Mar 09, 2026
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
e5ff1402

05 Mar, 2026 4 commits
- [compile] Consistent compiler config for saved/loaded vllm backends. (#35810) · a97954b6
  Zhengxu Chen authored Mar 05, 2026
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  a97954b6
- [Bugfix][CI] fix typos (#34934) · 6a895197
  Jiayi Yan authored Mar 06, 2026
```
Signed-off-by: 1195343015 <1195343015@qq.com>
Signed-off-by: Jiayi Yan <66017932+1195343015@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6a895197
- [Hardware] Replace `torch.cuda.synchronize()` api with `torch.accelerator.synchronize` (#36085) · 66a22096
  Kunshang Ji authored Mar 05, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  66a22096
- [compile] Fix extra cache save on warm start. (#35921) · dd6dbd93
  Zhengxu Chen authored Mar 04, 2026
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  dd6dbd93
04 Mar, 2026 5 commits
- [torch.compile] Stop lazily compiling (#35472) · 5569f521
  Richard Zou authored Mar 04, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  5569f521
- [CI] Add Blackwell AsyncTP correctness test (#35871) · d7166e74
  Stefano Castagnetta authored Mar 04, 2026
```
Signed-off-by: Stefano Castagnetta <scastagnetta@nvidia.com>
```
  d7166e74
- [Feature][CI]: compare `func` & `no_func` outputs in test_functionalization.py (#35481) · fb3e78ab
  Bhuminjay Soni authored Mar 04, 2026
```
Signed-off-by: Bhuminjay <bhuminjaysoni@gmail.com>
Signed-off-by: Bhuminjay Soni <Soni5Happy@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  fb3e78ab
- [Bugfix] Cap FULL decode cudagraph sizes for Mamba/hybrid models (#34094) (#34571) · d6e04f4c
  haosdent authored Mar 04, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
Co-authored-by: zjy0516 <riverclouds.zhu@qq.com>
```
  d6e04f4c
- [Hardware] Replace `torch.cuda.empty_cache` with `torch.accelerator.empty_cache` (#30681) · 16d2ad1d
  Kunshang Ji authored Mar 04, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  16d2ad1d
03 Mar, 2026 1 commit

[ROCm] [CI] Add new fusion test cases that are relevant to vLLM IR Ops (#34307) · fb7fdc49

TJian authored Mar 03, 2026


Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>

fb7fdc49

02 Mar, 2026 1 commit
- [torch.compile] Improve cold and warm start compile tests (#35709) · d1a6e96d
  Richard Zou authored Mar 02, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  d1a6e96d
28 Feb, 2026 1 commit

[1/N] Elastic EP Milestone 2 (#34861) · dea26833

Itay Alroy authored Feb 28, 2026


Signed-off-by: Yongji Wu <wuyongji317@gmail.com>
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: Ron Tourgeman <rtourgeman@nvidia.com>
Co-authored-by: Yongji Wu <wuyongji317@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Ron Tourgeman <rtourgeman@nvidia.com>

dea26833

27 Feb, 2026 1 commit
- [compile] Fix caching error over pytree slice node. (#35308) · 29b35477
  Zhengxu Chen authored Feb 27, 2026
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  29b35477
26 Feb, 2026 2 commits

[torch.compile] Sequence Parallelism threshold compile ranges (#28672) · 9d379410

Jason Li authored Feb 25, 2026


Signed-off-by: jasonlizhengjian <jasonlizhengjian@gmail.com>
Signed-off-by: Jason Li <jasonlizhengjian@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

9d379410

[Kernel] Refactor FlashInfer allreduce for mnnvl backend (#34109) · 71dfce6a

Hanjie Qiu authored Feb 25, 2026


Signed-off-by: hjjq <50634613+hjjq@users.noreply.github.com>
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Wei Zhao <51183510+wzhao18@users.noreply.github.com>

71dfce6a

25 Feb, 2026 1 commit
- [ROCm]: Enable customop and rope+kvcache fusion for AITER RoPE (#35180) · f38f8c97
  Rohan Potdar authored Feb 24, 2026
```
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
```
  f38f8c97
24 Feb, 2026 3 commits

[Refactor] [1/N] Reorganize kernel abstraction directory (#34055) · 6af03f23

BadrBasowid authored Feb 24, 2026


Signed-off-by: BadrBasowid <badr.basowid@gmail.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>

6af03f23

[ROCm] AITER fused RoPE+KVCache (#33443) · 2ff4e511

Rohan Potdar authored Feb 23, 2026


Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
Signed-off-by: charlifu <charlifu@amd.com>
Signed-off-by: Rohan Potdar <66227218+Rohan138@users.noreply.github.com>
Co-authored-by: charlifu <charlifu@amd.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>

2ff4e511

[Perf] Enable FlashInfer DeepGEMM swapAB on SM90 by default (#34924) · a4bd661f

Michael Goin authored Feb 23, 2026


Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

a4bd661f

18 Feb, 2026 1 commit
- [Bugfix] Fix quant RMS norm fusion for quantization with TMA-aligned scales (#33255) · a88b3be7
  ElizaWszola authored Feb 18, 2026
```
Signed-off-by: ElizaWszola <ewszola@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  a88b3be7
17 Feb, 2026 1 commit
- [BugFix] Fix sp tests (#34716) · 7967e854
  Richard Zou authored Feb 17, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  7967e854
11 Feb, 2026 2 commits
- [Bugfix]: Fix ROCm fusion attn test; use AttentionBackend utils to create kv cache (#33948) · fd618871
  Rohan Potdar authored Feb 11, 2026
```
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
```
  fd618871
- [torch.compile] Stop doing unnecessary FakeTensorProp in PiecewiseCompileInterpreter (#34093) · e30cedd4
  Richard Zou authored Feb 10, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  e30cedd4
09 Feb, 2026 1 commit
- [torch.compile][Fusion] Fix attention fusion pass removing kv_udpate op. (#33945) · bb9f9730
  Charlie Fu authored Feb 09, 2026
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  bb9f9730