Commits · d215d1efca7a18eb2a19007f229bbb070bfbee93 · OpenDAS / vllm_cscc

25 Mar, 2026 2 commits
- [Mypy] Better fixes for the `mypy` issues in `vllm/config` (#37902) · d215d1ef
  Harry Mellor authored Mar 25, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d215d1ef
- [ROCm][Test] Fix ROCM_AITER_UNIFIED_ATTN attn+quant fusion test (#37640) · 42e95479
  vllmellm authored Mar 25, 2026
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  42e95479
24 Mar, 2026 3 commits
- [Perf] Disable inductor runtime asserts by default for serving perfor… (#37485) · 82580b10
  Terry Gao authored Mar 24, 2026
```
Signed-off-by: tianrengao <terrygao87@gmail.com>
Co-authored-by: Tianren Gao <tianren@fb.com>
```
  82580b10
- [BugFix] fix VLLM_USE_STANDALONE_COMPILE=0 (#38015) · 89f572db
  Richard Zou authored Mar 24, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  89f572db
- [V0 Deprecation] Refactor kv cache from list to element (#37487) · c59a132f
  Wentao Ye authored Mar 23, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c59a132f
22 Mar, 2026 1 commit
- [ROCm][CI] Fix MEGA_AOT_ARTIFACT fallback when PyTorch < 2.10.0 lacks AOT support (#37763) · 3b06c55c
  Andreas Karatzas authored Mar 22, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  3b06c55c
21 Mar, 2026 1 commit

[MoE Refactor] Mxfp4 oracle rebased (#37128) · 87bd9189

Yongye Zhu authored Mar 20, 2026


Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

87bd9189

20 Mar, 2026 3 commits
- [compile] Add compiled artifact counter for VLLM_USE_MEGA_AOT_ARTIFACT=1. (#37589) · 2e089b96
  Zhengxu Chen authored Mar 20, 2026
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  2e089b96
- [compile] Fix aot test failures with torch 2.12. (#37604) · c0f5fae6
  Zhengxu Chen authored Mar 20, 2026
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  c0f5fae6
- [compile][graph_partition]Add tensor size handling (#36038) · ea2c148f
  Xiao authored Mar 19, 2026
```
Signed-off-by: Xiao Fu <xiaofu@meta.com>
```
  ea2c148f
19 Mar, 2026 1 commit
- test Qwen/Qwen3-4B-Instruct-2507 for unbacked (#36064) · 112944fa
  Laith Sakka authored Mar 19, 2026
```
Signed-off-by: Laith Sakka <lsakka@meta.com>
```
  112944fa
18 Mar, 2026 2 commits
- [V0 Deprecation] Deprecate virtual engine (#37195) · 0d81a1fe
  Wentao Ye authored Mar 18, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  0d81a1fe
- [Perf] Eliminate padding and slicing op for GPT-OSS with Flashinfer MXFP4 MXFP8 MoE (#30647) · 296839a1
  elvischenv authored Mar 18, 2026
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  296839a1
16 Mar, 2026 1 commit
- [Custom Ops] Add functional + out variant for scaled_fp4_quant (#34389) · 3e6a1e16
  Terry Gao authored Mar 16, 2026
```
Signed-off-by: tianrengao <terrygao87@gmail.com>
```
  3e6a1e16
13 Mar, 2026 1 commit
- Enable RoPE+KV cache fusion for ROCm AITER FA (non-shuffle layout) (#35786) · a4ad9db5
  Rohan Potdar authored Mar 13, 2026
```
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
```
  a4ad9db5
12 Mar, 2026 1 commit
- [Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145) · 53ec16a7
  Kunshang Ji authored Mar 12, 2026
```
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  53ec16a7
11 Mar, 2026 3 commits
- [torch.compile] Add support for non-contiguous fused RMSNorm + group quant (#36551) · 9556af87
  Luka Govedič authored Mar 11, 2026
```
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Copilot <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ProExpertProg <11367180+ProExpertProg@users.noreply.github.com>
```
  9556af87
- [torch.compile] Use FakeTensors instead of real GPU tensors for single-size compilation (#36093) · 822e250a
  Richard Zou authored Mar 11, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  822e250a
- [compile] aot_compile should respect VLLM_DISABLE_COMPILE_CACHE (#36358) · 09b6f998
  Richard Zou authored Mar 11, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  09b6f998
10 Mar, 2026 1 commit
- [Bugfix] Avoid merging empty-only partitions into splitting-op subgraphs (#36595) · ca5fb4bb
  Jiangyun Zhu authored Mar 10, 2026
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  ca5fb4bb
09 Mar, 2026 2 commits

[torch.compile] Rename `compile_ranges_split_points` to `compile_ranges_endpoints` (#36027) · 4b87ffbe

Copilot authored Mar 09, 2026

Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ProExpertProg <11367180+ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

4b87ffbe

[cudagraph] fix cudagraph warning in deepseekv32 (#28044) · e5ff1402
Jiangyun Zhu authored Mar 09, 2026
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
e5ff1402

05 Mar, 2026 4 commits
- [compile] Consistent compiler config for saved/loaded vllm backends. (#35810) · a97954b6
  Zhengxu Chen authored Mar 05, 2026
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  a97954b6
- [Bugfix][CI] fix typos (#34934) · 6a895197
  Jiayi Yan authored Mar 06, 2026
```
Signed-off-by: 1195343015 <1195343015@qq.com>
Signed-off-by: Jiayi Yan <66017932+1195343015@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6a895197
- [Hardware] Replace `torch.cuda.synchronize()` api with `torch.accelerator.synchronize` (#36085) · 66a22096
  Kunshang Ji authored Mar 05, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  66a22096
- [compile] Fix extra cache save on warm start. (#35921) · dd6dbd93
  Zhengxu Chen authored Mar 04, 2026
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  dd6dbd93
04 Mar, 2026 5 commits
- [torch.compile] Stop lazily compiling (#35472) · 5569f521
  Richard Zou authored Mar 04, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  5569f521
- [CI] Add Blackwell AsyncTP correctness test (#35871) · d7166e74
  Stefano Castagnetta authored Mar 04, 2026
```
Signed-off-by: Stefano Castagnetta <scastagnetta@nvidia.com>
```
  d7166e74
- [Feature][CI]: compare `func` & `no_func` outputs in test_functionalization.py (#35481) · fb3e78ab
  Bhuminjay Soni authored Mar 04, 2026
```
Signed-off-by: Bhuminjay <bhuminjaysoni@gmail.com>
Signed-off-by: Bhuminjay Soni <Soni5Happy@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  fb3e78ab
- [Bugfix] Cap FULL decode cudagraph sizes for Mamba/hybrid models (#34094) (#34571) · d6e04f4c
  haosdent authored Mar 04, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
Co-authored-by: zjy0516 <riverclouds.zhu@qq.com>
```
  d6e04f4c
- [Hardware] Replace `torch.cuda.empty_cache` with `torch.accelerator.empty_cache` (#30681) · 16d2ad1d
  Kunshang Ji authored Mar 04, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  16d2ad1d
03 Mar, 2026 1 commit

[ROCm] [CI] Add new fusion test cases that are relevant to vLLM IR Ops (#34307) · fb7fdc49

TJian authored Mar 03, 2026


Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>

fb7fdc49

02 Mar, 2026 1 commit
- [torch.compile] Improve cold and warm start compile tests (#35709) · d1a6e96d
  Richard Zou authored Mar 02, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  d1a6e96d
28 Feb, 2026 1 commit

[1/N] Elastic EP Milestone 2 (#34861) · dea26833

Itay Alroy authored Feb 28, 2026


Signed-off-by: Yongji Wu <wuyongji317@gmail.com>
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: Ron Tourgeman <rtourgeman@nvidia.com>
Co-authored-by: Yongji Wu <wuyongji317@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Ron Tourgeman <rtourgeman@nvidia.com>

dea26833

27 Feb, 2026 1 commit
- [compile] Fix caching error over pytree slice node. (#35308) · 29b35477
  Zhengxu Chen authored Feb 27, 2026
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  29b35477
26 Feb, 2026 2 commits

[torch.compile] Sequence Parallelism threshold compile ranges (#28672) · 9d379410

Jason Li authored Feb 25, 2026


Signed-off-by: jasonlizhengjian <jasonlizhengjian@gmail.com>
Signed-off-by: Jason Li <jasonlizhengjian@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

9d379410

[Kernel] Refactor FlashInfer allreduce for mnnvl backend (#34109) · 71dfce6a

Hanjie Qiu authored Feb 25, 2026


Signed-off-by: hjjq <50634613+hjjq@users.noreply.github.com>
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Wei Zhao <51183510+wzhao18@users.noreply.github.com>

71dfce6a

25 Feb, 2026 1 commit
- [ROCm]: Enable customop and rope+kvcache fusion for AITER RoPE (#35180) · f38f8c97
  Rohan Potdar authored Feb 24, 2026
```
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
```
  f38f8c97
24 Feb, 2026 2 commits

[Refactor] [1/N] Reorganize kernel abstraction directory (#34055) · 6af03f23

BadrBasowid authored Feb 24, 2026


Signed-off-by: BadrBasowid <badr.basowid@gmail.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>

6af03f23

[ROCm] AITER fused RoPE+KVCache (#33443) · 2ff4e511

Rohan Potdar authored Feb 23, 2026


Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
Signed-off-by: charlifu <charlifu@amd.com>
Signed-off-by: Rohan Potdar <66227218+Rohan138@users.noreply.github.com>
Co-authored-by: charlifu <charlifu@amd.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>

2ff4e511