Commits · fd3bfe74c972bccc3c7c45cb3be44cb4c3a26090 · OpenDAS / vllm_cscc

04 Mar, 2026 2 commits

[Bugfix] Cap FULL decode cudagraph sizes for Mamba/hybrid models (#34094) (#34571) · d6e04f4c
haosdent authored Mar 04, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
Co-authored-by: zjy0516 <riverclouds.zhu@qq.com>
```
d6e04f4c

[Hardware] Replace `torch.cuda.empty_cache` with `torch.accelerator.empty_cache` (#30681) · 16d2ad1d

Kunshang Ji authored Mar 04, 2026


Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

16d2ad1d

03 Mar, 2026 1 commit

[ROCm] [CI] Add new fusion test cases that are relevant to vLLM IR Ops (#34307) · fb7fdc49

TJian authored Mar 03, 2026


Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>

fb7fdc49

02 Mar, 2026 1 commit
- [torch.compile] Improve cold and warm start compile tests (#35709) · d1a6e96d
  Richard Zou authored Mar 02, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  d1a6e96d
28 Feb, 2026 1 commit

[1/N] Elastic EP Milestone 2 (#34861) · dea26833

Itay Alroy authored Feb 28, 2026


Signed-off-by: Yongji Wu <wuyongji317@gmail.com>
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: Ron Tourgeman <rtourgeman@nvidia.com>
Co-authored-by: Yongji Wu <wuyongji317@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Ron Tourgeman <rtourgeman@nvidia.com>

dea26833

27 Feb, 2026 1 commit
- [compile] Fix caching error over pytree slice node. (#35308) · 29b35477
  Zhengxu Chen authored Feb 27, 2026
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  29b35477
26 Feb, 2026 2 commits

[torch.compile] Sequence Parallelism threshold compile ranges (#28672) · 9d379410

Jason Li authored Feb 25, 2026


Signed-off-by: jasonlizhengjian <jasonlizhengjian@gmail.com>
Signed-off-by: Jason Li <jasonlizhengjian@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

9d379410

[Kernel] Refactor FlashInfer allreduce for mnnvl backend (#34109) · 71dfce6a

Hanjie Qiu authored Feb 25, 2026


Signed-off-by: hjjq <50634613+hjjq@users.noreply.github.com>
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Wei Zhao <51183510+wzhao18@users.noreply.github.com>

71dfce6a

25 Feb, 2026 1 commit
- [ROCm]: Enable customop and rope+kvcache fusion for AITER RoPE (#35180) · f38f8c97
  Rohan Potdar authored Feb 24, 2026
```
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
```
  f38f8c97
24 Feb, 2026 3 commits

[Refactor] [1/N] Reorganize kernel abstraction directory (#34055) · 6af03f23

BadrBasowid authored Feb 24, 2026


Signed-off-by: BadrBasowid <badr.basowid@gmail.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>

6af03f23

[ROCm] AITER fused RoPE+KVCache (#33443) · 2ff4e511

Rohan Potdar authored Feb 23, 2026


Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
Signed-off-by: charlifu <charlifu@amd.com>
Signed-off-by: Rohan Potdar <66227218+Rohan138@users.noreply.github.com>
Co-authored-by: charlifu <charlifu@amd.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>

2ff4e511

[Perf] Enable FlashInfer DeepGEMM swapAB on SM90 by default (#34924) · a4bd661f

Michael Goin authored Feb 23, 2026


Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

a4bd661f

18 Feb, 2026 1 commit
- [Bugfix] Fix quant RMS norm fusion for quantization with TMA-aligned scales (#33255) · a88b3be7
  ElizaWszola authored Feb 18, 2026
```
Signed-off-by: ElizaWszola <ewszola@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  a88b3be7
17 Feb, 2026 1 commit
- [BugFix] Fix sp tests (#34716) · 7967e854
  Richard Zou authored Feb 17, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  7967e854
11 Feb, 2026 2 commits
- [Bugfix]: Fix ROCm fusion attn test; use AttentionBackend utils to create kv cache (#33948) · fd618871
  Rohan Potdar authored Feb 11, 2026
```
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
```
  fd618871
- [torch.compile] Stop doing unnecessary FakeTensorProp in PiecewiseCompileInterpreter (#34093) · e30cedd4
  Richard Zou authored Feb 10, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  e30cedd4
09 Feb, 2026 2 commits
- [torch.compile][Fusion] Fix attention fusion pass removing kv_udpate op. (#33945) · bb9f9730
  Charlie Fu authored Feb 09, 2026
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  bb9f9730
- [Kernel] FlashInfer: switch allreduce fusion to unified API (#33985) · d4f123cc
  Mohammad Miadh Angkad authored Feb 09, 2026
```
Signed-off-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
```
  d4f123cc
08 Feb, 2026 1 commit
- [Release 2.10] Update to Torch 2.10 - final release (#30525) · f97ca671
  Andrey Talman authored Feb 08, 2026
  
  f97ca671
07 Feb, 2026 2 commits
- [torch.compile] Stop compiling identical artifacts (#34003) · 81fe69ca
  Richard Zou authored Feb 07, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  81fe69ca
- [Bugfix] Fix QK Norm+RoPE fusion pattern matching on B200+FP8 (#33967) · 90607718
  Ikenna authored Feb 06, 2026
```
Signed-off-by: Ikenna <ikennachifo@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  90607718
06 Feb, 2026 1 commit

[torch.compile] Reorganize vllm/compilation and tests/compile (0/N for vLLM IR) (#33731) · ac32e66c

Luka Govedič authored Feb 06, 2026


Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: ProExpertProg <luka.govedic@gmail.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

ac32e66c

05 Feb, 2026 1 commit

[CI][torch.compile] Reduce e2e fusion test time (#33293) · 4d951353

Luka Govedič authored Feb 04, 2026


Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: ProExpertProg <luka.govedic@gmail.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

4d951353

04 Feb, 2026 2 commits
- Revert "[torch.compile] Significantly speed up cold start times" (#33820) · 9f14c922
  Richard Zou authored Feb 04, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  9f14c922
- [Bugfix] Support `RotaryEmbedding` CustomOp for gpt-oss (#33800) · 4292c90a
  Simon Danielsson authored Feb 04, 2026
```
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
```
  4292c90a
03 Feb, 2026 1 commit
- [torch.compile] Significantly speed up cold start times (#33641) · b1bb18de
  Richard Zou authored Feb 03, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  b1bb18de
31 Jan, 2026 2 commits

[fix][torch.compile] Fix cold-start compilation time increase by adding kv... · 15f40b20

Luka Govedič authored Jan 31, 2026


[fix][torch.compile] Fix cold-start compilation time increase by adding kv cache update to splitting ops (#33441)
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Richard Zou <zou3519@gmail.com>

15f40b20

[ez] Add structured torch.compile logs (#33213) · 608b5565
Angela Yi authored Jan 31, 2026
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
608b5565

28 Jan, 2026 2 commits

Use aiter triton fused_add_rmsnorm_pad for gpt-oss (#30976) · 59bcc5b6
Rohan Potdar authored Jan 28, 2026
```
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
```
59bcc5b6

[Quantization][Deprecation] Remove Marlin 24 (#32688) · af9b69f9

Robert Shaw authored Jan 28, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

af9b69f9

27 Jan, 2026 1 commit
- [5/N][Attention] Finish eliminating `vllm/attention` folder (#32064) · a608b4c6
  Matthew Bonanni authored Jan 27, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  a608b4c6
23 Jan, 2026 3 commits

[torch.compile][CI] Add back attn fusion on hopper/ada (#32940) · bbbd696a
Luka Govedič authored Jan 23, 2026
```
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
```
bbbd696a
[Bugfix] Disable tma_aligned_scales in test_fusions_e2e (#32916) · 90c20079
Xin Yang authored Jan 23, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
90c20079

[torch.compile] Compile `CustomOp.forward_native` for `SiluAndMul` and... · 5e4e0e51

Luka Govedič authored Jan 22, 2026


[torch.compile] Compile `CustomOp.forward_native` for `SiluAndMul` and `QuantFP8` to avoid raw torch ops inside opaque custom ops (#32806)
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

5e4e0e51

22 Jan, 2026 1 commit
- [Misc][BE] Turn on strict type coverage for vllm/compilation (#31756) · 15e302df
  Lucas Kabela authored Jan 22, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  15e302df
21 Jan, 2026 1 commit
- [MoE Refactor] Oracle Select FP8+NVFP4 Kernels In Priority (#32414) · 42135d68
  Robert Shaw authored Jan 21, 2026
  
  42135d68
20 Jan, 2026 3 commits
- [Misc] Remove pad_for_cudagraphs from config (#30143) · 22613408
  Lucas Wilkinson authored Jan 20, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
```
  22613408
- [AOT compilation] support torch.compile inductor artifacts in VllmCompiledFunction (#25205) · 7c5dedc2
  dolpm authored Jan 20, 2026
```
Signed-off-by: dolpm <34420038+dolpm@users.noreply.github.com>
```
  7c5dedc2
- [Refactor] Make FP8 Linear Ops use kernel abstraction (#27814) · 148117ea
  vllmellm authored Jan 20, 2026
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  148117ea
16 Jan, 2026 1 commit
- [CI] Breakup h200 tests (#30499) · 14ce5242
  Lucas Wilkinson authored Jan 15, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  14ce5242