Commits · 5e4e0e51f4fbb6d6fbf7a94feef07bd3617bfa5f · OpenDAS / vllm_cscc

23 Jan, 2026 1 commit

[torch.compile] Compile `CustomOp.forward_native` for `SiluAndMul` and... · 5e4e0e51

Luka Govedič authored Jan 22, 2026


[torch.compile] Compile `CustomOp.forward_native` for `SiluAndMul` and `QuantFP8` to avoid raw torch ops inside opaque custom ops (#32806)
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

5e4e0e51

22 Jan, 2026 1 commit
- [Misc][BE] Turn on strict type coverage for vllm/compilation (#31756) · 15e302df
  Lucas Kabela authored Jan 22, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  15e302df
21 Jan, 2026 1 commit
- [MoE Refactor] Oracle Select FP8+NVFP4 Kernels In Priority (#32414) · 42135d68
  Robert Shaw authored Jan 21, 2026
  
  42135d68
20 Jan, 2026 2 commits
- [Misc] Remove pad_for_cudagraphs from config (#30143) · 22613408
  Lucas Wilkinson authored Jan 20, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
```
  22613408
- [AOT compilation] support torch.compile inductor artifacts in VllmCompiledFunction (#25205) · 7c5dedc2
  dolpm authored Jan 20, 2026
```
Signed-off-by: dolpm <34420038+dolpm@users.noreply.github.com>
```
  7c5dedc2
19 Jan, 2026 1 commit
- [Core] Whisper support `torch.compile` (#30385) · 74c583bc
  Nicolò Lucchesi authored Jan 19, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  74c583bc
15 Jan, 2026 1 commit
- [BugFix] Python file source reading can fail on UnicodeDecodeError (#32416) · bd292be0
  Richard Zou authored Jan 15, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  bd292be0
14 Jan, 2026 1 commit
- [misc] Remove is_torch_equal_or_newer(2.4) cases (#32296) · 79336380
  Angela Yi authored Jan 13, 2026
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  79336380
13 Jan, 2026 1 commit
- [Misc] improve warning/assert messages (#32226) · 15b33ff0
  cjackal authored Jan 13, 2026
```
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
```
  15b33ff0
12 Jan, 2026 1 commit
- [Misc][BE] Type coverage for vllm/compilation [3/3] (#31748) · ad8818bb
  Lucas Kabela authored Jan 12, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  ad8818bb
11 Jan, 2026 1 commit
- make assume_32_bit_indexing configurable (#32044) · 46eb30f5
  Laith Sakka authored Jan 10, 2026
```
Signed-off-by: Laith Sakka <lsakka@meta.com>
```
  46eb30f5
10 Jan, 2026 1 commit

[Bugfix] Narrow broad exceptions in compilation backends (#31616) · 4dc0d606

Kevin McKay authored Jan 09, 2026


Signed-off-by: c0de128 <kevin.mckay@outlook.com>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

4dc0d606

09 Jan, 2026 1 commit
- [Misc][BE] Type coverage for vllm/compilation [2/3] (#31744) · aaf4b70a
  Lucas Kabela authored Jan 09, 2026
  
  aaf4b70a
08 Jan, 2026 1 commit

fix(compile): apply partition wrapper when loading AOT cached functions (#31536) · 1f214290

DevByteAI authored Jan 08, 2026

Signed-off-by: Devbyteai <abud6673@gmail.com>
Signed-off-by: DevByteAI <161969603+devbyteai@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

1f214290

07 Jan, 2026 1 commit
- [Misc][BE] Type coverage for vllm/compilation [1/3] (#31554) · 873480d1
  Lucas Kabela authored Jan 06, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  873480d1
02 Jan, 2026 1 commit
- [BugFix] Support online dense model DP without overhead (#30739) · bd877162
  Nick Hill authored Jan 02, 2026
```
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: njhill <nickhill123@gmail.com>
```
  bd877162
25 Dec, 2025 1 commit

use the same stream for cuda graph catpure and replay for NCCL (#29207) · 030fc449

Amir Samani authored Dec 25, 2025


Signed-off-by: Amir Samani <asamani@nvidia.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

030fc449

23 Dec, 2025 1 commit
- [ROCm][FEAT] Support AITER RMSNorm quantization fusion pass (#26575) · f32cfd7d
  vllmellm authored Dec 23, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
```
  f32cfd7d
18 Dec, 2025 1 commit
- [Bugfix][torch2.10] Fix test_qwen2_5_vl_compilation with 2.10 RC (#30822) · 0db5439d
  Lucas Kabela authored Dec 18, 2025
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  0db5439d
17 Dec, 2025 2 commits
- [compile] Recompile graph module during Dynamo cache loading. (#30743) · 53cd7f86
  Zhengxu Chen authored Dec 17, 2025
```
Signed-off-by: Zhengxu Chen <zhxchen17@fb.com>
```
  53cd7f86
- [compile] Disable aot when eager backend is used. (#30810) · 177c391d
  Zhengxu Chen authored Dec 17, 2025
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  177c391d
14 Dec, 2025 3 commits
- [Bugfix] Fix fusion for VL models (#30244) · 994acec0
  ElizaWszola authored Dec 14, 2025
```
Signed-off-by: ElizaWszola <ewszola@redhat.com>
```
  994acec0
- [torch.compile] Add encoder tag for compilation (#30489) · 3224ea99
  Ilya Markov authored Dec 14, 2025
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
```
  3224ea99
- enable unbacked with aot_compile (#30462) · f569c654
  Laith Sakka authored Dec 14, 2025
```
Signed-off-by: Laith Sakka <lsakka@meta.com>
```
  f569c654
13 Dec, 2025 1 commit
- set assume_32bit_indexing and pass unbacked hints (#30459) · 763963aa
  Laith Sakka authored Dec 13, 2025
```
Signed-off-by: Laith Sakka <lsakka@meta.com>
```
  763963aa
12 Dec, 2025 1 commit
- [compile] Parse compile range cache keys as Range during cache loading. (#30516) · fe178710
  Zhengxu Chen authored Dec 11, 2025
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  fe178710
11 Dec, 2025 1 commit
- [compile] Stop one-off setting enable_aot_compile and use context manager instead. (#30503) · 92fea56f
  Zhengxu Chen authored Dec 11, 2025
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  92fea56f
09 Dec, 2025 2 commits

[Rocm][torch.compile] Adding layernorm + fp8 block quant and silu + fp8 block... · 3c680f4a

Charlie Fu authored Dec 09, 2025


[Rocm][torch.compile] Adding layernorm + fp8 block quant and silu + fp8 block quant for Aiter (#25693)
Signed-off-by: charlifu <charlifu@amd.com>
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Signed-off-by: Charlie Fu <Charlie.Fu@amd.com>
Co-authored-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: wuhuikx <hattie.wu@amd.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Gregory Shtrasberg <156009573+gshtras@users.noreply.github.com>

3c680f4a

[BugFix] Fix non detected failing tests (#30277) · 0b6a8a30
Ilya Markov authored Dec 09, 2025
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
```
0b6a8a30

08 Dec, 2025 3 commits
- Add evaluate_guards option to DynamicShapesConfig (#27432) · 87aee9ed
  Laith Sakka authored Dec 08, 2025
```
Signed-off-by: Laith Sakka <lsakka@meta.com>
```
  87aee9ed
- [ROCm] Guard group quant RMS norm fusion patterns (#30239) · eb1051fb
  Ye (Charlotte) Qi authored Dec 08, 2025
  
  eb1051fb
- [Bugfix] fix fuse_allreduce_rms when tp =1 (#30178) · d1432712
  Jiangyun Zhu authored Dec 08, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  d1432712
07 Dec, 2025 1 commit

[Performance] Fused blockwise quant RMS norm (#27883) · af0444bf

ElizaWszola authored Dec 07, 2025


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>

af0444bf

05 Dec, 2025 4 commits

[Compile] Conditional compilation. Introduce compile_ranges (#24252) · 4e26d3b0

Ilya Markov authored Dec 05, 2025


Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Signed-off-by: Luka Govedič <luka.govedic@gmail.com>
Signed-off-by: ProExpertProg <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Luka Govedič <luka.govedic@gmail.com>

4e26d3b0

[bugfix] Pass globals to aot_compiled function (#29428) · e7296b08
Angela Yi authored Dec 05, 2025
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
e7296b08

[Feature] Add Layer-wise NVTX Support (#29990) · c2894d38

Max Hu authored Dec 05, 2025


Signed-off-by: Max Hu <hyoung2991@gmail.com>
Signed-off-by: Max Hu <maxhu@nvidia.com>
Co-authored-by: Max Hu <maxhu@nvidia.com>

c2894d38

Do not guard during noop elimination pass (#30095) · 5867819e
Laith Sakka authored Dec 04, 2025
```
Signed-off-by: Laith Sakka <lsakka@meta.com>
```
5867819e

04 Dec, 2025 1 commit
- [aot_compile]change VLLM backend to read fake args from example_value (#29104) · 1f0d1845
  Laith Sakka authored Dec 04, 2025
```
Signed-off-by: Laith Sakka <lsakka@meta.com>
```
  1f0d1845
03 Dec, 2025 2 commits
- [Bugfix] Fix flashinfer ar+norm kernel not available issue (#29960) · afe9eb40
  elvischenv authored Dec 04, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  afe9eb40
- Add logging for cudagraph related info (#29825) · 69520bc6
  Yong Hoon Shin authored Dec 02, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  69520bc6