Commits · 74c583bc508c2dafb9e95bab3b635884e4a021f3 · OpenDAS / vllm_cscc

19 Jan, 2026 1 commit
- [Core] Whisper support `torch.compile` (#30385) · 74c583bc
  Nicolò Lucchesi authored Jan 19, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  74c583bc
15 Jan, 2026 1 commit
- [BugFix] Python file source reading can fail on UnicodeDecodeError (#32416) · bd292be0
  Richard Zou authored Jan 15, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  bd292be0
14 Jan, 2026 1 commit
- [misc] Remove is_torch_equal_or_newer(2.4) cases (#32296) · 79336380
  Angela Yi authored Jan 13, 2026
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  79336380
13 Jan, 2026 1 commit
- [Misc] improve warning/assert messages (#32226) · 15b33ff0
  cjackal authored Jan 13, 2026
```
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
```
  15b33ff0
12 Jan, 2026 1 commit
- [Misc][BE] Type coverage for vllm/compilation [3/3] (#31748) · ad8818bb
  Lucas Kabela authored Jan 12, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  ad8818bb
11 Jan, 2026 1 commit
- make assume_32_bit_indexing configurable (#32044) · 46eb30f5
  Laith Sakka authored Jan 10, 2026
```
Signed-off-by: Laith Sakka <lsakka@meta.com>
```
  46eb30f5
10 Jan, 2026 1 commit

[Bugfix] Narrow broad exceptions in compilation backends (#31616) · 4dc0d606

Kevin McKay authored Jan 09, 2026


Signed-off-by: c0de128 <kevin.mckay@outlook.com>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

4dc0d606

09 Jan, 2026 1 commit
- [Misc][BE] Type coverage for vllm/compilation [2/3] (#31744) · aaf4b70a
  Lucas Kabela authored Jan 09, 2026
  
  aaf4b70a
08 Jan, 2026 1 commit

fix(compile): apply partition wrapper when loading AOT cached functions (#31536) · 1f214290

DevByteAI authored Jan 08, 2026

Signed-off-by: Devbyteai <abud6673@gmail.com>
Signed-off-by: DevByteAI <161969603+devbyteai@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

1f214290

07 Jan, 2026 1 commit
- [Misc][BE] Type coverage for vllm/compilation [1/3] (#31554) · 873480d1
  Lucas Kabela authored Jan 06, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  873480d1
02 Jan, 2026 1 commit
- [BugFix] Support online dense model DP without overhead (#30739) · bd877162
  Nick Hill authored Jan 02, 2026
```
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: njhill <nickhill123@gmail.com>
```
  bd877162
25 Dec, 2025 1 commit

use the same stream for cuda graph catpure and replay for NCCL (#29207) · 030fc449

Amir Samani authored Dec 25, 2025


Signed-off-by: Amir Samani <asamani@nvidia.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

030fc449

23 Dec, 2025 1 commit
- [ROCm][FEAT] Support AITER RMSNorm quantization fusion pass (#26575) · f32cfd7d
  vllmellm authored Dec 23, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
```
  f32cfd7d
18 Dec, 2025 1 commit
- [Bugfix][torch2.10] Fix test_qwen2_5_vl_compilation with 2.10 RC (#30822) · 0db5439d
  Lucas Kabela authored Dec 18, 2025
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  0db5439d
17 Dec, 2025 2 commits
- [compile] Recompile graph module during Dynamo cache loading. (#30743) · 53cd7f86
  Zhengxu Chen authored Dec 17, 2025
```
Signed-off-by: Zhengxu Chen <zhxchen17@fb.com>
```
  53cd7f86
- [compile] Disable aot when eager backend is used. (#30810) · 177c391d
  Zhengxu Chen authored Dec 17, 2025
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  177c391d
14 Dec, 2025 3 commits
- [Bugfix] Fix fusion for VL models (#30244) · 994acec0
  ElizaWszola authored Dec 14, 2025
```
Signed-off-by: ElizaWszola <ewszola@redhat.com>
```
  994acec0
- [torch.compile] Add encoder tag for compilation (#30489) · 3224ea99
  Ilya Markov authored Dec 14, 2025
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
```
  3224ea99
- enable unbacked with aot_compile (#30462) · f569c654
  Laith Sakka authored Dec 14, 2025
```
Signed-off-by: Laith Sakka <lsakka@meta.com>
```
  f569c654
13 Dec, 2025 1 commit
- set assume_32bit_indexing and pass unbacked hints (#30459) · 763963aa
  Laith Sakka authored Dec 13, 2025
```
Signed-off-by: Laith Sakka <lsakka@meta.com>
```
  763963aa
12 Dec, 2025 1 commit
- [compile] Parse compile range cache keys as Range during cache loading. (#30516) · fe178710
  Zhengxu Chen authored Dec 11, 2025
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  fe178710
11 Dec, 2025 1 commit
- [compile] Stop one-off setting enable_aot_compile and use context manager instead. (#30503) · 92fea56f
  Zhengxu Chen authored Dec 11, 2025
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  92fea56f
09 Dec, 2025 2 commits

[Rocm][torch.compile] Adding layernorm + fp8 block quant and silu + fp8 block... · 3c680f4a

Charlie Fu authored Dec 09, 2025


[Rocm][torch.compile] Adding layernorm + fp8 block quant and silu + fp8 block quant for Aiter (#25693)
Signed-off-by: charlifu <charlifu@amd.com>
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Signed-off-by: Charlie Fu <Charlie.Fu@amd.com>
Co-authored-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: wuhuikx <hattie.wu@amd.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Gregory Shtrasberg <156009573+gshtras@users.noreply.github.com>

3c680f4a

[BugFix] Fix non detected failing tests (#30277) · 0b6a8a30
Ilya Markov authored Dec 09, 2025
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
```
0b6a8a30

08 Dec, 2025 3 commits
- Add evaluate_guards option to DynamicShapesConfig (#27432) · 87aee9ed
  Laith Sakka authored Dec 08, 2025
```
Signed-off-by: Laith Sakka <lsakka@meta.com>
```
  87aee9ed
- [ROCm] Guard group quant RMS norm fusion patterns (#30239) · eb1051fb
  Ye (Charlotte) Qi authored Dec 08, 2025
  
  eb1051fb
- [Bugfix] fix fuse_allreduce_rms when tp =1 (#30178) · d1432712
  Jiangyun Zhu authored Dec 08, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  d1432712
07 Dec, 2025 1 commit

[Performance] Fused blockwise quant RMS norm (#27883) · af0444bf

ElizaWszola authored Dec 07, 2025


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>

af0444bf

05 Dec, 2025 4 commits

[Compile] Conditional compilation. Introduce compile_ranges (#24252) · 4e26d3b0

Ilya Markov authored Dec 05, 2025


Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Signed-off-by: Luka Govedič <luka.govedic@gmail.com>
Signed-off-by: ProExpertProg <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Luka Govedič <luka.govedic@gmail.com>

4e26d3b0

[bugfix] Pass globals to aot_compiled function (#29428) · e7296b08
Angela Yi authored Dec 05, 2025
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
e7296b08

[Feature] Add Layer-wise NVTX Support (#29990) · c2894d38

Max Hu authored Dec 05, 2025


Signed-off-by: Max Hu <hyoung2991@gmail.com>
Signed-off-by: Max Hu <maxhu@nvidia.com>
Co-authored-by: Max Hu <maxhu@nvidia.com>

c2894d38

Do not guard during noop elimination pass (#30095) · 5867819e
Laith Sakka authored Dec 04, 2025
```
Signed-off-by: Laith Sakka <lsakka@meta.com>
```
5867819e

04 Dec, 2025 1 commit
- [aot_compile]change VLLM backend to read fake args from example_value (#29104) · 1f0d1845
  Laith Sakka authored Dec 04, 2025
```
Signed-off-by: Laith Sakka <lsakka@meta.com>
```
  1f0d1845
03 Dec, 2025 4 commits

[Bugfix] Fix flashinfer ar+norm kernel not available issue (#29960) · afe9eb40
elvischenv authored Dec 04, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
afe9eb40
Add logging for cudagraph related info (#29825) · 69520bc6
Yong Hoon Shin authored Dec 02, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
69520bc6

[Bugfix] Defunctionalize TRTLLM AR+Norm op for avoiding extra clone kernel before it (#29631) · c719c405

elvischenv authored Dec 03, 2025

Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

c719c405

[Core] Rename PassConfig flags as per RFC #27995 (#29646) · d7284a26

Arpit Khandelwal authored Dec 02, 2025


Signed-off-by: arpitkh101 <arpit5khandelwal@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

d7284a26

28 Nov, 2025 1 commit
- [Doc]: fixing typos in multiple files. (#29685) · fae69430
  Didier Durand authored Nov 28, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  fae69430
26 Nov, 2025 2 commits

[Attention] Remove imports from `vllm/attention/__init__.py` (#29342) · 430dd4d9
Matthew Bonanni authored Nov 26, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
430dd4d9

[Misc] Add backup hash algorithm for FIPS constrained environments (#28795) · 56531b79

George D. Torres authored Nov 25, 2025


Signed-off-by: George D. Torres <gdavtor@gmail.com>
Signed-off-by: George D. Torres <41129492+geodavic@users.noreply.github.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>

56531b79