Commits · b1bb18de8d12cac63e3bbb0f59b3726fcb68dc80 · OpenDAS / vllm_cscc · GitLab

03 Feb, 2026 2 commits
- [torch.compile] Significantly speed up cold start times (#33641) · b1bb18de
  Richard Zou authored Feb 03, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  b1bb18de
- [torch.compile] Document the workaround to standalone_compile failing (#33571) · fd9c83d0
  Richard Zou authored Feb 02, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  fd9c83d0
31 Jan, 2026 2 commits

[fix][torch.compile] Fix cold-start compilation time increase by adding kv... · 15f40b20

Luka Govedič authored Jan 31, 2026


[fix][torch.compile] Fix cold-start compilation time increase by adding kv cache update to splitting ops (#33441)
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Richard Zou <zou3519@gmail.com>

15f40b20

[ez] Add structured torch.compile logs (#33213) · 608b5565
Angela Yi authored Jan 31, 2026
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
608b5565

29 Jan, 2026 2 commits
- [ez] Delete torch25_custom_graph_pass (#33287) · 5a66c9cc
  Angela Yi authored Jan 29, 2026
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  5a66c9cc
- [ez] Delete more torch version checks <= 2.8 (#33288) · 07ea184f
  Angela Yi authored Jan 28, 2026
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  07ea184f
28 Jan, 2026 4 commits
- [ez] Remove checks for torch version <= 2.8 (#33209) · 4197168e
  Angela Yi authored Jan 28, 2026
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  4197168e
- Use aiter triton fused_add_rmsnorm_pad for gpt-oss (#30976) · 59bcc5b6
  Rohan Potdar authored Jan 28, 2026
```
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
```
  59bcc5b6
- [CI] Enable mypy import following for `vllm/compilation` (#33199) · f1acbd68
  Harry Mellor authored Jan 28, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  f1acbd68
- Add flake8-implicit-str-concat rules to Ruff (#33191) · 2eb673a0
  Harry Mellor authored Jan 28, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2eb673a0
27 Jan, 2026 1 commit
- [5/N][Attention] Finish eliminating `vllm/attention` folder (#32064) · a608b4c6
  Matthew Bonanni authored Jan 27, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  a608b4c6
25 Jan, 2026 1 commit
- [Perf][Kernel] Optimize FP4 quantization kernels (SM100F) (#32520) · fcb9df99
  Roberto L. Castro authored Jan 25, 2026
```
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
```
  fcb9df99
23 Jan, 2026 1 commit

[torch.compile] Compile `CustomOp.forward_native` for `SiluAndMul` and... · 5e4e0e51

Luka Govedič authored Jan 22, 2026


[torch.compile] Compile `CustomOp.forward_native` for `SiluAndMul` and `QuantFP8` to avoid raw torch ops inside opaque custom ops (#32806)
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

5e4e0e51

22 Jan, 2026 1 commit
- [Misc][BE] Turn on strict type coverage for vllm/compilation (#31756) · 15e302df
  Lucas Kabela authored Jan 22, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  15e302df
21 Jan, 2026 1 commit
- [MoE Refactor] Oracle Select FP8+NVFP4 Kernels In Priority (#32414) · 42135d68
  Robert Shaw authored Jan 21, 2026
  
  42135d68
20 Jan, 2026 2 commits
- [Misc] Remove pad_for_cudagraphs from config (#30143) · 22613408
  Lucas Wilkinson authored Jan 20, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
```
  22613408
- [AOT compilation] support torch.compile inductor artifacts in VllmCompiledFunction (#25205) · 7c5dedc2
  dolpm authored Jan 20, 2026
```
Signed-off-by: dolpm <34420038+dolpm@users.noreply.github.com>
```
  7c5dedc2
19 Jan, 2026 1 commit
- [Core] Whisper support `torch.compile` (#30385) · 74c583bc
  Nicolò Lucchesi authored Jan 19, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  74c583bc
15 Jan, 2026 1 commit
- [BugFix] Python file source reading can fail on UnicodeDecodeError (#32416) · bd292be0
  Richard Zou authored Jan 15, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  bd292be0
14 Jan, 2026 1 commit
- [misc] Remove is_torch_equal_or_newer(2.4) cases (#32296) · 79336380
  Angela Yi authored Jan 13, 2026
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  79336380
13 Jan, 2026 1 commit
- [Misc] improve warning/assert messages (#32226) · 15b33ff0
  cjackal authored Jan 13, 2026
```
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
```
  15b33ff0
12 Jan, 2026 1 commit
- [Misc][BE] Type coverage for vllm/compilation [3/3] (#31748) · ad8818bb
  Lucas Kabela authored Jan 12, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  ad8818bb
11 Jan, 2026 1 commit
- make assume_32_bit_indexing configurable (#32044) · 46eb30f5
  Laith Sakka authored Jan 10, 2026
```
Signed-off-by: Laith Sakka <lsakka@meta.com>
```
  46eb30f5
10 Jan, 2026 1 commit

[Bugfix] Narrow broad exceptions in compilation backends (#31616) · 4dc0d606

Kevin McKay authored Jan 09, 2026


Signed-off-by: c0de128 <kevin.mckay@outlook.com>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

4dc0d606

09 Jan, 2026 1 commit
- [Misc][BE] Type coverage for vllm/compilation [2/3] (#31744) · aaf4b70a
  Lucas Kabela authored Jan 09, 2026
  
  aaf4b70a
08 Jan, 2026 1 commit

fix(compile): apply partition wrapper when loading AOT cached functions (#31536) · 1f214290

DevByteAI authored Jan 08, 2026

Signed-off-by: Devbyteai <abud6673@gmail.com>
Signed-off-by: DevByteAI <161969603+devbyteai@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

1f214290

07 Jan, 2026 1 commit
- [Misc][BE] Type coverage for vllm/compilation [1/3] (#31554) · 873480d1
  Lucas Kabela authored Jan 06, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  873480d1
02 Jan, 2026 1 commit
- [BugFix] Support online dense model DP without overhead (#30739) · bd877162
  Nick Hill authored Jan 02, 2026
```
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: njhill <nickhill123@gmail.com>
```
  bd877162
25 Dec, 2025 1 commit

use the same stream for cuda graph catpure and replay for NCCL (#29207) · 030fc449

Amir Samani authored Dec 25, 2025


Signed-off-by: Amir Samani <asamani@nvidia.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

030fc449

23 Dec, 2025 1 commit
- [ROCm][FEAT] Support AITER RMSNorm quantization fusion pass (#26575) · f32cfd7d
  vllmellm authored Dec 23, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
```
  f32cfd7d
18 Dec, 2025 1 commit
- [Bugfix][torch2.10] Fix test_qwen2_5_vl_compilation with 2.10 RC (#30822) · 0db5439d
  Lucas Kabela authored Dec 18, 2025
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  0db5439d
17 Dec, 2025 2 commits
- [compile] Recompile graph module during Dynamo cache loading. (#30743) · 53cd7f86
  Zhengxu Chen authored Dec 17, 2025
```
Signed-off-by: Zhengxu Chen <zhxchen17@fb.com>
```
  53cd7f86
- [compile] Disable aot when eager backend is used. (#30810) · 177c391d
  Zhengxu Chen authored Dec 17, 2025
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  177c391d
14 Dec, 2025 3 commits
- [Bugfix] Fix fusion for VL models (#30244) · 994acec0
  ElizaWszola authored Dec 14, 2025
```
Signed-off-by: ElizaWszola <ewszola@redhat.com>
```
  994acec0
- [torch.compile] Add encoder tag for compilation (#30489) · 3224ea99
  Ilya Markov authored Dec 14, 2025
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
```
  3224ea99
- enable unbacked with aot_compile (#30462) · f569c654
  Laith Sakka authored Dec 14, 2025
```
Signed-off-by: Laith Sakka <lsakka@meta.com>
```
  f569c654
13 Dec, 2025 1 commit
- set assume_32bit_indexing and pass unbacked hints (#30459) · 763963aa
  Laith Sakka authored Dec 13, 2025
```
Signed-off-by: Laith Sakka <lsakka@meta.com>
```
  763963aa
12 Dec, 2025 1 commit
- [compile] Parse compile range cache keys as Range during cache loading. (#30516) · fe178710
  Zhengxu Chen authored Dec 11, 2025
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  fe178710
11 Dec, 2025 1 commit
- [compile] Stop one-off setting enable_aot_compile and use context manager instead. (#30503) · 92fea56f
  Zhengxu Chen authored Dec 11, 2025
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  92fea56f
09 Dec, 2025 1 commit

[Rocm][torch.compile] Adding layernorm + fp8 block quant and silu + fp8 block... · 3c680f4a

Charlie Fu authored Dec 09, 2025


[Rocm][torch.compile] Adding layernorm + fp8 block quant and silu + fp8 block quant for Aiter (#25693)
Signed-off-by: charlifu <charlifu@amd.com>
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Signed-off-by: Charlie Fu <Charlie.Fu@amd.com>
Co-authored-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: wuhuikx <hattie.wu@amd.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Gregory Shtrasberg <156009573+gshtras@users.noreply.github.com>

3c680f4a