Commits · 5eac9a1b341b93478d0d0d57239c92edd18ad19e · OpenDAS / vllm_cscc

03 Feb, 2026 1 commit

[torch.compile] Don't do the fast moe cold start optimization if there is... · 5eac9a1b

Richard Zou authored Feb 02, 2026


[torch.compile] Don't do the fast moe cold start optimization if there is speculative decoding (#33624)
Signed-off-by: Richard Zou <zou3519@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

5eac9a1b

31 Jan, 2026 1 commit

[fix][torch.compile] Fix cold-start compilation time increase by adding kv... · 15f40b20

Luka Govedič authored Jan 31, 2026


[fix][torch.compile] Fix cold-start compilation time increase by adding kv cache update to splitting ops (#33441)
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Richard Zou <zou3519@gmail.com>

15f40b20

29 Jan, 2026 1 commit
- Make `mypy` opt-out instead of opt-in (#33205) · fb946a7f
  Harry Mellor authored Jan 29, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  fb946a7f
28 Jan, 2026 3 commits
- [ez] Remove checks for torch version <= 2.8 (#33209) · 4197168e
  Angela Yi authored Jan 28, 2026
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  4197168e
- Use aiter triton fused_add_rmsnorm_pad for gpt-oss (#30976) · 59bcc5b6
  Rohan Potdar authored Jan 28, 2026
```
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
```
  59bcc5b6
- [CI] Enable mypy import following for `vllm/compilation` (#33199) · f1acbd68
  Harry Mellor authored Jan 28, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  f1acbd68
27 Jan, 2026 2 commits
- [torch.compile] Speed up MOE handling in forward_context (#33184) · d9aa39a3
  Richard Zou authored Jan 27, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  d9aa39a3
- [torch.compile] Stop assuming 32 bit indexing (#33113) · 3b8f0fe5
  Richard Zou authored Jan 26, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  3b8f0fe5
21 Jan, 2026 2 commits
- [PluggableLayer][1/N] Define PluggableLayer (Fix ci) (#32744) · 1861ae8a
  whx authored Jan 22, 2026
```
Signed-off-by: whx-sjtu <2952154980@qq.com>
```
  1861ae8a
- [ROCm][Deepseekv3.2] Refactor Sparse Indexer as CustomOp (#29287) · 6c20e89c
  Pleaplusone authored Jan 21, 2026
```
Signed-off-by: ganyi <ygan@amd.com>
```
  6c20e89c
20 Jan, 2026 1 commit

[Misc] Remove pad_for_cudagraphs from config (#30143) · 22613408

Lucas Wilkinson authored Jan 20, 2026


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

22613408

14 Jan, 2026 1 commit
- [compile] raise on compile_size implicit padding (#32343) · 8471b27d
  dolpm authored Jan 14, 2026
```
Signed-off-by: dolpm <34420038+dolpm@users.noreply.github.com>
```
  8471b27d
13 Jan, 2026 1 commit
- [Misc] improve warning/assert messages (#32226) · 15b33ff0
  cjackal authored Jan 13, 2026
```
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
```
  15b33ff0
11 Jan, 2026 1 commit
- make assume_32_bit_indexing configurable (#32044) · 46eb30f5
  Laith Sakka authored Jan 10, 2026
```
Signed-off-by: Laith Sakka <lsakka@meta.com>
```
  46eb30f5
10 Jan, 2026 1 commit
- [Misc][LLaMa4] Compile LLaMa Vision Encoder (#30709) · ea6d067a
  Lucas Kabela authored Jan 09, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  ea6d067a
09 Jan, 2026 2 commits
- [Misc][BE] Type coverage for vllm/compilation [2/3] (#31744) · aaf4b70a
  Lucas Kabela authored Jan 09, 2026
  
  aaf4b70a
- [Doc] Add developer guide for CustomOp (#30886) · 08d954f0
  Shanshan Shen authored Jan 10, 2026
```
Signed-off-by: shen-shanshan <467638484@qq.com>
```
  08d954f0
06 Jan, 2026 1 commit

[Docs] Improve malformed exception caused by backslash line continuations (#31694) · d386ab14

maang authored Jan 06, 2026


Signed-off-by: maang <maang_h@163.com>
Signed-off-by: maang <55082429+maang-h@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

d386ab14

18 Dec, 2025 3 commits

Remove all2all backend envvar (#30363) · 41b6f920

Elizabeth Thomas authored Dec 18, 2025

Signed-off-by: Elizabeth Thomas <email2eliza@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

41b6f920

[BugFix] Partial revert of #29558 (DeepEP HT + PIECEWISE CG support) (#30910) · 30bb19a7

Lucas Wilkinson authored Dec 18, 2025

Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

30bb19a7

[compile] Fix CI for test_gpt2_cache_hit (#30902) · 5f2f3fba
Zhengxu Chen authored Dec 17, 2025
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
5f2f3fba

16 Dec, 2025 1 commit
- update piecewise cudagraph warning when splitting_ops=[] (#30728) · 104003dc
  Boyuan Feng authored Dec 16, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  104003dc
15 Dec, 2025 2 commits
- [Bugfix] Fail instead of ignoring when CompilationConfig gets invalid args (#30708) · a450c64a
  Michael Goin authored Dec 15, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  a450c64a
- [Log] Skip piecewise cudagraph warn when using full cudagraph (#30657) · 917fdae5
  Boyuan Feng authored Dec 14, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  917fdae5
11 Dec, 2025 1 commit
- [Deprecation] Remove deprecated plugin and compilation fields for v0.13 release (#30396) · 5a87d8b9
  Cyrus Leung authored Dec 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5a87d8b9
08 Dec, 2025 1 commit
- Add evaluate_guards option to DynamicShapesConfig (#27432) · 87aee9ed
  Laith Sakka authored Dec 08, 2025
```
Signed-off-by: Laith Sakka <lsakka@meta.com>
```
  87aee9ed
07 Dec, 2025 1 commit
- [Perf] Enable cuda graph for deepepHT, 5.3% throughput improvement, 4.4% TTFT improvement (#29558) · 17eb25e3
  Wentao Ye authored Dec 06, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  17eb25e3
05 Dec, 2025 1 commit

[Compile] Conditional compilation. Introduce compile_ranges (#24252) · 4e26d3b0

Ilya Markov authored Dec 05, 2025


Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Signed-off-by: Luka Govedič <luka.govedic@gmail.com>
Signed-off-by: ProExpertProg <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Luka Govedič <luka.govedic@gmail.com>

4e26d3b0

04 Dec, 2025 1 commit
- [Core] Remove forced None assignment for deprecated PassConfig flags (#29994) · dfdda967
  Arpit Khandelwal authored Dec 04, 2025
```
Signed-off-by: arpitkh101 <arpit5khandelwal@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  dfdda967
03 Dec, 2025 1 commit

[Core] Rename PassConfig flags as per RFC #27995 (#29646) · d7284a26

Arpit Khandelwal authored Dec 02, 2025


Signed-off-by: arpitkh101 <arpit5khandelwal@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

d7284a26

01 Dec, 2025 1 commit
- [Ascend]: Fixed the issue where OOT Platform vllm-ascend could not enable SP in Eager mode (#28935) · eaf81485
  Nengjun Ma authored Dec 02, 2025
```
Signed-off-by: leo-pony <nengjunma@outlook.com>
```
  eaf81485
27 Nov, 2025 1 commit

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): Set up -O infrastructure (#26847) · 0838b52e

Morrison Turnansky authored Nov 27, 2025


Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: adabeyta <aabeyta@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Co-authored-by: adabeyta <aabeyta@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

0838b52e

25 Nov, 2025 2 commits

Scheduled removal of `CompilationConfig.use_inductor` (#29323) · 51fc9e01
Harry Mellor authored Nov 25, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
51fc9e01

Allow oot custom compiler extension via CompilerInterface (#28623) · 888152bf

Icey authored Nov 25, 2025


Signed-off-by: wxsIcey <1790571317@qq.com>
Signed-off-by: Mengqing Cao <cmq0113@163.com>
Signed-off-by: Icey <1790571317@qq.com>
Co-authored-by: Mengqing Cao <cmq0113@163.com>

888152bf

24 Nov, 2025 1 commit

Add option to use unbacked, and backed size obl dynamic shapes for more sounds... · 7a228b53

Laith Sakka authored Nov 24, 2025


Add option to use unbacked, and backed size obl dynamic shapes for more sounds compilation. (#26199)
Signed-off-by: Laith Sakka <lsakka@meta.com>

7a228b53

22 Nov, 2025 1 commit
- [BugFix] Fix Eagle `IndexError: list index out of range` for even `num_speculative_tokens` (#29102) · 30d64662
  Lucas Wilkinson authored Nov 21, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  30d64662
21 Nov, 2025 1 commit
- [BugFix] skip combo kernel on cpu (#29129) · 8c25f9cf
  Boyuan Feng authored Nov 20, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  8c25f9cf
19 Nov, 2025 2 commits

[BugFix] Fix false assertion with spec-decode=[2,4,..] and TP>2 (#29036) · 8f4f77a7
Lucas Wilkinson authored Nov 19, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
8f4f77a7

[torch.compile] caching of config fields should be opt-out by default (#26468) · 1ffe934c

vnadathur authored Nov 19, 2025

Signed-off-by: vnadathur <glvikramn@gmail.com>
Signed-off-by: WorldExplored <srreyansh.sethi@gmail.com>
Signed-off-by: Srreyansh Sethi <srreyansh.sethi@gmail.com>
Signed-off-by: Srreyansh Sethi <107075589+WorldExplored@users.noreply.github.com>
Co-authored-by: WorldExplored <srreyansh.sethi@gmail.com>
Co-authored-by: Srreyansh Sethi <107075589+worldexplored@users.noreply.github.com>
Co-authored-by: vnadathur <236933696+vnadathur@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

1ffe934c

17 Nov, 2025 1 commit
- [BugFix] Temporary fix for IMA with MTP = 2 and full-cg (#28315) · 64e39d66
  Lucas Wilkinson authored Nov 17, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  64e39d66