Commits · 32e45636e3d7e02615facc8c63645ce4ac1d7e11 · OpenDAS / vllm_cscc

26 Apr, 2026 1 commit

[torch.compile]: Disable Sequence Parallelism (SP) for piecewise compilation (#38373) · 32e45636

Xinan Miao authored Apr 27, 2026

Signed-off-by: SouthWest7 <am1ao@qq.com>
Signed-off-by: Xinan Miao <1403572259@qq.com>
Co-authored-by: SouthWest7 <am1ao@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Wang Xingran <72983099+wangxingran222@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

32e45636

23 Apr, 2026 4 commits
- [Bugfix] Include inductor and functorch configs in compilation cache key (#40627) · 424033f4
  Richard Zou authored Apr 23, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  424033f4
- [Compilation] Refactor SiluMul activation+quant Fusion Pass (#39684) · 2196bac1
  BadrBasowid authored Apr 23, 2026
```
Signed-off-by: BadrBasowid <badr.basowid@gmail.com>
```
  2196bac1
- [compile] Skip FX graph deserialiaztion on loading, further reducing warm compile time. (#40151) · 98a242ff
  Zhengxu Chen authored Apr 23, 2026
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  98a242ff
- [BE] Fix compile time message to be consistent (use monitoring) (#40641) · 0283f303
  Lucas Kabela authored Apr 22, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  0283f303
22 Apr, 2026 2 commits

[Refactor] Clean up log once `scope="local"` (#40540) · 8f87eb46

Wentao Ye authored Apr 22, 2026

Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

8f87eb46

[compile] mla + group fp8 fusion (#38877) · 4506319a

Carl Y authored Apr 21, 2026


Signed-off-by: Carl You <4531192+carlyou@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

4506319a

20 Apr, 2026 4 commits
- [Core] Cache InductorPass.hash_source with functools.cache (#39328) · 87805fa1
  Frederik Gossen authored Apr 20, 2026
```
Signed-off-by: Frederik Gossen <frgossen@meta.com>
```
  87805fa1
- [Core] Pass donate_graph_module=True to standalone_compile (#39733) · 47fcb8ca
  Frederik Gossen authored Apr 20, 2026
```
Signed-off-by: Frederik Gossen <frgossen@meta.com>
```
  47fcb8ca
- [Core] Label torch trace logging overhead with dynamo_timed (#39329) · b9cf629b
  Frederik Gossen authored Apr 20, 2026
```
Signed-off-by: Frederik Gossen <frgossen@meta.com>
```
  b9cf629b
- [ROCm] Add MLA dual RMS norm fusion (Q, KV) pass for DeepSeek/Kimi-K2 (#39242) · fb5635d3
  Rita Brugarolas authored Apr 20, 2026
```
Signed-off-by: Rita Brugarolas Brufau <rita.brugarolasbrufau@amd.com>
```
  fb5635d3
16 Apr, 2026 1 commit
- [compile] Invoke split FX graph by codegen. (#38657) · 951dca80
  Zhengxu Chen authored Apr 16, 2026
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  951dca80
15 Apr, 2026 1 commit
- [BugFix][Graph] fix: handle empty sym_shape_indices in PiecewiseBackend. (#39395) · db8d4a4a
  Chauncey authored Apr 15, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  db8d4a4a
14 Apr, 2026 2 commits
- [compile] Nest inductor cache under AOT compile dir (#39718) · 2faad083
  Alessandro Sangiorgi authored Apr 14, 2026
```
Signed-off-by: Alessandro Sangiorgi <asangior@redhat.com>
```
  2faad083
- Measure encoder compile time seperate from llm backbone (#39240) · c08f3b2a
  Lucas Kabela authored Apr 14, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  c08f3b2a
13 Apr, 2026 1 commit

fused qknorm+rope kernel optimization for SM9.0 (#37376) · 4beeb068

Kaicheng Yang authored Apr 13, 2026


Signed-off-by: EricccYang <yangyang4991@gmail.com>
Signed-off-by: Kaicheng Yang <53411596+EricccYang@users.noreply.github.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>

4beeb068

12 Apr, 2026 1 commit
- [compile] Bug fix for _decompose_size_nodes (#38360) · f00c5539
  Animesh Jain authored Apr 12, 2026
```
Signed-off-by: Animesh Jain <anijain@umich.edu>
```
  f00c5539
10 Apr, 2026 2 commits
- [Kernel] Porting the TRTLLM minimax_allreduce_rms kernels (#37045) · ecd1ea13
  Jee Jee Li authored Apr 11, 2026
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  ecd1ea13
- [compile] Allow strings in custom ops without regressing compilation times (#38123) · f44afef6
  Richard Zou authored Apr 10, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  f44afef6
09 Apr, 2026 2 commits

[ROCm] Correctly guard fused_silu_mul_block_quant on ROCm (#39387) · d5f75fdf
Micah Williamson authored Apr 09, 2026
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
d5f75fdf

[W8A8 Block Linear Refactor][2/N] Remove W8A8Fp8BlockLinearOp and adopt Fp8... · 2e9034c9

Maral authored Apr 09, 2026


[W8A8 Block Linear Refactor][2/N] Remove W8A8Fp8BlockLinearOp and adopt Fp8 block linear kernel selections. (#33892)
Signed-off-by: maral <maralbahari.98@gmail.com>
Signed-off-by: Maral <maralbahari.98@gmail.com>

2e9034c9

08 Apr, 2026 3 commits
- [torch.compile] Allow usage of Opaque Objects in PyTorch 2.11 (#39286) · ba4a78eb
  Richard Zou authored Apr 09, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  ba4a78eb
- [ROCm] Enable fused_silu_mul_block_quant on ROCm (#38817) · 56c976c1
  Gregory Shtrasberg authored Apr 08, 2026
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  56c976c1
- [Core] Use tuple_return in split_module for tuple-conformant subgraphs (#38752) · d74a306c
  Frederik Gossen authored Apr 08, 2026
```
Signed-off-by: Frederik Gossen <frgossen@meta.com>
Co-authored-by: Boyuan Feng <boyuan@meta.com>
```
  d74a306c
07 Apr, 2026 1 commit

[vLLM IR] rework gemma_rms_norm (#39014) · 8060bb03

Jiangyun Zhu authored Apr 07, 2026


Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

8060bb03

06 Apr, 2026 1 commit
- [Core] Re-enable Inductor pre-grad passes in standalone compile (torch>=2.12) (#38944) · 608914de
  Frederik Gossen authored Apr 06, 2026
```
Signed-off-by: Frederik Gossen <frgossen@meta.com>
```
  608914de
03 Apr, 2026 1 commit

[mla] Support fused FP8/NVFP4 output quantization in MLA attention (#35792) (#36205) · 1f5ec288

Carl Y authored Apr 02, 2026

Signed-off-by: Carl You <4531192+carlyou@users.noreply.github.com>
Signed-off-by: Carl Y <4531192+carlyou@users.noreply.github.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

1f5ec288

02 Apr, 2026 2 commits
- Don't compile vision encoder for Transformers backend (#30518) · dfe5e316
  Harry Mellor authored Apr 02, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  dfe5e316
- Fix multiline-format string for python 3.10 (#38739) · 69444905
  Luka Govedič authored Apr 01, 2026
```
Signed-off-by: Luka Govedic <luka.govedic@gmail.com>
```
  69444905
01 Apr, 2026 2 commits

Feature/silu block quant fusion v1 (#32996) · c09ad767
Monishver authored Apr 01, 2026
```
Signed-off-by: Monishver Chandrasekaran <monishverchandrasekaran@gmail.com>
```
c09ad767

[vLLM IR] 1/N Implement IR skeleton and rms_norm op (#33825) · 40bb1750

Luka Govedič authored Mar 31, 2026


Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Xinyu Chen <xinyu1.chen@intel.com>
Signed-off-by: chzhang <chaojun.zhang@intel.com>
Signed-off-by: Luka Govedic <luka.govedic@gmail.com>
Co-authored-by: Xinyu Chen <xinyu1.chen@intel.com>
Co-authored-by: Chaojun Zhang <chaojun.zhang@intel.com>
Co-authored-by: Luka Govedič <ProExpertProg@h100-01.nemg-001.lab.rdu2.dc.redhat.com>

40bb1750

31 Mar, 2026 1 commit
- [torch.compile] Refactor Attention Quant Fusion Pass and Remove Boilerplate (#37373) · 077a9a8e
  BadrBasowid authored Apr 01, 2026
```
Signed-off-by: BadrBasowid <badr.basowid@gmail.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  077a9a8e
24 Mar, 2026 2 commits
- [BugFix] fix VLLM_USE_STANDALONE_COMPILE=0 (#38015) · 89f572db
  Richard Zou authored Mar 24, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  89f572db
- [BugFix] Fix order of compile logging (#38012) · 71a4a2fb
  Richard Zou authored Mar 24, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  71a4a2fb
23 Mar, 2026 1 commit
- Use lazy graph module during split_module to defer recompile() (#37609) · aceadb5e
  Angela Yi authored Mar 23, 2026
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  aceadb5e
21 Mar, 2026 2 commits
- [Perf] Add SM 10.3 (B300/GB300) all-reduce communicator tuning (#37756) · 61e381dc
  Mohammad Miadh Angkad authored Mar 22, 2026
```
Signed-off-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
```
  61e381dc
- Revert "[compile] Initialize passes at VllmBackend init" (#37733) · 1fa1e53a
  Simon Mo authored Mar 20, 2026
  
  1fa1e53a
20 Mar, 2026 3 commits
- [compile] Initialize passes at VllmBackend init (#35216) · 12fd17eb
  Angela Yi authored Mar 20, 2026
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  12fd17eb
- [compile] Add compiled artifact counter for VLLM_USE_MEGA_AOT_ARTIFACT=1. (#37589) · 2e089b96
  Zhengxu Chen authored Mar 20, 2026
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  2e089b96
- [compile] Fix aot test failures with torch 2.12. (#37604) · c0f5fae6
  Zhengxu Chen authored Mar 20, 2026
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  c0f5fae6