Commits · 89f572dbc0bf18efaaec52b95119bf4c01330dfe · OpenDAS / vllm_cscc

24 Mar, 2026 2 commits
- [BugFix] fix VLLM_USE_STANDALONE_COMPILE=0 (#38015) · 89f572db
  Richard Zou authored Mar 24, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  89f572db
- [BugFix] Fix order of compile logging (#38012) · 71a4a2fb
  Richard Zou authored Mar 24, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  71a4a2fb
23 Mar, 2026 1 commit
- Use lazy graph module during split_module to defer recompile() (#37609) · aceadb5e
  Angela Yi authored Mar 23, 2026
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  aceadb5e
21 Mar, 2026 2 commits
- [Perf] Add SM 10.3 (B300/GB300) all-reduce communicator tuning (#37756) · 61e381dc
  Mohammad Miadh Angkad authored Mar 22, 2026
```
Signed-off-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
```
  61e381dc
- Revert "[compile] Initialize passes at VllmBackend init" (#37733) · 1fa1e53a
  Simon Mo authored Mar 20, 2026
  
  1fa1e53a
20 Mar, 2026 5 commits
- [compile] Initialize passes at VllmBackend init (#35216) · 12fd17eb
  Angela Yi authored Mar 20, 2026
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  12fd17eb
- [compile] Add compiled artifact counter for VLLM_USE_MEGA_AOT_ARTIFACT=1. (#37589) · 2e089b96
  Zhengxu Chen authored Mar 20, 2026
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  2e089b96
- [compile] Fix aot test failures with torch 2.12. (#37604) · c0f5fae6
  Zhengxu Chen authored Mar 20, 2026
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  c0f5fae6
- [Bug] Fix FlashInfer allreduce fusion workspace uninitialized error (#37461) · 0140eafb
  Wei Zhao authored Mar 20, 2026
```
Signed-off-by: root <root@prenyx0169.a51.clusters.nvidia.com>
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Signed-off-by: <>
Co-authored-by: root <root@prenyx0169.a51.clusters.nvidia.com>
Co-authored-by: root <root@prenyx0042.a51.clusters.nvidia.com>
```
  0140eafb
- [compile][graph_partition]Add tensor size handling (#36038) · ea2c148f
  Xiao authored Mar 19, 2026
```
Signed-off-by: Xiao Fu <xiaofu@meta.com>
```
  ea2c148f
19 Mar, 2026 2 commits
- [torch.compile][BE][Multimodal] Remove requirement to set_model_tag to avoid... · 7769b583
  Lucas Kabela authored Mar 19, 2026
```
[torch.compile][BE][Multimodal] Remove requirement to set_model_tag to avoid cache conflict (#37345)
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  7769b583
- [Perf] Fix slow hasattr in CUDAGraphWrapper.__getattr__ (#37425) · d3cc3795
  Ziming Huang authored Mar 19, 2026
```
Signed-off-by: 智鸣 <hzm414167@alibaba-inc.com>
```
  d3cc3795
18 Mar, 2026 1 commit
- [Log] Reduce duplicate log (#37313) · c373b5c0
  Wentao Ye authored Mar 18, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c373b5c0
17 Mar, 2026 2 commits

[Bugfix] Fix mock.patch resolution failure for... · 1204cf0a

Dimitrios Bariamis authored Mar 17, 2026


[Bugfix] Fix mock.patch resolution failure for standalone_compile.FakeTensorMode on Python <= 3.10 (#37158)
Signed-off-by: Dimitrios Bariamis <12195802+dbari@users.noreply.github.com>
Co-authored-by: Dimitrios Bariamis <12195802+dbari@users.noreply.github.com>

1204cf0a

[ROCm] Fix AttributeError for torch.compiler.skip_all_guards_unsafe on older PyTorch (#37219) · 54a62a79
Andreas Karatzas authored Mar 16, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
54a62a79

16 Mar, 2026 4 commits
- [Custom Ops] Add functional + out variant for scaled_fp4_quant (#34389) · 3e6a1e16
  Terry Gao authored Mar 16, 2026
```
Signed-off-by: tianrengao <terrygao87@gmail.com>
```
  3e6a1e16
- [compile] Enable mega aot artifact for torch 2.12+. (#37198) · e6ae4b1b
  Zhengxu Chen authored Mar 16, 2026
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  e6ae4b1b
- [torch.compile][BE] Modify cudagraph callable to check for is_forward_context_set (#36288) · 714c6e0e
  Lucas Kabela authored Mar 16, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  714c6e0e
- use skip_all_guards_unsafe to drop global_state and torch_function_mode_stack... · 52131f88
  Laith Sakka authored Mar 16, 2026
```
use skip_all_guards_unsafe to drop global_state and torch_function_mode_stack guards instead of previous hacks (#36204)
Signed-off-by: Laith Sakka <lsakka@meta.com>
```
  52131f88
11 Mar, 2026 3 commits
- [torch.compile] Use FakeTensors instead of real GPU tensors for single-size compilation (#36093) · 822e250a
  Richard Zou authored Mar 11, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  822e250a
- [compile] aot_compile should respect VLLM_DISABLE_COMPILE_CACHE (#36358) · 09b6f998
  Richard Zou authored Mar 11, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  09b6f998
- [Fix] Use torch.empty for output in attention+quant fusion (#31785) · 7d6abdd0
  elvischenv authored Mar 11, 2026
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  7d6abdd0
10 Mar, 2026 2 commits
- [compile] Apply stored functorch config while finalizing loaded artifacts. (#36582) · bdd8981d
  Zhengxu Chen authored Mar 10, 2026
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  bdd8981d
- [Bugfix] Avoid merging empty-only partitions into splitting-op subgraphs (#36595) · ca5fb4bb
  Jiangyun Zhu authored Mar 10, 2026
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  ca5fb4bb
09 Mar, 2026 3 commits

[BE] Rename `should_torch_compile_mm_vit` to `should_torch_compile_mm_encoder` (#36281) · 3fd03f1e
Lucas Kabela authored Mar 09, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
3fd03f1e

[torch.compile] Rename `compile_ranges_split_points` to `compile_ranges_endpoints` (#36027) · 4b87ffbe

Copilot authored Mar 09, 2026

Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ProExpertProg <11367180+ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

4b87ffbe

[cudagraph] fix cudagraph warning in deepseekv32 (#28044) · e5ff1402
Jiangyun Zhu authored Mar 09, 2026
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
e5ff1402

07 Mar, 2026 3 commits
- [compile] Split compile/warmup monitoring (#36098) · 2dde535d
  Richard Zou authored Mar 07, 2026
  
  2dde535d
- [Core] NGram GPU Implementation compatible with Async Scheduler (#29184) · a6be75db
  PatchyTIS authored Mar 08, 2026
  
  a6be75db
- [UX][Startup] Account for CUDA graphs during memory profiling (#30515) · ebb9cc5f
  Matthew Bonanni authored Mar 07, 2026
  
  ebb9cc5f
06 Mar, 2026 1 commit
- [compile] Stop unconditionally patching constrain_to_fx_strides (#36152) · 54756b61
  Richard Zou authored Mar 06, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  54756b61
05 Mar, 2026 3 commits
- [compile] Consistent compiler config for saved/loaded vllm backends. (#35810) · a97954b6
  Zhengxu Chen authored Mar 05, 2026
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  a97954b6
- [compile] Fix extra cache save on warm start. (#35921) · dd6dbd93
  Zhengxu Chen authored Mar 04, 2026
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  dd6dbd93
- [compile] Reduce log spam from compile. (#36044) · 2ed4722e
  Zhengxu Chen authored Mar 04, 2026
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  2ed4722e
04 Mar, 2026 2 commits

[torch.compile] Stop lazily compiling (#35472) · 5569f521
Richard Zou authored Mar 04, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
5569f521

[Hardware] Replace `torch.cuda.empty_cache` with `torch.accelerator.empty_cache` (#30681) · 16d2ad1d

Kunshang Ji authored Mar 04, 2026


Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

16d2ad1d

03 Mar, 2026 1 commit

[ROCm] [CI] Add new fusion test cases that are relevant to vLLM IR Ops (#34307) · fb7fdc49

TJian authored Mar 03, 2026


Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>

fb7fdc49

02 Mar, 2026 2 commits
- [torch.compile] Improve cold and warm start compile tests (#35709) · d1a6e96d
  Richard Zou authored Mar 02, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  d1a6e96d
- [Misc] Cleanup useless `current_platform` import (#35715) · 510bc9e1
  wangxiyuan authored Mar 02, 2026
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  510bc9e1
28 Feb, 2026 1 commit

[1/N] Elastic EP Milestone 2 (#34861) · dea26833

Itay Alroy authored Feb 28, 2026


Signed-off-by: Yongji Wu <wuyongji317@gmail.com>
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: Ron Tourgeman <rtourgeman@nvidia.com>
Co-authored-by: Yongji Wu <wuyongji317@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Ron Tourgeman <rtourgeman@nvidia.com>

dea26833