Commits · 2e0ad629b0422358d424e1fcfddeb22d102936e8 · OpenDAS / vllm_cscc

14 Nov, 2025 1 commit
- Avoid bytecode hook and simplify TorchCompileWrapperWithCustomDipatch (#25110) · 2e0ad629
  Laith Sakka authored Nov 14, 2025
```
Signed-off-by: Laith Sakka <lsakka@meta.com>
```
  2e0ad629
12 Nov, 2025 1 commit
- Remove deprecated fields from `CompilationConfig` (#27593) · a742134c
  Harry Mellor authored Nov 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a742134c
22 Oct, 2025 1 commit
- Remove last `level` references not removed in #26355 (#27260) · 8f18feb1
  Harry Mellor authored Oct 22, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8f18feb1
18 Oct, 2025 1 commit
- [Chore] Clean up pytorch helper functions in `vllm.utils` (#26908) · 6ac5e06f
  Isotr0py authored Oct 19, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: isotr0py <2037008807@qq.com>
```
  6ac5e06f
17 Oct, 2025 1 commit
- [torch.compile] fix simple inductor graph partition test (#27050) · 17c540a9
  Boyuan Feng authored Oct 16, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  17c540a9
16 Oct, 2025 1 commit
- [BugFix] Work around graph partition x torch.compile cache issue (#26956) · 9b6504c3
  Richard Zou authored Oct 15, 2025
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  9b6504c3
15 Oct, 2025 2 commits

[BugFix] Patch inductor memory plan logic (#26878) · f5743833

Boyuan Feng authored Oct 15, 2025

Signed-off-by: Boyuan Feng <boyuan@meta.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

f5743833

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change ... · 96b9aa5a

Morrison Turnansky authored Oct 14, 2025


[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change  compilation level to compilation mode, deprecation compilation level (#26355)
Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

96b9aa5a

14 Oct, 2025 1 commit
- [torch.compile] Fix tests for torch==2.9 inductor partition (#26116) · 2dcd12d3
  Luka Govedič authored Oct 14, 2025
```
Signed-off-by: ProExpertProg <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
```
  2dcd12d3
13 Oct, 2025 1 commit

[FrontEnd] UNREVERT CompilationConfig overhaul (#20283): deprecate... · e3fdb627

Morrison Turnansky authored Oct 13, 2025


[FrontEnd] UNREVERT CompilationConfig overhaul (#20283): deprecate use_inductor in favor of backend, simplify custom_ops  (#26502)
Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>

e3fdb627

12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
10 Oct, 2025 2 commits

[torch.compile] Make inductor partition rules respect splitting_ops #25691 (#25845) · cddce79f

baonudesifeizhai authored Oct 10, 2025

Signed-off-by: baonudesifeizhai <baonudesifeizhai@gmail.com>
Signed-off-by: baonudesifeizhai <85092850+baonudesifeizhai@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

cddce79f

fix test_simple_inductor_graph_partition (#26522) · b545a0b2
Boyuan Feng authored Oct 09, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
b545a0b2

09 Oct, 2025 1 commit

Revert #26113 "[Frontend] CompilationConfig overhaul (#20283): deprecate... · 5728da11

Jiangyun Zhu authored Oct 09, 2025


Revert  #26113 "[Frontend] CompilationConfig overhaul (#20283): deprecate use_inductor in favor of backend, simplify custom_ops" (#26472)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>

5728da11

07 Oct, 2025 2 commits

[Frontend] CompilationConfig overhaul (#20283): deprecate use_inductor in... · 0c824fc4

Morrison Turnansky authored Oct 07, 2025


[Frontend] CompilationConfig overhaul (#20283): deprecate use_inductor in favor of backend, simplify custom_ops (#26113)
Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>

0c824fc4

[V0 Deprecation] Remove `VLLM_USE_V1` from tests (#26341) · 1e4ecca1
Cyrus Leung authored Oct 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
1e4ecca1

06 Oct, 2025 1 commit
- Fix per file ruff ignores related to line length (#26262) · 6c046382
  Harry Mellor authored Oct 06, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6c046382
05 Oct, 2025 1 commit
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
26 Sep, 2025 1 commit

[V1] address post issues related to #20059 (part 1) (#23046) · f075693d

fhl2000 authored Sep 27, 2025


Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

f075693d

25 Sep, 2025 1 commit
- [V0 deprecation] Remove _VLLM_V1 suffixes from attention backend names (#25489) · 3468f17e
  Matthew Bonanni authored Sep 25, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  3468f17e
22 Sep, 2025 1 commit

[CLI env var] Add VLLM_FLASH_ATTN_MAX_NUM_SPLITS_FOR_CUDA_GRAPH in env variables (#25274) · cfbee3d0

Daisy-Ma-coder authored Sep 22, 2025


Signed-off-by: qqma <qqma@amazon.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: qqma <qqma@amazon.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

cfbee3d0

20 Sep, 2025 1 commit

[torch.compile] CUDAGraph Inductor partition integration (#24281) · 8945b001

Boyuan Feng authored Sep 19, 2025


Signed-off-by: Boyuan Feng <boyuan@meta.com>
Signed-off-by: Boyuan Feng <fby.1994@gmail.com>
Signed-off-by: boyuanfeng <boyuan@meta.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

8945b001

09 Sep, 2025 1 commit
- [CI] execute all piecewise compilation tests together (#24502) · b8a93076
  Jiangyun Zhu authored Sep 10, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  b8a93076
08 Sep, 2025 1 commit

[Attention] FlashAttention MLA cudagraph support (#23958) · 620db1fc

Matthew Bonanni authored Sep 08, 2025


Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

620db1fc

03 Sep, 2025 1 commit
- fix some typos (#24071) · 1bd007f2
  co63oc authored Sep 03, 2025
```
Signed-off-by: co63oc <co63oc@users.noreply.github.com>
```
  1bd007f2
20 Aug, 2025 1 commit
- [torch.compile] Support conditional torch.compile per module (#22269) · dfd23820
  Yong Hoon Shin authored Aug 20, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  dfd23820
15 Aug, 2025 2 commits

[Core] Allow full cudagraph with separate attention routines and orthogonal to... · 74f441f4

fhl2000 authored Aug 15, 2025


[Core] Allow full cudagraph with separate attention routines and orthogonal to compilation, add support for FA2 and FlashInfer (#20059)
Signed-off-by: fhl <2410591650@qq.com>
Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>

74f441f4

[Feature] Full Cuda Graph Support for Cutlass MLA and 6% E2E Throughput Improvement (#22763) · 5c3fbfe4
Wentao Ye authored Aug 15, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
5c3fbfe4

23 Jul, 2025 1 commit
- Add test case for compiling multiple graphs (#21044) · 4ac7713e
  Yong Hoon Shin authored Jul 23, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  4ac7713e
17 Jun, 2025 1 commit
- [Feature][ROCm] Add full graph capture support for TritonAttentionBackend (#19158) · a44b1c95
  Charlie Fu authored Jun 17, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  a44b1c95
13 Jun, 2025 1 commit
- [CUDA] Enable full cudagraph for FlashMLA (#18581) · 3597b06a
  Luka Govedič authored Jun 13, 2025
```
Signed-off-by: luka <luka@neuralmagic.com>
```
  3597b06a
08 Jun, 2025 2 commits
- [Misc] Change tests/compile to use VLLM_V1 by default (#19302) · 3d64d366
  Richard Zou authored Jun 08, 2025
```
Signed-off-by: rzou <zou3519@gmail.com>
```
  3d64d366
- [Bugfix] Re-enable use_cudagraph in vLLM v1 (#19299) · eaa2e510
  Richard Zou authored Jun 07, 2025
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  eaa2e510
04 Jun, 2025 1 commit
- [Bugfix] Fix FA3 full cuda graph correctness (#19106) · b124e108
  Woosuk Kwon authored Jun 03, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  b124e108
03 Jun, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
29 May, 2025 1 commit
- Add ability to use CUDAGraphs with use_inductor=False (#17345) · 26b4fa45
  Richard Zou authored May 28, 2025
```
Signed-off-by: rzou <zou3519@gmail.com>
```
  26b4fa45
08 May, 2025 1 commit

[Core] Support full cuda graph in v1 (#16072) · 7ea2adb8

Chanh Nguyen authored May 07, 2025


Signed-off-by: Chanh Nguyen <cnguyen@linkedin.com>
Co-authored-by: Chanh Nguyen <cnguyen@linkedin.com>

7ea2adb8

27 Mar, 2025 1 commit
- Support FIPS enabled machines with MD5 hashing (#15299) · 7a6d45bc
  Matthew Vine authored Mar 26, 2025
```
Signed-off-by: Matthew Vine <32849887+MattTheCuber@users.noreply.github.com>
```
  7a6d45bc
03 Mar, 2025 1 commit
- Update deprecated Python 3.8 typing (#13971) · cf069aa8
  Harry Mellor authored Mar 03, 2025
  
  cf069aa8
06 Feb, 2025 1 commit
- [torch.compile] PyTorch 2.6 and nightly compatibility (#12393) · 09b95e36
  youkaichao authored Feb 07, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  09b95e36