Commits · 80118853f42a728805e6a861ffb50f3b876a9939 · OpenDAS / vllm_cscc

14 Apr, 2026 1 commit

[MM][Perf][CG] Support ViT full CUDA graph for Qwen3-VL video inference (#38061) · 80118853

Shanshan Shen authored Apr 14, 2026


Signed-off-by: shen-shanshan <467638484@qq.com>
Signed-off-by: Shanshan Shen <87969357+shen-shanshan@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

80118853

05 Apr, 2026 1 commit

[Bug] Fix Import paths for `encoder_cudagraph` modules (#38997) · 4dd49b06

Greg Pereira authored Apr 05, 2026

Signed-off-by: greg pereira <grpereir@redhat.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

4dd49b06

03 Apr, 2026 1 commit
- refactor hard coded device string in test files under tests/v1 and tests/lora (#37566) · 32e0c0bf
  wliao2 authored Apr 02, 2026
```
Signed-off-by: Liao, Wei <wei.liao@intel.com>
```
  32e0c0bf
26 Mar, 2026 1 commit

Relocate Encoder CUDA graph manager (#38116) · 144030c8

Woosuk Kwon authored Mar 25, 2026


Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

144030c8

23 Mar, 2026 1 commit
- [Feature] ViT Full CUDA Graph (#35963) · f85e479e
  Baorun (Lauren) Mu authored Mar 23, 2026
```
Signed-off-by: Baorun Mu <bmu@nvidia.com>
```
  f85e479e
27 Feb, 2026 1 commit
- [DP] Only use DP padding when cudagraphs are actually used (#34102) · 1d532f9d
  Lucas Wilkinson authored Feb 27, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  1d532f9d
11 Feb, 2026 1 commit
- Reapply [Attention][FA3] Update FA3 to include new swizzle optimization (#34043) · c7914d30
  Lucas Wilkinson authored Feb 11, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  c7914d30
02 Feb, 2026 1 commit

Reduce the kernel overhead when num of active loras is smaller than max... · ffe1fc7a

yugong333 authored Feb 02, 2026


  Reduce the kernel overhead when num of active loras is smaller than max loras. Multiple cuda graphs are captured for each num of active-loras. (#32005)
Signed-off-by: Yu Gong <yu3.gong@gmail.com>

ffe1fc7a

23 Jan, 2026 1 commit
- [cudagraphs] Refactor cudagraph capture loop (#32946) · 3a414595
  Lucas Wilkinson authored Jan 23, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  3a414595
20 Jan, 2026 1 commit

[Misc] Remove pad_for_cudagraphs from config (#30143) · 22613408

Lucas Wilkinson authored Jan 20, 2026


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

22613408

18 Dec, 2025 1 commit

Remove all2all backend envvar (#30363) · 41b6f920

Elizabeth Thomas authored Dec 18, 2025

Signed-off-by: Elizabeth Thomas <email2eliza@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

41b6f920

17 Dec, 2025 1 commit
- [Attention] Update tests to remove deprecated env vars (#30563) · 7eb6cb6c
  Matthew Bonanni authored Dec 17, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  7eb6cb6c
09 Dec, 2025 1 commit
- [BugFix] Fix `assert batch_descriptor.num_tokens == num_tokens_padded` (#30173) · 56037dfa
  Lucas Wilkinson authored Dec 09, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  56037dfa
02 Dec, 2025 2 commits
- [ROCm][CI] Fix test_cudagraph_mode.py Failure For AMD CI (#29808) · c014de1e
  Micah Williamson authored Dec 02, 2025
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
  c014de1e
- Remove default values from `InitVar`s so that they're not stored (#29859) · 951445a5
  Harry Mellor authored Dec 02, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  951445a5
27 Nov, 2025 1 commit

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): Set up -O infrastructure (#26847) · 0838b52e

Morrison Turnansky authored Nov 27, 2025


Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: adabeyta <aabeyta@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Co-authored-by: adabeyta <aabeyta@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

0838b52e

26 Nov, 2025 1 commit
- [Core] Refactor padding logic and pad for CUDA graphs before attention metadata building (#28579) · 56539cdd
  Lucas Wilkinson authored Nov 26, 2025
  
  56539cdd
25 Nov, 2025 1 commit
- [ROCm][CI] Fix test_cudagraph_mode failure in AMD CI (#29367) · ef1f7030
  Micah Williamson authored Nov 25, 2025
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
  ef1f7030
25 Oct, 2025 1 commit
- [CI] Add tests for cudagraph (#27391) · 29c9cb80
  Jiangyun Zhu authored Oct 25, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  29c9cb80
15 Oct, 2025 1 commit

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change ... · 96b9aa5a

Morrison Turnansky authored Oct 14, 2025


[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change  compilation level to compilation mode, deprecation compilation level (#26355)
Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

96b9aa5a

07 Oct, 2025 1 commit
- [V0 Deprecation] Remove `VLLM_USE_V1` from tests (#26341) · 1e4ecca1
  Cyrus Leung authored Oct 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1e4ecca1
05 Oct, 2025 1 commit
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
26 Sep, 2025 1 commit

[V1] address post issues related to #20059 (part 1) (#23046) · f075693d

fhl2000 authored Sep 27, 2025


Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

f075693d

25 Sep, 2025 1 commit
- [V0 deprecation] Remove _VLLM_V1 suffixes from attention backend names (#25489) · 3468f17e
  Matthew Bonanni authored Sep 25, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  3468f17e
22 Sep, 2025 1 commit

[CLI env var] Add VLLM_FLASH_ATTN_MAX_NUM_SPLITS_FOR_CUDA_GRAPH in env variables (#25274) · cfbee3d0

Daisy-Ma-coder authored Sep 22, 2025


Signed-off-by: qqma <qqma@amazon.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: qqma <qqma@amazon.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

cfbee3d0

08 Sep, 2025 1 commit

[Attention] FlashAttention MLA cudagraph support (#23958) · 620db1fc

Matthew Bonanni authored Sep 08, 2025


Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

620db1fc

15 Aug, 2025 1 commit

[Core] Allow full cudagraph with separate attention routines and orthogonal to... · 74f441f4

fhl2000 authored Aug 15, 2025


[Core] Allow full cudagraph with separate attention routines and orthogonal to compilation, add support for FA2 and FlashInfer (#20059)
Signed-off-by: fhl <2410591650@qq.com>
Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>

74f441f4