---
id: pr-vllm-20059
repo: vllm-project/vllm
pr: 20059
title: '[Core] Allow full cudagraph with separate attention routines and orthogonal to compilation, add support for FA2 and FlashInfer'
author: fhl2000
date: '2025-08-15'
url: https://github.com/vllm-project/vllm/pull/20059
source_category: upstream-code
architectures:
- sm100
tags: []
techniques: []
hardware_features: []
kernel_types: []
languages: []
captured_at: '2026-05-16'
status: merged
merge_sha: 74f441f4b517a895ad12afd314a6f40caf657c4e
inclusion_reason: defer
changed_paths:
- tests/compile/piecewise/test_full_cudagraph.py
- tests/compile/piecewise/test_simple.py
- tests/compile/piecewise/test_toy_llama.py
- tests/v1/cudagraph/__init__.py
- tests/v1/cudagraph/test_cudagraph_dispatch.py
- tests/v1/cudagraph/test_cudagraph_mode.py
- vllm/compilation/backends.py
- vllm/compilation/base_piecewise_backend.py
- vllm/compilation/base_static_graph.py
- vllm/compilation/cuda_graph.py
- vllm/compilation/cuda_piecewise_backend.py
- vllm/compilation/monitor.py
- vllm/compilation/wrapper.py
- vllm/config/__init__.py
- vllm/config/compilation.py
- vllm/forward_context.py
- vllm/platforms/cuda.py
- vllm/platforms/interface.py
- vllm/platforms/rocm.py
- vllm/platforms/tpu.py
- vllm/platforms/xpu.py
- vllm/v1/attention/backends/flash_attn.py
- vllm/v1/attention/backends/flashinfer.py
- vllm/v1/attention/backends/mamba2_attn.py
- vllm/v1/attention/backends/mla/common.py
- vllm/v1/attention/backends/mla/cutlass_mla.py
- vllm/v1/attention/backends/mla/flashmla.py
- vllm/v1/attention/backends/mla/rocm_aiter_mla.py
- vllm/v1/attention/backends/rocm_aiter_fa.py
- vllm/v1/attention/backends/triton_attn.py
- vllm/v1/attention/backends/utils.py
- vllm/v1/cudagraph_dispatcher.py
- vllm/v1/worker/gpu_model_runner.py
- vllm/v1/worker/gpu_worker.py
artifact_dir: evidence/pull-bundles/vllm/gh-20059
head_ref_oid: f751e50b7a2aae3110d83ed0d88202fc91b3e78a
---
# [Core] Allow full cudagraph with separate attention routines and orthogonal to compilation, add support for FA2 and FlashInfer

- Repository: `vllm-project/vllm`
- PR: [20059](https://github.com/vllm-project/vllm/pull/20059)
- Decision: `defer`
- Reason: defer

## Changed Paths

- `tests/compile/piecewise/test_full_cudagraph.py`
- `tests/compile/piecewise/test_simple.py`
- `tests/compile/piecewise/test_toy_llama.py`
- `tests/v1/cudagraph/__init__.py`
- `tests/v1/cudagraph/test_cudagraph_dispatch.py`
- `tests/v1/cudagraph/test_cudagraph_mode.py`
- `vllm/compilation/backends.py`
- `vllm/compilation/base_piecewise_backend.py`
- `vllm/compilation/base_static_graph.py`
- `vllm/compilation/cuda_graph.py`
- `vllm/compilation/cuda_piecewise_backend.py`
- `vllm/compilation/monitor.py`
- `vllm/compilation/wrapper.py`
- `vllm/config/__init__.py`
- `vllm/config/compilation.py`
- `vllm/forward_context.py`
- `vllm/platforms/cuda.py`
- `vllm/platforms/interface.py`
- `vllm/platforms/rocm.py`
- `vllm/platforms/tpu.py`
- `vllm/platforms/xpu.py`
- `vllm/v1/attention/backends/flash_attn.py`
- `vllm/v1/attention/backends/flashinfer.py`
- `vllm/v1/attention/backends/mamba2_attn.py`
- `vllm/v1/attention/backends/mla/common.py`
- `vllm/v1/attention/backends/mla/cutlass_mla.py`
- `vllm/v1/attention/backends/mla/flashmla.py`
- `vllm/v1/attention/backends/mla/rocm_aiter_mla.py`
- `vllm/v1/attention/backends/rocm_aiter_fa.py`
- `vllm/v1/attention/backends/triton_attn.py`
- `vllm/v1/attention/backends/utils.py`
- `vllm/v1/cudagraph_dispatcher.py`
- `vllm/v1/worker/gpu_model_runner.py`
- `vllm/v1/worker/gpu_worker.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-20059`
