---
id: pr-vllm-28479
repo: vllm-project/vllm
pr: 28479
title: '[Perf] Refactor cudagraph_support to enable full CUDA graphs for spec decoding with FlashInfer'
author: benchislett
date: '2025-11-12'
url: https://github.com/vllm-project/vllm/pull/28479
source_category: upstream-code
architectures:
- sm100
tags: []
techniques: []
hardware_features: []
kernel_types: []
languages: []
captured_at: '2026-05-16'
status: merged
merge_sha: 304419576ae9dc2ecaa28c4506d3870f7c68bd85
inclusion_reason: defer
changed_paths:
- docs/design/cuda_graphs.md
- vllm/attention/layers/chunked_local_attention.py
- vllm/v1/attention/backends/flash_attn.py
- vllm/v1/attention/backends/flashinfer.py
- vllm/v1/attention/backends/gdn_attn.py
- vllm/v1/attention/backends/mamba_attn.py
- vllm/v1/attention/backends/mla/cutlass_mla.py
- vllm/v1/attention/backends/mla/flashattn_mla.py
- vllm/v1/attention/backends/mla/flashinfer_mla.py
- vllm/v1/attention/backends/mla/flashmla.py
- vllm/v1/attention/backends/mla/flashmla_sparse.py
- vllm/v1/attention/backends/mla/indexer.py
- vllm/v1/attention/backends/mla/rocm_aiter_mla.py
- vllm/v1/attention/backends/rocm_aiter_fa.py
- vllm/v1/attention/backends/rocm_attn.py
- vllm/v1/attention/backends/triton_attn.py
- vllm/v1/attention/backends/utils.py
- vllm/v1/worker/gpu_model_runner.py
artifact_dir: evidence/pull-bundles/vllm/gh-28479
head_ref_oid: 1b28db4dc1e2ab46501fc17b296e498a63ed71d7
---
# [Perf] Refactor cudagraph_support to enable full CUDA graphs for spec decoding with FlashInfer

- Repository: `vllm-project/vllm`
- PR: [28479](https://github.com/vllm-project/vllm/pull/28479)
- Decision: `defer`
- Reason: defer

## Changed Paths

- `docs/design/cuda_graphs.md`
- `vllm/attention/layers/chunked_local_attention.py`
- `vllm/v1/attention/backends/flash_attn.py`
- `vllm/v1/attention/backends/flashinfer.py`
- `vllm/v1/attention/backends/gdn_attn.py`
- `vllm/v1/attention/backends/mamba_attn.py`
- `vllm/v1/attention/backends/mla/cutlass_mla.py`
- `vllm/v1/attention/backends/mla/flashattn_mla.py`
- `vllm/v1/attention/backends/mla/flashinfer_mla.py`
- `vllm/v1/attention/backends/mla/flashmla.py`
- `vllm/v1/attention/backends/mla/flashmla_sparse.py`
- `vllm/v1/attention/backends/mla/indexer.py`
- `vllm/v1/attention/backends/mla/rocm_aiter_mla.py`
- `vllm/v1/attention/backends/rocm_aiter_fa.py`
- `vllm/v1/attention/backends/rocm_attn.py`
- `vllm/v1/attention/backends/triton_attn.py`
- `vllm/v1/attention/backends/utils.py`
- `vllm/v1/worker/gpu_model_runner.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-28479`
