---
id: pr-vllm-18581
repo: vllm-project/vllm
pr: 18581
title: '[CUDA] Enable full cudagraph for FlashMLA'
author: ProExpertProg
date: '2025-06-13'
url: https://github.com/vllm-project/vllm/pull/18581
source_category: upstream-code
architectures:
- sm100
tags: []
techniques: []
hardware_features: []
kernel_types: []
languages: []
captured_at: '2026-05-16'
status: merged
merge_sha: 3597b06a4faafae96f9696e736ebc198520dc8ec
inclusion_reason: defer
changed_paths:
- tests/compile/piecewise/test_full_cudagraph.py
- tests/compile/piecewise/test_simple.py
- tests/compile/piecewise/test_toy_llama.py
- tests/utils.py
- vllm/compilation/cuda_piecewise_backend.py
- vllm/entrypoints/llm.py
- vllm/forward_context.py
- vllm/v1/attention/backends/cpu_attn.py
- vllm/v1/attention/backends/flash_attn.py
- vllm/v1/attention/backends/flashinfer.py
- vllm/v1/attention/backends/flex_attention.py
- vllm/v1/attention/backends/mla/common.py
- vllm/v1/attention/backends/mla/flashmla.py
- vllm/v1/attention/backends/mla/rocm_aiter_mla.py
- vllm/v1/attention/backends/utils.py
- vllm/v1/spec_decode/eagle.py
- vllm/v1/worker/gpu_model_runner.py
artifact_dir: evidence/pull-bundles/vllm/gh-18581
head_ref_oid: 78a88db9bdd5decd2d641b29c0ed206a4ba5fc35
---
# [CUDA] Enable full cudagraph for FlashMLA

- Repository: `vllm-project/vllm`
- PR: [18581](https://github.com/vllm-project/vllm/pull/18581)
- Decision: `defer`
- Reason: defer

## Changed Paths

- `tests/compile/piecewise/test_full_cudagraph.py`
- `tests/compile/piecewise/test_simple.py`
- `tests/compile/piecewise/test_toy_llama.py`
- `tests/utils.py`
- `vllm/compilation/cuda_piecewise_backend.py`
- `vllm/entrypoints/llm.py`
- `vllm/forward_context.py`
- `vllm/v1/attention/backends/cpu_attn.py`
- `vllm/v1/attention/backends/flash_attn.py`
- `vllm/v1/attention/backends/flashinfer.py`
- `vllm/v1/attention/backends/flex_attention.py`
- `vllm/v1/attention/backends/mla/common.py`
- `vllm/v1/attention/backends/mla/flashmla.py`
- `vllm/v1/attention/backends/mla/rocm_aiter_mla.py`
- `vllm/v1/attention/backends/utils.py`
- `vllm/v1/spec_decode/eagle.py`
- `vllm/v1/worker/gpu_model_runner.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-18581`
