---
id: pr-vllm-12639
repo: vllm-project/vllm
pr: 12639
title: '[Attention] MLA with chunked prefill'
author: LucasWilkinson
date: '2025-02-21'
url: https://github.com/vllm-project/vllm/pull/12639
source_category: upstream-code
architectures:
- sm100
tags:
- attention
- fp8
- mla
- prefill
- quantization
techniques: []
hardware_features:
- fp8
kernel_types:
- attention
- mla
- prefill
- quantization
languages:
- cuda-cpp
- triton
captured_at: '2026-04-27'
status: merged
merge_sha: 288cc6c234d0509e2caed574729b2829ed9921a1
inclusion_reason: kernel file changes
changed_paths:
- csrc/cache.h
- csrc/cache_kernels.cu
- csrc/core/math.hpp
- csrc/cuda_utils.h
- csrc/quantization/cutlass_w8a8/scaled_mm_c3x.cu
- csrc/torch_bindings.cpp
- tests/kernels/test_cache.py
- vllm/_custom_ops.py
- vllm/attention/__init__.py
- vllm/attention/backends/mla/common.py
- vllm/attention/backends/mla/utils.py
- vllm/attention/backends/triton_mla.py
- vllm/attention/ops/triton_merge_attn_states.py
- vllm/config.py
- vllm/engine/arg_utils.py
- vllm/model_executor/layers/quantization/utils/fp8_utils.py
- vllm/utils.py
- vllm/v1/attention/backends/flash_attn.py
head_ref_oid: 10c4e540b367c832147af9a5c715aab19d6ea339
artifact_dir: evidence/pull-bundles/vllm/gh-12639
---
# [Attention] MLA with chunked prefill

- Repository: `vllm-project/vllm`
- PR: [12639](https://github.com/vllm-project/vllm/pull/12639)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `csrc/cache.h`
- `csrc/cache_kernels.cu`
- `csrc/core/math.hpp`
- `csrc/cuda_utils.h`
- `csrc/quantization/cutlass_w8a8/scaled_mm_c3x.cu`
- `csrc/torch_bindings.cpp`
- `tests/kernels/test_cache.py`
- `vllm/_custom_ops.py`
- `vllm/attention/__init__.py`
- `vllm/attention/backends/mla/common.py`
- `vllm/attention/backends/mla/utils.py`
- `vllm/attention/backends/triton_mla.py`
- `vllm/attention/ops/triton_merge_attn_states.py`
- `vllm/config.py`
- `vllm/engine/arg_utils.py`
- `vllm/model_executor/layers/quantization/utils/fp8_utils.py`
- `vllm/utils.py`
- `vllm/v1/attention/backends/flash_attn.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-12639`
