---
id: pr-vllm-22668
repo: vllm-project/vllm
pr: 22668
title: '[Kernel] Add FP8 support with FlashMLA backend'
author: MatthewBonanni
date: '2025-08-22'
url: https://github.com/vllm-project/vllm/pull/22668
source_category: upstream-code
architectures:
- sm100
tags: []
techniques: []
hardware_features: []
kernel_types: []
languages: []
captured_at: '2026-05-16'
status: merged
merge_sha: 19fe1a0510852b5a892932653a5881e58e359660
inclusion_reason: defer
changed_paths:
- cmake/external_projects/flashmla.cmake
- csrc/cache.h
- csrc/cache_kernels.cu
- csrc/torch_bindings.cpp
- tests/kernels/attention/test_cache.py
- tests/kernels/attention/test_flashmla.py
- vllm/_custom_ops.py
- vllm/attention/backends/mla/common.py
- vllm/attention/ops/flashmla.py
- vllm/engine/arg_utils.py
- vllm/platforms/cuda.py
- vllm/platforms/interface.py
- vllm/platforms/rocm.py
- vllm/platforms/tpu.py
- vllm/v1/attention/backends/mla/common.py
- vllm/v1/attention/backends/mla/cutlass_mla.py
- vllm/v1/attention/backends/mla/flashmla.py
- vllm/v1/attention/backends/mla/rocm_aiter_mla.py
- vllm/v1/attention/backends/mla/triton_mla.py
artifact_dir: evidence/pull-bundles/vllm/gh-22668
head_ref_oid: f59cf508d5555d99435d6da8e0f1c8a53b7042da
---
# [Kernel] Add FP8 support with FlashMLA backend

- Repository: `vllm-project/vllm`
- PR: [22668](https://github.com/vllm-project/vllm/pull/22668)
- Decision: `defer`
- Reason: defer

## Changed Paths

- `cmake/external_projects/flashmla.cmake`
- `csrc/cache.h`
- `csrc/cache_kernels.cu`
- `csrc/torch_bindings.cpp`
- `tests/kernels/attention/test_cache.py`
- `tests/kernels/attention/test_flashmla.py`
- `vllm/_custom_ops.py`
- `vllm/attention/backends/mla/common.py`
- `vllm/attention/ops/flashmla.py`
- `vllm/engine/arg_utils.py`
- `vllm/platforms/cuda.py`
- `vllm/platforms/interface.py`
- `vllm/platforms/rocm.py`
- `vllm/platforms/tpu.py`
- `vllm/v1/attention/backends/mla/common.py`
- `vllm/v1/attention/backends/mla/cutlass_mla.py`
- `vllm/v1/attention/backends/mla/flashmla.py`
- `vllm/v1/attention/backends/mla/rocm_aiter_mla.py`
- `vllm/v1/attention/backends/mla/triton_mla.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-22668`
