---
id: pr-vllm-14570
repo: vllm-project/vllm
pr: 14570
title: '[Attention] Flash Attention 3 - fp8'
author: mickaelseznec
date: '2025-03-20'
url: https://github.com/vllm-project/vllm/pull/14570
source_category: upstream-code
architectures:
- sm100
tags:
- attention
- fp8
- mla
- quantization
techniques: []
hardware_features:
- fp8
kernel_types:
- attention
- mla
- quantization
languages:
- cuda-cpp
captured_at: '2026-04-27'
status: merged
merge_sha: a597a57595b5b6bb5eca63ed510468a21e683cbd
inclusion_reason: kernel file changes
changed_paths:
- cmake/external_projects/vllm_flash_attn.cmake
- tests/kernels/test_flash_attn.py
- vllm/attention/__init__.py
- vllm/attention/backends/abstract.py
- vllm/attention/backends/flash_attn.py
- vllm/attention/backends/mla/common.py
- vllm/attention/backends/utils.py
- vllm/attention/layer.py
- vllm/envs.py
- vllm/fa_utils.py
- vllm/model_executor/layers/quantization/kv_cache.py
- vllm/platforms/cuda.py
- vllm/v1/attention/backends/flash_attn.py
- vllm/v1/executor/multiproc_executor.py
- vllm/v1/worker/gpu_model_runner.py
head_ref_oid: 5678b6dc2b5764ede9f90c33c0d72403e51768f8
artifact_dir: evidence/pull-bundles/vllm/gh-14570
---
# [Attention] Flash Attention 3 - fp8

- Repository: `vllm-project/vllm`
- PR: [14570](https://github.com/vllm-project/vllm/pull/14570)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `cmake/external_projects/vllm_flash_attn.cmake`
- `tests/kernels/test_flash_attn.py`
- `vllm/attention/__init__.py`
- `vllm/attention/backends/abstract.py`
- `vllm/attention/backends/flash_attn.py`
- `vllm/attention/backends/mla/common.py`
- `vllm/attention/backends/utils.py`
- `vllm/attention/layer.py`
- `vllm/envs.py`
- `vllm/fa_utils.py`
- `vllm/model_executor/layers/quantization/kv_cache.py`
- `vllm/platforms/cuda.py`
- `vllm/v1/attention/backends/flash_attn.py`
- `vllm/v1/executor/multiproc_executor.py`
- `vllm/v1/worker/gpu_model_runner.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-14570`
