---
id: pr-flash-attention-1268
repo: Dao-AILab/flash-attention
pr: 1268
title: Paged Attention support for FA3
author: kadeng
date: '2024-11-10'
url: https://github.com/Dao-AILab/flash-attention/pull/1268
source_category: upstream-code
architectures:
- sm90
tags:
- FA3
- arch_pipeline
- attention_kv
- fp8
- hopper
- paged
techniques:
- async-copy
- pipeline-stages
hardware_features:
- fp8
- hopper
- tma
kernel_types:
- attention
- runtime
languages:
- cuda-cpp
captured_at: '2026-05-16'
status: merged
merge_sha: b443207c1fc4c98e4532aad4e88cfee1d590d996
inclusion_reason: Preserve page/KV/layout and plan-run contracts; profile memory traffic separately from math utilization.
changed_paths:
- hopper/copy_paged_sm90_tma.hpp
- hopper/flash.h
- hopper/flash_api.cpp
- hopper/flash_attn_interface.py
- hopper/flash_fwd_launch_template.h
- hopper/mainloop_fwd_sm90_tma_gmma_ws.hpp
- hopper/seq_len.h
- hopper/static_switch.h
- hopper/test_flash_attn.py
artifact_dir: evidence/pull-bundles/flash-attention/gh-1268
head_ref_oid: 66d43ccf7599035f022e1e71baf667ecf17e50e0
---
# Paged Attention support for FA3

- Repository: `Dao-AILab/flash-attention`
- PR: [1268](https://github.com/Dao-AILab/flash-attention/pull/1268)
- Decision: `Preserve page/KV/layout and plan-run contracts; profile memory traffic separately from math utilization.`
- Reason: Preserve page/KV/layout and plan-run contracts; profile memory traffic separately from math utilization.

## Changed Paths

- `hopper/copy_paged_sm90_tma.hpp`
- `hopper/flash.h`
- `hopper/flash_api.cpp`
- `hopper/flash_attn_interface.py`
- `hopper/flash_fwd_launch_template.h`
- `hopper/mainloop_fwd_sm90_tma_gmma_ws.hpp`
- `hopper/seq_len.h`
- `hopper/static_switch.h`
- `hopper/test_flash_attn.py`

## Evidence Bundle

`evidence/pull-bundles/flash-attention/gh-1268`
