---
id: pr-flash-attention-1010
repo: Dao-AILab/flash-attention
pr: 1010
title: Support AMD ROCm on FlashAttention 2
author: rocking5566
date: '2024-07-23'
url: https://github.com/Dao-AILab/flash-attention/pull/1010
source_category: upstream-code
architectures:
- sm100
tags:
- fmha
techniques: []
hardware_features: []
kernel_types:
- attention
languages: []
captured_at: '2026-05-16'
status: merged
merge_sha: d8f104e97aae2057842df765816cc1e273f0a380
inclusion_reason: Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.
changed_paths:
- .gitmodules
- README.md
- csrc/composable_kernel
- csrc/flash_attn_ck/flash_api.cpp
- csrc/flash_attn_ck/flash_common.hpp
- csrc/flash_attn_ck/mha_bwd.cpp
- csrc/flash_attn_ck/mha_fwd.cpp
- csrc/flash_attn_ck/mha_varlen_bwd.cpp
- csrc/flash_attn_ck/mha_varlen_fwd.cpp
- setup.py
- tests/test_flash_attn_ck.py
artifact_dir: evidence/pull-bundles/flash-attention/gh-1010
head_ref_oid: d83c4129a92e4258081f92dfafd34345b3b06130
---
# Support AMD ROCm on FlashAttention 2

- Repository: `Dao-AILab/flash-attention`
- PR: [1010](https://github.com/Dao-AILab/flash-attention/pull/1010)
- Decision: `Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.`
- Reason: Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.

## Changed Paths

- `.gitmodules`
- `README.md`
- `csrc/composable_kernel`
- `csrc/flash_attn_ck/flash_api.cpp`
- `csrc/flash_attn_ck/flash_common.hpp`
- `csrc/flash_attn_ck/mha_bwd.cpp`
- `csrc/flash_attn_ck/mha_fwd.cpp`
- `csrc/flash_attn_ck/mha_varlen_bwd.cpp`
- `csrc/flash_attn_ck/mha_varlen_fwd.cpp`
- `setup.py`
- `tests/test_flash_attn_ck.py`

## Evidence Bundle

`evidence/pull-bundles/flash-attention/gh-1010`
