---
id: pr-flash-attention-2178
repo: Dao-AILab/flash-attention
pr: 2178
title: ' [AMD] Triton Backend for ROCm #3'
author: micmelesse
date: '2026-01-28'
url: https://github.com/Dao-AILab/flash-attention/pull/2178
source_category: upstream-code
architectures:
- sm90
tags:
- attention
- attention kernel
- benchmark kernel
- fp8
- hopper
- triton kernel
techniques: []
hardware_features:
- fp8
- hopper
kernel_types:
- attention
languages:
- cuda-cpp
- triton
captured_at: '2026-05-16'
status: merged
merge_sha: 701ebe05783a3f83041a3f4604de083a328b20c1
inclusion_reason: Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.
changed_paths:
- README.md
- flash_attn/flash_attn_interface.py
- flash_attn/flash_attn_triton_amd/Dockerfile
- flash_attn/flash_attn_triton_amd/README.md
- flash_attn/flash_attn_triton_amd/__init__.py
- flash_attn/flash_attn_triton_amd/bench.py
- flash_attn/flash_attn_triton_amd/bwd.py
- flash_attn/flash_attn_triton_amd/bwd_prefill.py
- flash_attn/flash_attn_triton_amd/bwd_prefill_fused.py
- flash_attn/flash_attn_triton_amd/bwd_prefill_onekernel.py
- flash_attn/flash_attn_triton_amd/bwd_prefill_split.py
- flash_attn/flash_attn_triton_amd/bwd_ref.py
- flash_attn/flash_attn_triton_amd/common.py
- flash_attn/flash_attn_triton_amd/fp8.py
- flash_attn/flash_attn_triton_amd/fwd_decode.py
- flash_attn/flash_attn_triton_amd/fwd_prefill.py
- flash_attn/flash_attn_triton_amd/fwd_ref.py
- flash_attn/flash_attn_triton_amd/interface_fa.py
- flash_attn/flash_attn_triton_amd/interface_v2.py
- flash_attn/flash_attn_triton_amd/interface_v3.py
- flash_attn/flash_attn_triton_amd/pyproject.toml
- flash_attn/flash_attn_triton_amd/test.py
- flash_attn/flash_attn_triton_amd/train.py
- flash_attn/flash_attn_triton_amd/utils.py
- hopper/flash_attn_interface.py
- hopper/setup.py
- hopper/test_flash_attn_triton_amd.py
- tests/test_flash_attn_triton_amd.py
artifact_dir: evidence/pull-bundles/flash-attention/gh-2178
head_ref_oid: 82006063cb81e26b10169412807e426a91e551b5
---
#  [AMD] Triton Backend for ROCm #3

- Repository: `Dao-AILab/flash-attention`
- PR: [2178](https://github.com/Dao-AILab/flash-attention/pull/2178)
- Decision: `Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.`
- Reason: Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.

## Changed Paths

- `README.md`
- `flash_attn/flash_attn_interface.py`
- `flash_attn/flash_attn_triton_amd/Dockerfile`
- `flash_attn/flash_attn_triton_amd/README.md`
- `flash_attn/flash_attn_triton_amd/__init__.py`
- `flash_attn/flash_attn_triton_amd/bench.py`
- `flash_attn/flash_attn_triton_amd/bwd.py`
- `flash_attn/flash_attn_triton_amd/bwd_prefill.py`
- `flash_attn/flash_attn_triton_amd/bwd_prefill_fused.py`
- `flash_attn/flash_attn_triton_amd/bwd_prefill_onekernel.py`
- `flash_attn/flash_attn_triton_amd/bwd_prefill_split.py`
- `flash_attn/flash_attn_triton_amd/bwd_ref.py`
- `flash_attn/flash_attn_triton_amd/common.py`
- `flash_attn/flash_attn_triton_amd/fp8.py`
- `flash_attn/flash_attn_triton_amd/fwd_decode.py`
- `flash_attn/flash_attn_triton_amd/fwd_prefill.py`
- `flash_attn/flash_attn_triton_amd/fwd_ref.py`
- `flash_attn/flash_attn_triton_amd/interface_fa.py`
- `flash_attn/flash_attn_triton_amd/interface_v2.py`
- `flash_attn/flash_attn_triton_amd/interface_v3.py`
- `flash_attn/flash_attn_triton_amd/pyproject.toml`
- `flash_attn/flash_attn_triton_amd/test.py`
- `flash_attn/flash_attn_triton_amd/train.py`
- `flash_attn/flash_attn_triton_amd/utils.py`
- `hopper/flash_attn_interface.py`
- `hopper/setup.py`
- `hopper/test_flash_attn_triton_amd.py`
- `tests/test_flash_attn_triton_amd.py`

## Evidence Bundle

`evidence/pull-bundles/flash-attention/gh-2178`
