---
id: pr-pytorch-122967
repo: pytorch/pytorch
pr: 122967
title: Fix performance regression and memory storage handling of Flash Attention on ROCM (#122857)
author: xinyazhang
date: '2024-04-02'
url: https://github.com/pytorch/pytorch/pull/122967
source_category: upstream-code
architectures:
- sm100
tags: []
techniques: []
hardware_features: []
kernel_types: []
languages: []
captured_at: '2026-05-16'
status: merged
merge_sha: bc9e23abb5b975b22685c80cc9aee3ffe8c63c84
inclusion_reason: defer
changed_paths:
- aten/src/ATen/native/transformers/hip/flash_attn/flash_api.hip
- cmake/External/aotriton.cmake
- test/test_transformers.py
artifact_dir: evidence/pull-bundles/pytorch/gh-122967
head_ref_oid: 1596a3331e892749c0eb37da9dd5f429808e6f35
---
# Fix performance regression and memory storage handling of Flash Attention on ROCM (#122857)

- Repository: `pytorch/pytorch`
- PR: [122967](https://github.com/pytorch/pytorch/pull/122967)
- Decision: `defer`
- Reason: defer

## Changed Paths

- `aten/src/ATen/native/transformers/hip/flash_attn/flash_api.hip`
- `cmake/External/aotriton.cmake`
- `test/test_transformers.py`

## Evidence Bundle

`evidence/pull-bundles/pytorch/gh-122967`
