---
id: pr-flash-attention-1075
repo: Dao-AILab/flash-attention
pr: 1075
title: 'Changes For FP8 '
author: ganeshcolfax
date: '2024-07-23'
url: https://github.com/Dao-AILab/flash-attention/pull/1075
source_category: upstream-code
architectures:
- sm100
tags:
- fp8
techniques: []
hardware_features:
- fp8
kernel_types:
- attention
languages: []
captured_at: '2026-05-16'
status: merged
merge_sha: 1899c970c8639e82e6b8a78408f4041425e9f900
inclusion_reason: Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.
changed_paths:
- hopper/benchmark_flash_attention.py
- hopper/benchmark_flash_attention_fp8.py
- hopper/epilogue_fwd_sm90_tma.hpp
- hopper/flash_api.cpp
- hopper/flash_attn_interface.py
- hopper/flash_fwd_hdim128_fp8_sm90.cu
- hopper/flash_fwd_hdim256_fp8_sm90.cu
- hopper/flash_fwd_hdim64_fp8_sm90.cu
- hopper/flash_fwd_launch_template.h
- hopper/kernel_traits.h
- hopper/mainloop_fwd_sm90_tma_gmma_ws.hpp
- hopper/setup.py
- hopper/test_flash_attn.py
- hopper/utils.h
artifact_dir: evidence/pull-bundles/flash-attention/gh-1075
head_ref_oid: d5893f3c74ae53d0b42632fe5cfeb755d6bb0c7a
---
# Changes For FP8 

- Repository: `Dao-AILab/flash-attention`
- PR: [1075](https://github.com/Dao-AILab/flash-attention/pull/1075)
- Decision: `Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.`
- Reason: Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.

## Changed Paths

- `hopper/benchmark_flash_attention.py`
- `hopper/benchmark_flash_attention_fp8.py`
- `hopper/epilogue_fwd_sm90_tma.hpp`
- `hopper/flash_api.cpp`
- `hopper/flash_attn_interface.py`
- `hopper/flash_fwd_hdim128_fp8_sm90.cu`
- `hopper/flash_fwd_hdim256_fp8_sm90.cu`
- `hopper/flash_fwd_hdim64_fp8_sm90.cu`
- `hopper/flash_fwd_launch_template.h`
- `hopper/kernel_traits.h`
- `hopper/mainloop_fwd_sm90_tma_gmma_ws.hpp`
- `hopper/setup.py`
- `hopper/test_flash_attn.py`
- `hopper/utils.h`

## Evidence Bundle

`evidence/pull-bundles/flash-attention/gh-1075`
