---
id: pr-flash-attention-2329
repo: Dao-AILab/flash-attention
pr: 2329
title: SM120 forward pass (Blackwell GeForce / DGX Spark)
author: blake-snc
date: '2026-03-12'
url: https://github.com/Dao-AILab/flash-attention/pull/2329
source_category: upstream-code
architectures:
- sm100
- sm90
tags:
- blackwell
- online-softmax
- sm80
- sm90
- tma
- wgmma
techniques:
- async-copy
hardware_features:
- blackwell
- hopper
- tma
- wgmma
kernel_types:
- attention
- softmax
languages:
- cute-dsl
captured_at: '2026-05-16'
status: merged
merge_sha: fb69aefd44684989ebb73fad3e36bf598574e25f
inclusion_reason: Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.
changed_paths:
- flash_attn/cute/flash_fwd.py
- flash_attn/cute/flash_fwd_sm120.py
- flash_attn/cute/interface.py
artifact_dir: evidence/pull-bundles/flash-attention/gh-2329
head_ref_oid: b6de3817a4bf8e8c5b4652fc9955d5eb697d7df4
---
# SM120 forward pass (Blackwell GeForce / DGX Spark)

- Repository: `Dao-AILab/flash-attention`
- PR: [2329](https://github.com/Dao-AILab/flash-attention/pull/2329)
- Decision: `Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.`
- Reason: Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.

## Changed Paths

- `flash_attn/cute/flash_fwd.py`
- `flash_attn/cute/flash_fwd_sm120.py`
- `flash_attn/cute/interface.py`

## Evidence Bundle

`evidence/pull-bundles/flash-attention/gh-2329`
