---
id: pr-flash-attention-2098
repo: Dao-AILab/flash-attention
pr: 2098
title: Add pack-gqa fwd support for sparse impl w/ broadcasted H dim
author: drisspg
date: '2026-01-04'
url: https://github.com/Dao-AILab/flash-attention/pull/2098
source_category: upstream-code
architectures:
- sm100
tags:
- arch_pipeline
- attention_kv
- benchmark_test
- block sparse
- compiler_runtime
techniques:
- pipeline-stages
hardware_features:
- blackwell
kernel_types:
- attention
- compiler
- runtime
languages:
- cute-dsl
captured_at: '2026-05-16'
status: merged
merge_sha: 9b6dbaceb658f576ea81e2b0189f4b5707a39aae
inclusion_reason: Preserve page/KV/layout and plan-run contracts; profile memory traffic separately from math utilization.
changed_paths:
- flash_attn/cute/block_sparse_utils.py
- flash_attn/cute/flash_fwd_sm100.py
- flash_attn/cute/interface.py
- flash_attn/cute/mask.py
- flash_attn/cute/mask_definitions.py
- tests/cute/test_mask_mod.py
artifact_dir: evidence/pull-bundles/flash-attention/gh-2098
head_ref_oid: 3bf9cdf468e5f59a234a716bbc1050135d2fee20
---
# Add pack-gqa fwd support for sparse impl w/ broadcasted H dim

- Repository: `Dao-AILab/flash-attention`
- PR: [2098](https://github.com/Dao-AILab/flash-attention/pull/2098)
- Decision: `Preserve page/KV/layout and plan-run contracts; profile memory traffic separately from math utilization.`
- Reason: Preserve page/KV/layout and plan-run contracts; profile memory traffic separately from math utilization.

## Changed Paths

- `flash_attn/cute/block_sparse_utils.py`
- `flash_attn/cute/flash_fwd_sm100.py`
- `flash_attn/cute/interface.py`
- `flash_attn/cute/mask.py`
- `flash_attn/cute/mask_definitions.py`
- `tests/cute/test_mask_mod.py`

## Evidence Bundle

`evidence/pull-bundles/flash-attention/gh-2098`
