---
id: pr-flash-attention-2473
repo: Dao-AILab/flash-attention
pr: 2473
title: Expose --pack-gqa and --num-splits in benchmark_attn.py
author: Johnsonms
date: '2026-04-19'
url: https://github.com/Dao-AILab/flash-attention/pull/2473
source_category: upstream-code
architectures:
- sm100
tags:
- benchmark kernel
techniques: []
hardware_features: []
kernel_types:
- attention
languages:
- cuda-cpp
captured_at: '2026-05-16'
status: merged
merge_sha: 881139b60c70dcf1406d397c5293585f5e1e5db3
inclusion_reason: Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.
changed_paths:
- benchmarks/benchmark_attn.py
artifact_dir: evidence/pull-bundles/flash-attention/gh-2473
head_ref_oid: a3e3b1cefa1dab30488c60e3f5895b7938a142d4
---
# Expose --pack-gqa and --num-splits in benchmark_attn.py

- Repository: `Dao-AILab/flash-attention`
- PR: [2473](https://github.com/Dao-AILab/flash-attention/pull/2473)
- Decision: `Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.`
- Reason: Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.

## Changed Paths

- `benchmarks/benchmark_attn.py`

## Evidence Bundle

`evidence/pull-bundles/flash-attention/gh-2473`
