---
id: pr-flashinfer-1200
repo: flashinfer-ai/flashinfer
pr: 1200
title: '[feat] optimize persistent batch attention perf.'
author: happierpig
date: '2025-06-30'
url: https://github.com/flashinfer-ai/flashinfer/pull/1200
source_category: upstream-code
architectures:
- sm100
tags:
- attention
- persistent-kernel
techniques:
- persistent-kernel
hardware_features: []
kernel_types:
- attention
languages:
- cuda-cpp
captured_at: '2026-04-17'
status: merged
merge_sha: 40db3fadfd5f361882dcd4cc797bd8867b7893a2
inclusion_reason: kernel file changes
changed_paths:
- csrc/batch_attention.cu
- csrc/batch_attention_customize_config.jinja
- csrc/batch_attention_jit_pybind.cu
- flashinfer/attention.py
- flashinfer/jit/attention/pytorch.py
- include/flashinfer/attention/cascade.cuh
- include/flashinfer/attention/persistent.cuh
- include/flashinfer/attention/persistent_template.cuh
- include/flashinfer/attention/scheduler.cuh
- include/flashinfer/profiler.cuh
- profiler/batch_attention.py
- tests/test_batch_attention.py
head_ref_oid: a2d79f79c28e5316b341f4679dbf493158a491f6
artifact_dir: evidence/pull-bundles/flashinfer/gh-1200
---
# [feat] optimize persistent batch attention perf.

- Repository: `flashinfer-ai/flashinfer`
- PR: [1200](https://github.com/flashinfer-ai/flashinfer/pull/1200)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `csrc/batch_attention.cu`
- `csrc/batch_attention_customize_config.jinja`
- `csrc/batch_attention_jit_pybind.cu`
- `flashinfer/attention.py`
- `flashinfer/jit/attention/pytorch.py`
- `include/flashinfer/attention/cascade.cuh`
- `include/flashinfer/attention/persistent.cuh`
- `include/flashinfer/attention/persistent_template.cuh`
- `include/flashinfer/attention/scheduler.cuh`
- `include/flashinfer/profiler.cuh`
- `profiler/batch_attention.py`
- `tests/test_batch_attention.py`

## Evidence Bundle

`evidence/pull-bundles/flashinfer/gh-1200`
