---
id: pr-flashinfer-1039
repo: flashinfer-ai/flashinfer
pr: 1039
title: '[nvidia] initial support for blackwell kernels'
author: yzh119
date: '2025-05-13'
url: https://github.com/flashinfer-ai/flashinfer/pull/1039
source_category: upstream-code
architectures:
- sm100
tags:
- attention
- epilogue-fusion
- flash-attention
- kernel-fusion
- mla
- prefill
- tile-scheduling
- tma
techniques:
- epilogue-fusion
- kernel-fusion
- tile-scheduling
hardware_features:
- tma
kernel_types:
- attention
- flash-attention
- mla
- prefill
languages:
- cuda-cpp
- triton
captured_at: '2026-04-17'
status: merged
merge_sha: 9a05c92ad7d8b4d044111f482fb800819819e5f0
inclusion_reason: kernel file changes
changed_paths:
- benchmarks/bench_blackwell_attention.py
- csrc/fmha_cutlass_sm100.cu
- csrc/fmha_cutlass_sm100_pybind.cu
- flashinfer/jit/__init__.py
- flashinfer/jit/attention/__init__.py
- flashinfer/jit/attention/pytorch.py
- flashinfer/jit/core.py
- flashinfer/prefill.py
- flashinfer/triton/__init__.py
- flashinfer/triton/format_conversion.py
- flashinfer/utils.py
- include/flashinfer/attention/blackwell/collective/fmha_common.hpp
- include/flashinfer/attention/blackwell/collective/fmha_fusion.hpp
- include/flashinfer/attention/blackwell/collective/sm100_fmha_fwd_epilogue_tma_warpspecialized.hpp
- include/flashinfer/attention/blackwell/collective/sm100_fmha_fwd_mainloop_tma_warpspecialized.hpp
- include/flashinfer/attention/blackwell/collective/sm100_fmha_gen_epilogue_warpspecialized.hpp
- include/flashinfer/attention/blackwell/collective/sm100_fmha_gen_mainloop_warpspecialized.hpp
- include/flashinfer/attention/blackwell/collective/sm100_fmha_load_cpasync_warpspecialized.hpp
- include/flashinfer/attention/blackwell/collective/sm100_fmha_load_tma_warpspecialized.hpp
- include/flashinfer/attention/blackwell/common/pow_2.hpp
- include/flashinfer/attention/blackwell/device/fmha.hpp
- include/flashinfer/attention/blackwell/device/sm100_mla.hpp
- include/flashinfer/attention/blackwell/fmha_cutlass_sm100.cuh
- include/flashinfer/attention/blackwell/kernel/fmha_options.hpp
- include/flashinfer/attention/blackwell/kernel/fmha_tile_scheduler.hpp
- include/flashinfer/attention/blackwell/kernel/sm100_fmha_fwd_kernel_tma_warpspecialized.hpp
- include/flashinfer/attention/blackwell/kernel/sm100_fmha_gen_kernel_warpspecialized.hpp
- include/flashinfer/attention/blackwell/kernel/sm100_fmha_mla_reduction.hpp
- include/flashinfer/attention/blackwell/kernel/sm100_fmha_mla_tma_warpspecialized.hpp
- include/flashinfer/attention/blackwell/kernel/sm100_mla_tile_scheduler.hpp
- tests/test_blackwell_fmha.py
- tests/test_format_conversion.py
artifact_dir: evidence/pull-bundles/flashinfer/gh-1039
head_ref_oid: f3855cf5beef3e7ab19dcc8d45d4dcd5be2d5723
---
# [nvidia] initial support for blackwell kernels

- Repository: `flashinfer-ai/flashinfer`
- PR: [1039](https://github.com/flashinfer-ai/flashinfer/pull/1039)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `benchmarks/bench_blackwell_attention.py`
- `csrc/fmha_cutlass_sm100.cu`
- `csrc/fmha_cutlass_sm100_pybind.cu`
- `flashinfer/jit/__init__.py`
- `flashinfer/jit/attention/__init__.py`
- `flashinfer/jit/attention/pytorch.py`
- `flashinfer/jit/core.py`
- `flashinfer/prefill.py`
- `flashinfer/triton/__init__.py`
- `flashinfer/triton/format_conversion.py`
- `flashinfer/utils.py`
- `include/flashinfer/attention/blackwell/collective/fmha_common.hpp`
- `include/flashinfer/attention/blackwell/collective/fmha_fusion.hpp`
- `include/flashinfer/attention/blackwell/collective/sm100_fmha_fwd_epilogue_tma_warpspecialized.hpp`
- `include/flashinfer/attention/blackwell/collective/sm100_fmha_fwd_mainloop_tma_warpspecialized.hpp`
- `include/flashinfer/attention/blackwell/collective/sm100_fmha_gen_epilogue_warpspecialized.hpp`
- `include/flashinfer/attention/blackwell/collective/sm100_fmha_gen_mainloop_warpspecialized.hpp`
- `include/flashinfer/attention/blackwell/collective/sm100_fmha_load_cpasync_warpspecialized.hpp`
- `include/flashinfer/attention/blackwell/collective/sm100_fmha_load_tma_warpspecialized.hpp`
- `include/flashinfer/attention/blackwell/common/pow_2.hpp`
- `include/flashinfer/attention/blackwell/device/fmha.hpp`
- `include/flashinfer/attention/blackwell/device/sm100_mla.hpp`
- `include/flashinfer/attention/blackwell/fmha_cutlass_sm100.cuh`
- `include/flashinfer/attention/blackwell/kernel/fmha_options.hpp`
- `include/flashinfer/attention/blackwell/kernel/fmha_tile_scheduler.hpp`
- `include/flashinfer/attention/blackwell/kernel/sm100_fmha_fwd_kernel_tma_warpspecialized.hpp`
- `include/flashinfer/attention/blackwell/kernel/sm100_fmha_gen_kernel_warpspecialized.hpp`
- `include/flashinfer/attention/blackwell/kernel/sm100_fmha_mla_reduction.hpp`
- `include/flashinfer/attention/blackwell/kernel/sm100_fmha_mla_tma_warpspecialized.hpp`
- `include/flashinfer/attention/blackwell/kernel/sm100_mla_tile_scheduler.hpp`
- `tests/test_blackwell_fmha.py`
- `tests/test_format_conversion.py`

## Evidence Bundle

`evidence/pull-bundles/flashinfer/gh-1039`
