---
id: pr-flashinfer-2111
repo: flashinfer-ai/flashinfer
pr: 2111
title: 'refactor: update fa3 codebase and fix hopper unittest [part 1]'
author: yzh119
date: '2025-12-06'
url: https://github.com/flashinfer-ai/flashinfer/pull/2111
source_category: upstream-code
architectures:
- sm100
- sm90
tags:
- attention
- epilogue-fusion
- fp8
- prefill
- quantization
techniques:
- epilogue-fusion
hardware_features:
- fp8
kernel_types:
- attention
- prefill
- quantization
languages:
- cuda-cpp
- triton
captured_at: '2026-04-27'
status: merged
merge_sha: 09872a1d79fa616d9b2d1def05ad5119d25b5ee0
inclusion_reason: kernel file changes
changed_paths:
- benchmarks/bench_hopper_fp8_attention.py
- csrc/batch_prefill_fp8_ragged_sm90_kernel_inst.jinja
- csrc/batch_prefill_fp8_sm90.cu
- csrc/batch_prefill_sm90.cu
- csrc/batch_prefill_sm90_customize_config.jinja
- csrc/flashinfer_page_binding.cu
- csrc/page.cu
- flashinfer/jit/attention/modules.py
- flashinfer/jit/attention/variants.py
- flashinfer/page.py
- flashinfer/prefill.py
- flashinfer/sparse.py
- flashinfer/triton/kernels/cascade.py
- include/flashinfer/attention/hopper/block_sparse_gather.cuh
- include/flashinfer/attention/hopper/default_params.cuh
- include/flashinfer/attention/hopper/epilogue.cuh
- include/flashinfer/attention/hopper/kernel_traits.cuh
- include/flashinfer/attention/hopper/mainloop_mma.cuh
- include/flashinfer/attention/hopper/prefill_sm90.cuh
- include/flashinfer/attention/hopper/quantization/mainloop_sparse_load.cuh
- include/flashinfer/attention/hopper/quantization/prefill_sm90.cuh
- include/flashinfer/attention/hopper/sparse_mainloop.cuh
- include/flashinfer/attention/hopper/variants.cuh
- include/flashinfer/attention/variant_helper.cuh
- include/flashinfer/page.cuh
- scripts/task_jit_run_tests_part2.sh
- tests/attention/test_batch_prefill_kernels.py
- tests/attention/test_block_sparse.py
- tests/attention/test_hopper.py
- tests/attention/test_hopper_fp8_attention.py
- tests/utils/test_block_sparse_indices_to_vector_sparse_offsets.py
head_ref_oid: 436c4433c01dd45ad0c1b85828c47463c6a12744
artifact_dir: evidence/pull-bundles/flashinfer/gh-2111
---
# refactor: update fa3 codebase and fix hopper unittest [part 1]

- Repository: `flashinfer-ai/flashinfer`
- PR: [2111](https://github.com/flashinfer-ai/flashinfer/pull/2111)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `benchmarks/bench_hopper_fp8_attention.py`
- `csrc/batch_prefill_fp8_ragged_sm90_kernel_inst.jinja`
- `csrc/batch_prefill_fp8_sm90.cu`
- `csrc/batch_prefill_sm90.cu`
- `csrc/batch_prefill_sm90_customize_config.jinja`
- `csrc/flashinfer_page_binding.cu`
- `csrc/page.cu`
- `flashinfer/jit/attention/modules.py`
- `flashinfer/jit/attention/variants.py`
- `flashinfer/page.py`
- `flashinfer/prefill.py`
- `flashinfer/sparse.py`
- `flashinfer/triton/kernels/cascade.py`
- `include/flashinfer/attention/hopper/block_sparse_gather.cuh`
- `include/flashinfer/attention/hopper/default_params.cuh`
- `include/flashinfer/attention/hopper/epilogue.cuh`
- `include/flashinfer/attention/hopper/kernel_traits.cuh`
- `include/flashinfer/attention/hopper/mainloop_mma.cuh`
- `include/flashinfer/attention/hopper/prefill_sm90.cuh`
- `include/flashinfer/attention/hopper/quantization/mainloop_sparse_load.cuh`
- `include/flashinfer/attention/hopper/quantization/prefill_sm90.cuh`
- `include/flashinfer/attention/hopper/sparse_mainloop.cuh`
- `include/flashinfer/attention/hopper/variants.cuh`
- `include/flashinfer/attention/variant_helper.cuh`
- `include/flashinfer/page.cuh`
- `scripts/task_jit_run_tests_part2.sh`
- `tests/attention/test_batch_prefill_kernels.py`
- `tests/attention/test_block_sparse.py`
- `tests/attention/test_hopper.py`
- `tests/attention/test_hopper_fp8_attention.py`
- `tests/utils/test_block_sparse_indices_to_vector_sparse_offsets.py`

## Evidence Bundle

`evidence/pull-bundles/flashinfer/gh-2111`
