---
id: pr-flashinfer-869
repo: flashinfer-ai/flashinfer
pr: 869
title: Naive Support for Hopper FP8 Prefill Kernel with Per-Head Quantization
author: happierpig
date: '2025-02-27'
url: https://github.com/flashinfer-ai/flashinfer/pull/869
source_category: upstream-code
architectures:
- sm100
- sm90
tags:
- attention
- epilogue-fusion
- fp8
- prefill
- quantization
techniques:
- epilogue-fusion
hardware_features:
- fp8
kernel_types:
- attention
- prefill
- quantization
languages:
- cuda-cpp
captured_at: '2026-04-17'
status: merged
merge_sha: f5dec3d502634cf350a88fc50cbb4d048bda16b1
inclusion_reason: kernel file changes
changed_paths:
- include/flashinfer/attention/hopper/attention_updater.cuh
- include/flashinfer/attention/hopper/default_params.cuh
- include/flashinfer/attention/hopper/named_barrier.cuh
- include/flashinfer/attention/hopper/quantization/epilogue.cuh
- include/flashinfer/attention/hopper/quantization/kernel_traits.cuh
- include/flashinfer/attention/hopper/quantization/mainloop_load.cuh
- include/flashinfer/attention/hopper/quantization/mainloop_mma.cuh
- include/flashinfer/attention/hopper/quantization/prefill_sm90.cuh
- include/flashinfer/attention/hopper/utils.cuh
- include/flashinfer/attention/hopper/variants.cuh
- src/fp8-dev/CMakeLists.txt
- src/fp8-dev/bench_single_prefill_sm90.cu
- src/fp8-dev/cpu_reference.h
- src/fp8-dev/flashattention_ops.h
- src/fp8-dev/flashinfer_ops.cu
- src/fp8-dev/test_single_prefill_fa3_sm90.cu
- src/fp8-dev/utils.h
head_ref_oid: 70bad2338d7ddb39ef7d3058e50f8bc7e7470ddf
artifact_dir: evidence/pull-bundles/flashinfer/gh-869
---
# Naive Support for Hopper FP8 Prefill Kernel with Per-Head Quantization

- Repository: `flashinfer-ai/flashinfer`
- PR: [869](https://github.com/flashinfer-ai/flashinfer/pull/869)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `include/flashinfer/attention/hopper/attention_updater.cuh`
- `include/flashinfer/attention/hopper/default_params.cuh`
- `include/flashinfer/attention/hopper/named_barrier.cuh`
- `include/flashinfer/attention/hopper/quantization/epilogue.cuh`
- `include/flashinfer/attention/hopper/quantization/kernel_traits.cuh`
- `include/flashinfer/attention/hopper/quantization/mainloop_load.cuh`
- `include/flashinfer/attention/hopper/quantization/mainloop_mma.cuh`
- `include/flashinfer/attention/hopper/quantization/prefill_sm90.cuh`
- `include/flashinfer/attention/hopper/utils.cuh`
- `include/flashinfer/attention/hopper/variants.cuh`
- `src/fp8-dev/CMakeLists.txt`
- `src/fp8-dev/bench_single_prefill_sm90.cu`
- `src/fp8-dev/cpu_reference.h`
- `src/fp8-dev/flashattention_ops.h`
- `src/fp8-dev/flashinfer_ops.cu`
- `src/fp8-dev/test_single_prefill_fa3_sm90.cu`
- `src/fp8-dev/utils.h`

## Evidence Bundle

`evidence/pull-bundles/flashinfer/gh-869`
