---
id: pr-flashinfer-2035
repo: flashinfer-ai/flashinfer
pr: 2035
title: Added an initial implementation of Q and KV Cache in fp8 and to use t…
author: Anerudhan
date: '2025-12-16'
url: https://github.com/flashinfer-ai/flashinfer/pull/2035
source_category: upstream-code
architectures:
- sm100
tags:
- attention
- fp8
- prefill
techniques: []
hardware_features:
- fp8
kernel_types:
- attention
- prefill
languages:
- python
captured_at: '2026-04-27'
status: merged
merge_sha: d64bcc5997488ed17da7680a91f2812e9a81843b
inclusion_reason: kernel file changes
changed_paths:
- benchmarks/README.md
- benchmarks/routines/attention.py
- benchmarks/routines/flashinfer_benchmark_utils.py
- flashinfer/cudnn/prefill.py
- flashinfer/prefill.py
- tests/attention/test_cudnn_prefill.py
head_ref_oid: be68a0fb49549a822036fef37d8137bd18aa5bdc
artifact_dir: evidence/pull-bundles/flashinfer/gh-2035
---
# Added an initial implementation of Q and KV Cache in fp8 and to use t…

- Repository: `flashinfer-ai/flashinfer`
- PR: [2035](https://github.com/flashinfer-ai/flashinfer/pull/2035)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `benchmarks/README.md`
- `benchmarks/routines/attention.py`
- `benchmarks/routines/flashinfer_benchmark_utils.py`
- `flashinfer/cudnn/prefill.py`
- `flashinfer/prefill.py`
- `tests/attention/test_cudnn_prefill.py`

## Evidence Bundle

`evidence/pull-bundles/flashinfer/gh-2035`
