---
id: pr-flashinfer-1769
repo: flashinfer-ai/flashinfer
pr: 1769
title: 'feat: add xqa fp8 mha and fp8 kv cache'
author: qsang-nv
date: '2025-10-27'
url: https://github.com/flashinfer-ai/flashinfer/pull/1769
source_category: upstream-code
architectures:
- sm100
tags:
- attention
- fp8
- mla
- tma
techniques: []
hardware_features:
- fp8
- tma
kernel_types:
- attention
- mla
languages:
- cuda-cpp
captured_at: '2026-04-27'
status: merged
merge_sha: ef687e9009f1f4e16f6f02b0554ecb4c5c7985e8
inclusion_reason: kernel file changes
changed_paths:
- csrc/flashinfer_xqa_binding.cu
- csrc/xqa/gmma.cuh
- csrc/xqa/gmma_impl.cuh
- csrc/xqa/mha.cu
- csrc/xqa/mha.h
- csrc/xqa/mha_sm90.cu
- csrc/xqa/mla_sm120.cu
- csrc/xqa/mla_sm120.cuh
- csrc/xqa/tensorMap.cpp
- csrc/xqa/tensorMap.h
- csrc/xqa/tma.h
- csrc/xqa/utils.cuh
- csrc/xqa/xqa_wrapper.cu
- docs/api/attention.rst
- flashinfer/__init__.py
- flashinfer/aot.py
- flashinfer/jit/xqa.py
- flashinfer/xqa.py
- tests/attention/test_xqa.py
head_ref_oid: 3b70d5d760155c1f9b7aec8b91253dd2f2106b1b
artifact_dir: evidence/pull-bundles/flashinfer/gh-1769
---
# feat: add xqa fp8 mha and fp8 kv cache

- Repository: `flashinfer-ai/flashinfer`
- PR: [1769](https://github.com/flashinfer-ai/flashinfer/pull/1769)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `csrc/flashinfer_xqa_binding.cu`
- `csrc/xqa/gmma.cuh`
- `csrc/xqa/gmma_impl.cuh`
- `csrc/xqa/mha.cu`
- `csrc/xqa/mha.h`
- `csrc/xqa/mha_sm90.cu`
- `csrc/xqa/mla_sm120.cu`
- `csrc/xqa/mla_sm120.cuh`
- `csrc/xqa/tensorMap.cpp`
- `csrc/xqa/tensorMap.h`
- `csrc/xqa/tma.h`
- `csrc/xqa/utils.cuh`
- `csrc/xqa/xqa_wrapper.cu`
- `docs/api/attention.rst`
- `flashinfer/__init__.py`
- `flashinfer/aot.py`
- `flashinfer/jit/xqa.py`
- `flashinfer/xqa.py`
- `tests/attention/test_xqa.py`

## Evidence Bundle

`evidence/pull-bundles/flashinfer/gh-1769`
