---
id: pr-flashinfer-2738
repo: flashinfer-ai/flashinfer
pr: 2738
title: Support for MXFP4 and NVFP4 group GEMMs on GeForce and Spark
author: depaulmillz
date: '2026-03-28'
url: https://github.com/flashinfer-ai/flashinfer/pull/2738
source_category: upstream-code
architectures:
- sm100
tags:
- fp4
- fp8
- gemm
- grouped-gemm
- nvfp4
techniques: []
hardware_features:
- fp4
- fp8
- nvfp4
kernel_types:
- gemm
- grouped-gemm
languages:
- cuda-cpp
captured_at: '2026-04-27'
status: merged
merge_sha: 904fa8cbcf0d5d1d8b31283020223bfec1acbb6f
inclusion_reason: kernel file changes
changed_paths:
- benchmarks/bench_groupwise_grouped_gemm_mxfp4_blackwell.py
- benchmarks/bench_groupwise_grouped_gemm_nvfp4_blackwell_geforce.py
- csrc/group_gemm_mxfp4_groupwise_sm120.cu
- csrc/group_gemm_mxfp4_groupwise_sm120_kernel_inst.jinja
- csrc/group_gemm_nvfp4_groupwise_sm120.cu
- csrc/group_gemm_nvfp4_groupwise_sm120_kernel_inst.jinja
- csrc/group_gemm_sm120_binding.cu
- csrc/tvm_ffi_utils.h
- flashinfer/gemm/__init__.py
- flashinfer/gemm/gemm_base.py
- flashinfer/jit/gemm/core.py
- include/flashinfer/gemm/fp4_gemm_template_sm120.h
- include/flashinfer/gemm/group_gemm_fp8_groupwise_sm120.cuh
- include/flashinfer/gemm/group_gemm_mxfp4_groupwise_sm120.cuh
- include/flashinfer/gemm/group_gemm_nvfp4_groupwise_sm120.cuh
- tests/gemm/test_group_gemm_fp4.py
- tests/gemm/test_groupwise_scaled_gemm_mxfp4.py
head_ref_oid: b93397ddfa017fef88b53252091764c0ab0ebbfa
artifact_dir: evidence/pull-bundles/flashinfer/gh-2738
---
# Support for MXFP4 and NVFP4 group GEMMs on GeForce and Spark

- Repository: `flashinfer-ai/flashinfer`
- PR: [2738](https://github.com/flashinfer-ai/flashinfer/pull/2738)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `benchmarks/bench_groupwise_grouped_gemm_mxfp4_blackwell.py`
- `benchmarks/bench_groupwise_grouped_gemm_nvfp4_blackwell_geforce.py`
- `csrc/group_gemm_mxfp4_groupwise_sm120.cu`
- `csrc/group_gemm_mxfp4_groupwise_sm120_kernel_inst.jinja`
- `csrc/group_gemm_nvfp4_groupwise_sm120.cu`
- `csrc/group_gemm_nvfp4_groupwise_sm120_kernel_inst.jinja`
- `csrc/group_gemm_sm120_binding.cu`
- `csrc/tvm_ffi_utils.h`
- `flashinfer/gemm/__init__.py`
- `flashinfer/gemm/gemm_base.py`
- `flashinfer/jit/gemm/core.py`
- `include/flashinfer/gemm/fp4_gemm_template_sm120.h`
- `include/flashinfer/gemm/group_gemm_fp8_groupwise_sm120.cuh`
- `include/flashinfer/gemm/group_gemm_mxfp4_groupwise_sm120.cuh`
- `include/flashinfer/gemm/group_gemm_nvfp4_groupwise_sm120.cuh`
- `tests/gemm/test_group_gemm_fp4.py`
- `tests/gemm/test_groupwise_scaled_gemm_mxfp4.py`

## Evidence Bundle

`evidence/pull-bundles/flashinfer/gh-2738`
