---
id: pr-flashinfer-2261
repo: flashinfer-ai/flashinfer
pr: 2261
title: Fix CUTLASS FP8 gemm correctness issue on SM120/SM121 for shapes where N is not divisible by ScaleGranularityN.
author: yongwww
date: '2025-12-24'
url: https://github.com/flashinfer-ai/flashinfer/pull/2261
source_category: upstream-code
architectures:
- sm100
tags:
- fp8
- gemm
techniques: []
hardware_features:
- fp8
kernel_types:
- gemm
languages:
- python
captured_at: '2026-04-27'
status: merged
merge_sha: f3e036d9439f6edd5a1236592eb109eb95171537
inclusion_reason: kernel file changes
changed_paths:
- flashinfer/gemm/gemm_base.py
- tests/gemm/test_bmm_fp8.py
head_ref_oid: d81cc5d257fa96c22c3a0a868fc5cfd6733efe43
artifact_dir: evidence/pull-bundles/flashinfer/gh-2261
---
# Fix CUTLASS FP8 gemm correctness issue on SM120/SM121 for shapes where N is not divisible by ScaleGranularityN.

- Repository: `flashinfer-ai/flashinfer`
- PR: [2261](https://github.com/flashinfer-ai/flashinfer/pull/2261)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `flashinfer/gemm/gemm_base.py`
- `tests/gemm/test_bmm_fp8.py`

## Evidence Bundle

`evidence/pull-bundles/flashinfer/gh-2261`
