---
id: pr-flashinfer-1862
repo: flashinfer-ai/flashinfer
pr: 1862
title: raise error for group_gemm_fp8_nt_groupwise then num_groups > 1 on sm120/121
author: yongwww
date: '2025-10-04'
url: https://github.com/flashinfer-ai/flashinfer/pull/1862
source_category: upstream-code
architectures:
- sm100
tags:
- fp4
- fp8
- gemm
techniques: []
hardware_features:
- fp4
- fp8
kernel_types:
- gemm
languages:
- cute-dsl
captured_at: '2026-04-27'
status: merged
merge_sha: c6917680f4ebdd94d0d99c47d257bd958fe512f2
inclusion_reason: kernel file changes
changed_paths:
- flashinfer/gemm.py
- scripts/task_jit_run_tests_part1.sh
- scripts/task_jit_run_tests_part4.sh
- tests/gemm/__init__.py
- tests/gemm/test_bmm_fp8.py
- tests/gemm/test_cute_dsl_blockscaled_gemm.py
- tests/gemm/test_cute_dsl_gemm_allreduce_two_shot.py
- tests/gemm/test_group_gemm.py
- tests/gemm/test_groupwise_scaled_gemm_fp8.py
- tests/gemm/test_groupwise_scaled_gemm_mxfp4.py
- tests/gemm/test_mm_fp4.py
- tests/gemm/test_sm_constraint_gemm.py
- tests/gemm/test_tgv_gemm.py
head_ref_oid: e7f390e6426d7dc2bd23009b767d9d3ab5a0720a
artifact_dir: evidence/pull-bundles/flashinfer/gh-1862
---
# raise error for group_gemm_fp8_nt_groupwise then num_groups > 1 on sm120/121

- Repository: `flashinfer-ai/flashinfer`
- PR: [1862](https://github.com/flashinfer-ai/flashinfer/pull/1862)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `flashinfer/gemm.py`
- `scripts/task_jit_run_tests_part1.sh`
- `scripts/task_jit_run_tests_part4.sh`
- `tests/gemm/__init__.py`
- `tests/gemm/test_bmm_fp8.py`
- `tests/gemm/test_cute_dsl_blockscaled_gemm.py`
- `tests/gemm/test_cute_dsl_gemm_allreduce_two_shot.py`
- `tests/gemm/test_group_gemm.py`
- `tests/gemm/test_groupwise_scaled_gemm_fp8.py`
- `tests/gemm/test_groupwise_scaled_gemm_mxfp4.py`
- `tests/gemm/test_mm_fp4.py`
- `tests/gemm/test_sm_constraint_gemm.py`
- `tests/gemm/test_tgv_gemm.py`

## Evidence Bundle

`evidence/pull-bundles/flashinfer/gh-1862`
