---
id: pr-flashinfer-3239
repo: flashinfer-ai/flashinfer
pr: 3239
title: Update moe gemm
author: IwakuraRein
date: '2026-05-08'
url: https://github.com/flashinfer-ai/flashinfer/pull/3239
source_category: upstream-code
architectures:
- sm100
tags:
- attention_kv
- benchmark_test
- fp8
- gemm_quant
- moe_routing
- mxfp4
techniques:
- fine-grained-quantization
hardware_features:
- fp4
- fp8
- mxfp4
kernel_types:
- attention
- gemm
- moe
languages:
- cuda-cpp
captured_at: '2026-05-16'
status: merged
merge_sha: 2fe28ca941911e79f517af618c2ad52ee377cd79
inclusion_reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.
changed_paths:
- csrc/trtllm_batched_gemm_runner.cu
- csrc/trtllm_gemm_runner.cu
- csrc/trtllm_low_latency_gemm_runner.cu
- flashinfer/artifacts.py
artifact_dir: evidence/pull-bundles/flashinfer/gh-3239
head_ref_oid: faaf038eb5771112dc31f84f8095736c3319b58a
---
# Update moe gemm

- Repository: `flashinfer-ai/flashinfer`
- PR: [3239](https://github.com/flashinfer-ai/flashinfer/pull/3239)
- Decision: `Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.`
- Reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.

## Changed Paths

- `csrc/trtllm_batched_gemm_runner.cu`
- `csrc/trtllm_gemm_runner.cu`
- `csrc/trtllm_low_latency_gemm_runner.cu`
- `flashinfer/artifacts.py`

## Evidence Bundle

`evidence/pull-bundles/flashinfer/gh-3239`
