---
id: pr-flashinfer-2534
repo: flashinfer-ai/flashinfer
pr: 2534
title: 'fix: support fp32 logits for fp8_per_tensor and fp8_block'
author: yweng0828
date: '2026-03-30'
url: https://github.com/flashinfer-ai/flashinfer/pull/2534
source_category: upstream-code
architectures:
- sm100
tags:
- attention_kv
- benchmark_test
- fp8
- gemm_quant
- moe_routing
techniques:
- fine-grained-quantization
- kernel-fusion
hardware_features:
- fp8
kernel_types:
- attention
- gemm
- moe
languages:
- cuda-cpp
captured_at: '2026-05-16'
status: merged
merge_sha: 182dc2038661b5827b3693f3a72dfb85dffb9348
inclusion_reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.
changed_paths:
- csrc/trtllm_fused_moe_kernel_launcher.cu
- csrc/trtllm_fused_moe_runner.cu
- include/flashinfer/trtllm/fused_moe/DevKernel.h
- include/flashinfer/trtllm/fused_moe/RoutingKernel.h
- include/flashinfer/trtllm/fused_moe/runner.h
- tests/moe/test_dpsk_fused_moe_fp8.py
- tests/moe/test_trtllm_gen_fused_moe.py
- tests/moe/utils.py
artifact_dir: evidence/pull-bundles/flashinfer/gh-2534
head_ref_oid: af075f14bac3e56b16dae7ca350deca403ae5a2e
---
# fix: support fp32 logits for fp8_per_tensor and fp8_block

- Repository: `flashinfer-ai/flashinfer`
- PR: [2534](https://github.com/flashinfer-ai/flashinfer/pull/2534)
- Decision: `Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.`
- Reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.

## Changed Paths

- `csrc/trtllm_fused_moe_kernel_launcher.cu`
- `csrc/trtllm_fused_moe_runner.cu`
- `include/flashinfer/trtllm/fused_moe/DevKernel.h`
- `include/flashinfer/trtllm/fused_moe/RoutingKernel.h`
- `include/flashinfer/trtllm/fused_moe/runner.h`
- `tests/moe/test_dpsk_fused_moe_fp8.py`
- `tests/moe/test_trtllm_gen_fused_moe.py`
- `tests/moe/utils.py`

## Evidence Bundle

`evidence/pull-bundles/flashinfer/gh-2534`
