---
id: pr-flashinfer-1819
repo: flashinfer-ai/flashinfer
pr: 1819
title: feat:enable fp8 blockscale moe for fused cultass for sm90
author: djmmoss
date: '2025-10-12'
url: https://github.com/flashinfer-ai/flashinfer/pull/1819
source_category: upstream-code
architectures:
- sm100
- sm90
tags:
- fp8
- gemm
- kernel-fusion
- moe
- tma
techniques:
- kernel-fusion
hardware_features:
- fp8
- tma
kernel_types:
- gemm
- moe
languages:
- cuda-cpp
captured_at: '2026-04-27'
status: merged
merge_sha: 8276d03c368e49b25736a97d29d6d70e089be985
inclusion_reason: kernel file changes
changed_paths:
- csrc/nv_internal/tensorrt_llm/deep_gemm/compiler.cuh
- csrc/nv_internal/tensorrt_llm/deep_gemm/fp8_gemm.cuh
- csrc/nv_internal/tensorrt_llm/deep_gemm/fp8_gemm_impl.cuh
- csrc/nv_internal/tensorrt_llm/deep_gemm/jit_utils.cuh
- csrc/nv_internal/tensorrt_llm/deep_gemm/mma_utils.cuh
- csrc/nv_internal/tensorrt_llm/deep_gemm/nvrtc_cutlass.cuh
- csrc/nv_internal/tensorrt_llm/deep_gemm/nvrtc_std.cuh
- csrc/nv_internal/tensorrt_llm/deep_gemm/runtime.cuh
- csrc/nv_internal/tensorrt_llm/deep_gemm/scheduler.cuh
- csrc/nv_internal/tensorrt_llm/deep_gemm/tma_utils.cuh
- csrc/nv_internal/tensorrt_llm/deep_gemm/utils.cuh
- csrc/nv_internal/tensorrt_llm/kernels/cutlass_kernels/fp8_blockscale_gemm/ada_blockwise_gemm/sm89_fp8_gemm_1d1d.cuh
- csrc/nv_internal/tensorrt_llm/kernels/cutlass_kernels/fp8_blockscale_gemm/ada_blockwise_gemm/sm89_utils.cuh
- csrc/nv_internal/tensorrt_llm/kernels/cutlass_kernels/fp8_blockscale_gemm/fp8_blockscale_gemm.cu
- csrc/nv_internal/tensorrt_llm/kernels/cutlass_kernels/fp8_blockscale_gemm/fp8_blockscale_gemm.h
- csrc/nv_internal/tensorrt_llm/kernels/cutlass_kernels/fp8_blockscale_gemm/fp8_blockscale_gemm_kernel.cuh
- csrc/nv_internal/tensorrt_llm/kernels/cutlass_kernels/fp8_blockscale_gemm/fp8_blockscale_gemm_stub.cu
- csrc/nv_internal/tensorrt_llm/kernels/cutlass_kernels/fp8_blockscale_gemm/fp8_blockscale_mma_utils.cuh
- csrc/nv_internal/tensorrt_llm/kernels/cutlass_kernels/fp8_blockscale_gemm/fp8_blockscale_tma_utils.cuh
- flashinfer/fused_moe/core.py
- flashinfer/jit/fused_moe.py
- tests/moe/test_trtllm_cutlass_fused_moe.py
head_ref_oid: 94c13dec70a0a64e522670b098ffef09e3a049f3
artifact_dir: evidence/pull-bundles/flashinfer/gh-1819
---
# feat:enable fp8 blockscale moe for fused cultass for sm90

- Repository: `flashinfer-ai/flashinfer`
- PR: [1819](https://github.com/flashinfer-ai/flashinfer/pull/1819)
- Decision: `kernel file changes`
- Reason: kernel file changes

## Changed Paths

- `csrc/nv_internal/tensorrt_llm/deep_gemm/compiler.cuh`
- `csrc/nv_internal/tensorrt_llm/deep_gemm/fp8_gemm.cuh`
- `csrc/nv_internal/tensorrt_llm/deep_gemm/fp8_gemm_impl.cuh`
- `csrc/nv_internal/tensorrt_llm/deep_gemm/jit_utils.cuh`
- `csrc/nv_internal/tensorrt_llm/deep_gemm/mma_utils.cuh`
- `csrc/nv_internal/tensorrt_llm/deep_gemm/nvrtc_cutlass.cuh`
- `csrc/nv_internal/tensorrt_llm/deep_gemm/nvrtc_std.cuh`
- `csrc/nv_internal/tensorrt_llm/deep_gemm/runtime.cuh`
- `csrc/nv_internal/tensorrt_llm/deep_gemm/scheduler.cuh`
- `csrc/nv_internal/tensorrt_llm/deep_gemm/tma_utils.cuh`
- `csrc/nv_internal/tensorrt_llm/deep_gemm/utils.cuh`
- `csrc/nv_internal/tensorrt_llm/kernels/cutlass_kernels/fp8_blockscale_gemm/ada_blockwise_gemm/sm89_fp8_gemm_1d1d.cuh`
- `csrc/nv_internal/tensorrt_llm/kernels/cutlass_kernels/fp8_blockscale_gemm/ada_blockwise_gemm/sm89_utils.cuh`
- `csrc/nv_internal/tensorrt_llm/kernels/cutlass_kernels/fp8_blockscale_gemm/fp8_blockscale_gemm.cu`
- `csrc/nv_internal/tensorrt_llm/kernels/cutlass_kernels/fp8_blockscale_gemm/fp8_blockscale_gemm.h`
- `csrc/nv_internal/tensorrt_llm/kernels/cutlass_kernels/fp8_blockscale_gemm/fp8_blockscale_gemm_kernel.cuh`
- `csrc/nv_internal/tensorrt_llm/kernels/cutlass_kernels/fp8_blockscale_gemm/fp8_blockscale_gemm_stub.cu`
- `csrc/nv_internal/tensorrt_llm/kernels/cutlass_kernels/fp8_blockscale_gemm/fp8_blockscale_mma_utils.cuh`
- `csrc/nv_internal/tensorrt_llm/kernels/cutlass_kernels/fp8_blockscale_gemm/fp8_blockscale_tma_utils.cuh`
- `flashinfer/fused_moe/core.py`
- `flashinfer/jit/fused_moe.py`
- `tests/moe/test_trtllm_cutlass_fused_moe.py`

## Evidence Bundle

`evidence/pull-bundles/flashinfer/gh-1819`
