---
id: pr-vllm-27134
repo: vllm-project/vllm
pr: 27134
title: '[Kernels] Enable FlashInfer FP8 Blockscale on SM90 (for TEP DSR1)'
author: djmmoss
date: '2025-11-14'
url: https://github.com/vllm-project/vllm/pull/27134
source_category: upstream-code
architectures:
- sm90
tags:
- arch_pipeline
- attention_kv
- gemm_quant
- moe_routing
- sm90
techniques:
- fine-grained-quantization
- kernel-fusion
- pipeline-stages
hardware_features:
- fp8
- hopper
kernel_types:
- attention
- gemm
- moe
- runtime
languages:
- cuda-cpp
- cute-dsl
captured_at: '2026-05-16'
status: merged
merge_sha: 3f8a8740656f2c0079b9e2b1623a0758a61104af
inclusion_reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.
changed_paths:
- vllm/model_executor/layers/fused_moe/flashinfer_cutlass_moe.py
- vllm/model_executor/layers/fused_moe/flashinfer_cutlass_prepare_finalize.py
- vllm/model_executor/layers/quantization/fp8.py
- vllm/model_executor/layers/quantization/utils/flashinfer_utils.py
artifact_dir: evidence/pull-bundles/vllm/gh-27134
head_ref_oid: 070f14a24268fbfc0a8e0b826e3148f9c1b14065
---
# [Kernels] Enable FlashInfer FP8 Blockscale on SM90 (for TEP DSR1)

- Repository: `vllm-project/vllm`
- PR: [27134](https://github.com/vllm-project/vllm/pull/27134)
- Decision: `Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.`
- Reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.

## Changed Paths

- `vllm/model_executor/layers/fused_moe/flashinfer_cutlass_moe.py`
- `vllm/model_executor/layers/fused_moe/flashinfer_cutlass_prepare_finalize.py`
- `vllm/model_executor/layers/quantization/fp8.py`
- `vllm/model_executor/layers/quantization/utils/flashinfer_utils.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-27134`
