---
id: pr-vllm-20645
repo: vllm-project/vllm
pr: 20645
title: '[NVIDIA] Add SM100 Flashinfer MoE blockscale fp8 backend for low latency'
author: kaixih
date: '2025-07-19'
url: https://github.com/vllm-project/vllm/pull/20645
source_category: upstream-code
architectures:
- sm100
tags: []
techniques: []
hardware_features: []
kernel_types: []
languages: []
captured_at: '2026-05-16'
status: merged
merge_sha: 6d0734c562e759fdb7076d762222b3881e62ab1f
inclusion_reason: defer
changed_paths:
- vllm/envs.py
- vllm/model_executor/layers/fused_moe/config.py
- vllm/model_executor/layers/fused_moe/fused_moe.py
- vllm/model_executor/layers/quantization/fp8.py
- vllm/model_executor/layers/quantization/modelopt.py
- vllm/utils/flashinfer.py
artifact_dir: evidence/pull-bundles/vllm/gh-20645
head_ref_oid: 44b0d24c0f000daf37934edb59a60a19f80f0107
---
# [NVIDIA] Add SM100 Flashinfer MoE blockscale fp8 backend for low latency

- Repository: `vllm-project/vllm`
- PR: [20645](https://github.com/vllm-project/vllm/pull/20645)
- Decision: `defer`
- Reason: defer

## Changed Paths

- `vllm/envs.py`
- `vllm/model_executor/layers/fused_moe/config.py`
- `vllm/model_executor/layers/fused_moe/fused_moe.py`
- `vllm/model_executor/layers/quantization/fp8.py`
- `vllm/model_executor/layers/quantization/modelopt.py`
- `vllm/utils/flashinfer.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-20645`
