---
id: pr-vllm-41050
repo: vllm-project/vllm
pr: 41050
title: '[Kernel][MoE] Support GELU on TRT-LLM NvFP4 fused MoE for Gemma4'
author: juhi10071998
date: '2026-05-01'
url: https://github.com/vllm-project/vllm/pull/41050
source_category: upstream-code
architectures:
- sm100
tags:
- FlashInfer
- Marlin
- MoE kernel
- blackwell
- fp4
- fused moe
- gemm_quant
- moe_routing
- nvfp4
- quantization kernel
- sm100
techniques:
- fine-grained-quantization
- kernel-fusion
hardware_features:
- blackwell
- fp4
- nvfp4
kernel_types:
- gemm
- moe
languages:
- cuda-cpp
captured_at: '2026-05-16'
status: merged
merge_sha: 6b6ac6c3c737b69e99264731f010588613dada58
inclusion_reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.
changed_paths:
- tests/kernels/moe/test_trtllm_nvfp4_moe.py
- tests/kernels/moe/utils.py
- vllm/model_executor/layers/fused_moe/experts/trtllm_nvfp4_moe.py
artifact_dir: evidence/pull-bundles/vllm/gh-41050
head_ref_oid: e242affdca5420d1ae501ccf14646009d83b9fc8
---
# [Kernel][MoE] Support GELU on TRT-LLM NvFP4 fused MoE for Gemma4

- Repository: `vllm-project/vllm`
- PR: [41050](https://github.com/vllm-project/vllm/pull/41050)
- Decision: `Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.`
- Reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.

## Changed Paths

- `tests/kernels/moe/test_trtllm_nvfp4_moe.py`
- `tests/kernels/moe/utils.py`
- `vllm/model_executor/layers/fused_moe/experts/trtllm_nvfp4_moe.py`

## Evidence Bundle

`evidence/pull-bundles/vllm/gh-41050`
