---
id: pr-tensorrt-llm-13384
repo: NVIDIA/TensorRT-LLM
pr: 13384
title: '[None][feat] Add MegaMoEDeepGemmFusedMoE backend wrapping DeepGEMM fp8_fp4_mega_moe'
author: Barry-Delaney
date: '2026-05-08'
url: https://github.com/NVIDIA/TensorRT-LLM/pull/13384
source_category: upstream-code
architectures:
- sm100
tags:
- fp4
- moe kernel
- mxfp4
techniques:
- kernel-fusion
hardware_features:
- fp4
- fp8
- mxfp4
kernel_types:
- gemm
- moe
languages:
- cuda-cpp
captured_at: '2026-05-16'
status: merged
merge_sha: 6e069b69ef3c70d9565e5f6a92c86a77ca1d41d6
inclusion_reason: Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.
changed_paths:
- tensorrt_llm/_torch/modules/fused_moe/configurable_moe.py
- tensorrt_llm/_torch/modules/fused_moe/create_moe.py
- tensorrt_llm/_torch/modules/fused_moe/mega_moe/__init__.py
- tensorrt_llm/_torch/modules/fused_moe/mega_moe/backend.py
artifact_dir: evidence/pull-bundles/tensorrt-llm/gh-13384
head_ref_oid: e7d80e9383bf913a614e93728b3da90673aa4c40
---
# [None][feat] Add MegaMoEDeepGemmFusedMoE backend wrapping DeepGEMM fp8_fp4_mega_moe

- Repository: `NVIDIA/TensorRT-LLM`
- PR: [13384](https://github.com/NVIDIA/TensorRT-LLM/pull/13384)
- Decision: `Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.`
- Reason: Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.

## Changed Paths

- `tensorrt_llm/_torch/modules/fused_moe/configurable_moe.py`
- `tensorrt_llm/_torch/modules/fused_moe/create_moe.py`
- `tensorrt_llm/_torch/modules/fused_moe/mega_moe/__init__.py`
- `tensorrt_llm/_torch/modules/fused_moe/mega_moe/backend.py`

## Evidence Bundle

`evidence/pull-bundles/tensorrt-llm/gh-13384`
