---
id: pr-tensorrt-llm-13667
repo: NVIDIA/TensorRT-LLM
pr: 13667
title: '[None][perf] Improve TRTLLM MoE autotune in DEP'
author: rosenrodt
date: '2026-05-08'
url: https://github.com/NVIDIA/TensorRT-LLM/pull/13667
source_category: upstream-code
architectures:
- sm100
tags:
- moe
- moe kernel
- mxfp4
techniques:
- autotuning
hardware_features:
- fp4
- mxfp4
kernel_types:
- moe
languages:
- cuda-cpp
captured_at: '2026-05-16'
status: merged
merge_sha: cf4d75b964883f1f0ce6fe3c1d22a4ad4fb16a50
inclusion_reason: Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.
changed_paths:
- tensorrt_llm/_torch/custom_ops/trtllm_gen_custom_ops.py
- tensorrt_llm/_torch/modules/fused_moe/fused_moe_trtllm_gen.py
- tensorrt_llm/_torch/modules/fused_moe/moe_op_backend.py
- tests/unittest/_torch/modules/moe/test_moe_module.py
artifact_dir: evidence/pull-bundles/tensorrt-llm/gh-13667
head_ref_oid: 0325d4241f9ac39055f814b690eee32a327f00ae
---
# [None][perf] Improve TRTLLM MoE autotune in DEP

- Repository: `NVIDIA/TensorRT-LLM`
- PR: [13667](https://github.com/NVIDIA/TensorRT-LLM/pull/13667)
- Decision: `Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.`
- Reason: Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.

## Changed Paths

- `tensorrt_llm/_torch/custom_ops/trtllm_gen_custom_ops.py`
- `tensorrt_llm/_torch/modules/fused_moe/fused_moe_trtllm_gen.py`
- `tensorrt_llm/_torch/modules/fused_moe/moe_op_backend.py`
- `tests/unittest/_torch/modules/moe/test_moe_module.py`

## Evidence Bundle

`evidence/pull-bundles/tensorrt-llm/gh-13667`
