---
id: pr-tensorrt-llm-11652
repo: NVIDIA/TensorRT-LLM
pr: 11652
title: '[None][feat] NVFP4 TRTLLM-Gen MoE for AutoDeploy (Nemotron Super)'
author: tcherckez-nvidia
date: '2026-03-10'
url: https://github.com/NVIDIA/TensorRT-LLM/pull/11652
source_category: upstream-code
architectures:
- sm100
tags:
- benchmark_test
- gemm_quant
- moe_routing
- scheduler_autotune
- sm100
techniques:
- autotuning
- fine-grained-quantization
- kernel-fusion
- tile-scheduling
hardware_features:
- blackwell
- fp4
- nvfp4
kernel_types:
- gemm
- moe
- scheduler
languages: []
captured_at: '2026-05-16'
status: merged
merge_sha: c96c68f9b863684a296eb9ed135145cc22ebce95
inclusion_reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.
changed_paths:
- examples/auto_deploy/super_v3.yaml
- tensorrt_llm/_torch/auto_deploy/config/default.yaml
- tensorrt_llm/_torch/auto_deploy/custom_ops/fused_moe/trtllm_moe.py
- tensorrt_llm/_torch/auto_deploy/transform/library/fused_moe.py
- tensorrt_llm/_torch/auto_deploy/transform/library/multi_stream_moe.py
- tests/unittest/auto_deploy/singlegpu/custom_ops/moe/test_trtllm_moe.py
- tests/unittest/auto_deploy/singlegpu/transformations/library/test_moe_fusion.py
- tests/unittest/auto_deploy/singlegpu/transformations/library/test_trtllm_gen_diag.py
artifact_dir: evidence/pull-bundles/tensorrt-llm/gh-11652
head_ref_oid: 8fd20254fda658147c1b37eb9480d22f07156e1b
---
# [None][feat] NVFP4 TRTLLM-Gen MoE for AutoDeploy (Nemotron Super)

- Repository: `NVIDIA/TensorRT-LLM`
- PR: [11652](https://github.com/NVIDIA/TensorRT-LLM/pull/11652)
- Decision: `Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.`
- Reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.

## Changed Paths

- `examples/auto_deploy/super_v3.yaml`
- `tensorrt_llm/_torch/auto_deploy/config/default.yaml`
- `tensorrt_llm/_torch/auto_deploy/custom_ops/fused_moe/trtllm_moe.py`
- `tensorrt_llm/_torch/auto_deploy/transform/library/fused_moe.py`
- `tensorrt_llm/_torch/auto_deploy/transform/library/multi_stream_moe.py`
- `tests/unittest/auto_deploy/singlegpu/custom_ops/moe/test_trtllm_moe.py`
- `tests/unittest/auto_deploy/singlegpu/transformations/library/test_moe_fusion.py`
- `tests/unittest/auto_deploy/singlegpu/transformations/library/test_trtllm_gen_diag.py`

## Evidence Bundle

`evidence/pull-bundles/tensorrt-llm/gh-11652`
