---
id: pr-tensorrt-llm-13997
repo: NVIDIA/TensorRT-LLM
pr: 13997
title: '[None][feat] enable TRTLLM-Gen internal routing'
author: tcherckez-nvidia
date: '2026-05-13'
url: https://github.com/NVIDIA/TensorRT-LLM/pull/13997
source_category: upstream-code
architectures:
- sm100
tags:
- benchmark_test
- moe
- moe_routing
- nvfp4
- routing
- scheduler_autotune
techniques:
- autotuning
- kernel-fusion
- tile-scheduling
hardware_features:
- fp4
- nvfp4
kernel_types:
- moe
- scheduler
languages:
- cuda-cpp
captured_at: '2026-05-16'
status: merged
merge_sha: 2fd65a5fa1999275f582dd7b9759bf0864c15b9e
inclusion_reason: Separate routing, permutation, top-k, and expert GEMM costs; keep tail-token and expert-layout tests attached to the idea.
changed_paths:
- examples/auto_deploy/model_registry/configs/super_v3.yaml
- tensorrt_llm/_torch/auto_deploy/custom_ops/fused_moe/trtllm_moe.py
- tensorrt_llm/_torch/auto_deploy/transform/library/fused_moe.py
- tensorrt_llm/_torch/auto_deploy/transform/library/multi_stream_moe.py
- tests/unittest/auto_deploy/singlegpu/transformations/library/test_moe_fusion.py
artifact_dir: evidence/pull-bundles/tensorrt-llm/gh-13997
head_ref_oid: 341c7254b28110bbea47fe124b326ab978cc6e47
---
# [None][feat] enable TRTLLM-Gen internal routing

- Repository: `NVIDIA/TensorRT-LLM`
- PR: [13997](https://github.com/NVIDIA/TensorRT-LLM/pull/13997)
- Decision: `Separate routing, permutation, top-k, and expert GEMM costs; keep tail-token and expert-layout tests attached to the idea.`
- Reason: Separate routing, permutation, top-k, and expert GEMM costs; keep tail-token and expert-layout tests attached to the idea.

## Changed Paths

- `examples/auto_deploy/model_registry/configs/super_v3.yaml`
- `tensorrt_llm/_torch/auto_deploy/custom_ops/fused_moe/trtllm_moe.py`
- `tensorrt_llm/_torch/auto_deploy/transform/library/fused_moe.py`
- `tensorrt_llm/_torch/auto_deploy/transform/library/multi_stream_moe.py`
- `tests/unittest/auto_deploy/singlegpu/transformations/library/test_moe_fusion.py`

## Evidence Bundle

`evidence/pull-bundles/tensorrt-llm/gh-13997`
