---
id: pr-tensorrt-llm-8886
repo: NVIDIA/TensorRT-LLM
pr: 8886
title: '[None][feat] Enable EPLB for trtllm-gen and cutlass backend'
author: dongxuy04
date: '2025-11-12'
url: https://github.com/NVIDIA/TensorRT-LLM/pull/8886
source_category: upstream-code
architectures:
- sm100
tags:
- arch_pipeline
- benchmark_test
- compiler_runtime
- gemm_quant
- moe_routing
- trtllmgen
techniques:
- fine-grained-quantization
- kernel-fusion
- pipeline-stages
hardware_features: []
kernel_types:
- compiler
- gemm
- moe
- runtime
languages:
- cuda-cpp
- cute-dsl
captured_at: '2026-05-16'
status: merged
merge_sha: 9241ccaf2770aa71fa2435c45c2019b507cf82a1
inclusion_reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.
changed_paths:
- tensorrt_llm/_torch/models/modeling_gpt_oss.py
- tensorrt_llm/_torch/modules/fused_moe/create_moe.py
- tensorrt_llm/_torch/modules/fused_moe/fused_moe_cute_dsl.py
- tensorrt_llm/_torch/modules/fused_moe/fused_moe_cutlass.py
- tensorrt_llm/_torch/modules/fused_moe/fused_moe_trtllm_gen.py
- tensorrt_llm/_torch/modules/fused_moe/fused_moe_wide_ep.py
- tensorrt_llm/_torch/modules/fused_moe/interface.py
- tensorrt_llm/_torch/modules/fused_moe/moe_load_balancer.py
- tensorrt_llm/_torch/modules/fused_moe/quantization.py
- tests/integration/defs/.test_durations
- tests/integration/defs/accuracy/test_llm_api_pytorch.py
- tests/integration/test_lists/qa/llm_function_core.txt
- tests/integration/test_lists/qa/llm_function_core_sanity.txt
- tests/integration/test_lists/qa/llm_function_nim.txt
- tests/integration/test_lists/test-db/l0_gb200_multi_gpus.yml
- tests/integration/test_lists/test-db/l0_gb300_multi_gpus.yml
- tests/integration/test_lists/test-db/l0_rtx_pro_6000.yml
artifact_dir: evidence/pull-bundles/tensorrt-llm/gh-8886
head_ref_oid: 83782760e8e658d3e74d0f7315260221cbece487
---
# [None][feat] Enable EPLB for trtllm-gen and cutlass backend

- Repository: `NVIDIA/TensorRT-LLM`
- PR: [8886](https://github.com/NVIDIA/TensorRT-LLM/pull/8886)
- Decision: `Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.`
- Reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.

## Changed Paths

- `tensorrt_llm/_torch/models/modeling_gpt_oss.py`
- `tensorrt_llm/_torch/modules/fused_moe/create_moe.py`
- `tensorrt_llm/_torch/modules/fused_moe/fused_moe_cute_dsl.py`
- `tensorrt_llm/_torch/modules/fused_moe/fused_moe_cutlass.py`
- `tensorrt_llm/_torch/modules/fused_moe/fused_moe_trtllm_gen.py`
- `tensorrt_llm/_torch/modules/fused_moe/fused_moe_wide_ep.py`
- `tensorrt_llm/_torch/modules/fused_moe/interface.py`
- `tensorrt_llm/_torch/modules/fused_moe/moe_load_balancer.py`
- `tensorrt_llm/_torch/modules/fused_moe/quantization.py`
- `tests/integration/defs/.test_durations`
- `tests/integration/defs/accuracy/test_llm_api_pytorch.py`
- `tests/integration/test_lists/qa/llm_function_core.txt`
- `tests/integration/test_lists/qa/llm_function_core_sanity.txt`
- `tests/integration/test_lists/qa/llm_function_nim.txt`
- `tests/integration/test_lists/test-db/l0_gb200_multi_gpus.yml`
- `tests/integration/test_lists/test-db/l0_gb300_multi_gpus.yml`
- `tests/integration/test_lists/test-db/l0_rtx_pro_6000.yml`

## Evidence Bundle

`evidence/pull-bundles/tensorrt-llm/gh-8886`
