---
id: pr-tensorrt-llm-13767
repo: NVIDIA/TensorRT-LLM
pr: 13767
title: '[None][fix] Plumb swiglu_limit through DeepGEMM and TRTLLMGen FP8 fused MoE'
author: Barry-Delaney
date: '2026-05-07'
url: https://github.com/NVIDIA/TensorRT-LLM/pull/13767
source_category: upstream-code
architectures:
- sm100
tags:
- blackwell
- blockScaleMoe
- cuda kernel
- fp8
- gemm_quant
- moe
- moe_routing
- trtllmgen
techniques:
- fine-grained-quantization
- kernel-fusion
hardware_features:
- blackwell
- fp8
kernel_types:
- gemm
- moe
languages:
- cuda-cpp
- cute-dsl
- triton
captured_at: '2026-05-16'
status: merged
merge_sha: 1a52b727bf7dc3d0ee97490fae1e635e9e04e57a
inclusion_reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.
changed_paths:
- cpp/tensorrt_llm/kernels/trtllmGenKernels/blockScaleMoe/DevKernel.cu
- cpp/tensorrt_llm/kernels/trtllmGenKernels/blockScaleMoe/DevKernel.h
- cpp/tensorrt_llm/kernels/trtllmGenKernels/blockScaleMoe/runner.cu
- cpp/tensorrt_llm/kernels/trtllmGenKernels/blockScaleMoe/runner.h
- cpp/tensorrt_llm/thop/fp8BlockScaleMoe.cpp
- tensorrt_llm/_torch/custom_ops/trtllm_gen_custom_ops.py
- tensorrt_llm/_torch/models/modeling_deepseekv4.py
- tensorrt_llm/_torch/modules/fused_moe/configurable_moe.py
- tensorrt_llm/_torch/modules/fused_moe/create_moe.py
- tensorrt_llm/_torch/modules/fused_moe/fused_moe_cutlass.py
- tensorrt_llm/_torch/modules/fused_moe/fused_moe_deepgemm.py
- tensorrt_llm/_torch/modules/fused_moe/fused_moe_trtllm_gen.py
- tensorrt_llm/_torch/modules/fused_moe/fused_moe_wide_ep.py
- tensorrt_llm/_torch/modules/fused_moe/interface.py
- tensorrt_llm/_torch/modules/fused_moe/moe_op_backend.py
- tensorrt_llm/_torch/modules/fused_moe/ops/moe_op_deepgemm.py
- tests/integration/defs/accuracy/test_llm_api_pytorch.py
- tests/integration/test_lists/test-db/l0_dgx_b300_ds.yml
- tests/integration/test_lists/waives.txt
artifact_dir: evidence/pull-bundles/tensorrt-llm/gh-13767
head_ref_oid: 865c8b6b33c08383e0f04f6dd472bec5432709fe
---
# [None][fix] Plumb swiglu_limit through DeepGEMM and TRTLLMGen FP8 fused MoE

- Repository: `NVIDIA/TensorRT-LLM`
- PR: [13767](https://github.com/NVIDIA/TensorRT-LLM/pull/13767)
- Decision: `Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.`
- Reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.

## Changed Paths

- `cpp/tensorrt_llm/kernels/trtllmGenKernels/blockScaleMoe/DevKernel.cu`
- `cpp/tensorrt_llm/kernels/trtllmGenKernels/blockScaleMoe/DevKernel.h`
- `cpp/tensorrt_llm/kernels/trtllmGenKernels/blockScaleMoe/runner.cu`
- `cpp/tensorrt_llm/kernels/trtllmGenKernels/blockScaleMoe/runner.h`
- `cpp/tensorrt_llm/thop/fp8BlockScaleMoe.cpp`
- `tensorrt_llm/_torch/custom_ops/trtllm_gen_custom_ops.py`
- `tensorrt_llm/_torch/models/modeling_deepseekv4.py`
- `tensorrt_llm/_torch/modules/fused_moe/configurable_moe.py`
- `tensorrt_llm/_torch/modules/fused_moe/create_moe.py`
- `tensorrt_llm/_torch/modules/fused_moe/fused_moe_cutlass.py`
- `tensorrt_llm/_torch/modules/fused_moe/fused_moe_deepgemm.py`
- `tensorrt_llm/_torch/modules/fused_moe/fused_moe_trtllm_gen.py`
- `tensorrt_llm/_torch/modules/fused_moe/fused_moe_wide_ep.py`
- `tensorrt_llm/_torch/modules/fused_moe/interface.py`
- `tensorrt_llm/_torch/modules/fused_moe/moe_op_backend.py`
- `tensorrt_llm/_torch/modules/fused_moe/ops/moe_op_deepgemm.py`
- `tests/integration/defs/accuracy/test_llm_api_pytorch.py`
- `tests/integration/test_lists/test-db/l0_dgx_b300_ds.yml`
- `tests/integration/test_lists/waives.txt`

## Evidence Bundle

`evidence/pull-bundles/tensorrt-llm/gh-13767`
