---
id: pr-tensorrt-llm-10279
repo: NVIDIA/TensorRT-LLM
pr: 10279
title: '[TRTLLM-10147][perf] Balanced random MoE workload generator for CuteDSL kernel UT, autotuner and layerwise benchmark'
author: syuoni
date: '2026-01-25'
url: https://github.com/NVIDIA/TensorRT-LLM/pull/10279
source_category: upstream-code
architectures:
- sm100
tags:
- benchmark_test
- compiler_runtime
- cute dsl
- moe_routing
techniques:
- autotuning
- kernel-fusion
hardware_features: []
kernel_types:
- compiler
- moe
languages:
- cuda-cpp
- cute-dsl
captured_at: '2026-05-16'
status: merged
merge_sha: 72ef732bcfd8875af49d3a37afe3818d80f00149
inclusion_reason: Mine shape sets, tolerance rules, warmup logic, and profile commands before mutating code.
changed_paths:
- tensorrt_llm/_torch/custom_ops/cute_dsl_custom_ops.py
- tensorrt_llm/_torch/modules/fused_moe/fused_moe_cute_dsl.py
- tensorrt_llm/tools/layer_wise_benchmarks/runner.py
- tests/scripts/cute_dsl_kernels/README.md
- tests/scripts/cute_dsl_kernels/moe_workload_generator.py
- tests/unittest/_torch/thop/parallel/test_cute_dsl_moe.py
artifact_dir: evidence/pull-bundles/tensorrt-llm/gh-10279
head_ref_oid: cdb17f34def7430fef90e4d7fd480b8d9c2ce866
---
# [TRTLLM-10147][perf] Balanced random MoE workload generator for CuteDSL kernel UT, autotuner and layerwise benchmark

- Repository: `NVIDIA/TensorRT-LLM`
- PR: [10279](https://github.com/NVIDIA/TensorRT-LLM/pull/10279)
- Decision: `Mine shape sets, tolerance rules, warmup logic, and profile commands before mutating code.`
- Reason: Mine shape sets, tolerance rules, warmup logic, and profile commands before mutating code.

## Changed Paths

- `tensorrt_llm/_torch/custom_ops/cute_dsl_custom_ops.py`
- `tensorrt_llm/_torch/modules/fused_moe/fused_moe_cute_dsl.py`
- `tensorrt_llm/tools/layer_wise_benchmarks/runner.py`
- `tests/scripts/cute_dsl_kernels/README.md`
- `tests/scripts/cute_dsl_kernels/moe_workload_generator.py`
- `tests/unittest/_torch/thop/parallel/test_cute_dsl_moe.py`

## Evidence Bundle

`evidence/pull-bundles/tensorrt-llm/gh-10279`
