---
id: pr-tensorrt-llm-9175
repo: NVIDIA/TensorRT-LLM
pr: 9175
title: '[None][feat] TRT-LLM Gen MoE optimize DeepSeek Fp8 activation kernel'
author: nekorobov
date: '2025-11-21'
url: https://github.com/NVIDIA/TensorRT-LLM/pull/9175
source_category: upstream-code
architectures:
- sm100
tags:
- blockScaleMoe
- gemm_quant
- moe_routing
- norm_elementwise
techniques:
- fine-grained-quantization
- vectorized-loads
hardware_features:
- fp8
kernel_types:
- gemm
- moe
- norm
languages:
- cuda-cpp
captured_at: '2026-05-16'
status: merged
merge_sha: f2ebaf288a19d3a50d2cb1fb01e02f6fba0954da
inclusion_reason: Separate routing, permutation, top-k, and expert GEMM costs; keep tail-token and expert-layout tests attached to the idea.
changed_paths:
- cpp/tensorrt_llm/kernels/trtllmGenKernels/blockScaleMoe/DevKernel.cu
- cpp/tensorrt_llm/kernels/trtllmGenKernels/blockScaleMoe/DevKernel.h
artifact_dir: evidence/pull-bundles/tensorrt-llm/gh-9175
head_ref_oid: d47538380148551c04c67db714de12782e77be98
---
# [None][feat] TRT-LLM Gen MoE optimize DeepSeek Fp8 activation kernel

- Repository: `NVIDIA/TensorRT-LLM`
- PR: [9175](https://github.com/NVIDIA/TensorRT-LLM/pull/9175)
- Decision: `Separate routing, permutation, top-k, and expert GEMM costs; keep tail-token and expert-layout tests attached to the idea.`
- Reason: Separate routing, permutation, top-k, and expert GEMM costs; keep tail-token and expert-layout tests attached to the idea.

## Changed Paths

- `cpp/tensorrt_llm/kernels/trtllmGenKernels/blockScaleMoe/DevKernel.cu`
- `cpp/tensorrt_llm/kernels/trtllmGenKernels/blockScaleMoe/DevKernel.h`

## Evidence Bundle

`evidence/pull-bundles/tensorrt-llm/gh-9175`
