---
id: pr-tensorrt-llm-13646
repo: NVIDIA/TensorRT-LLM
pr: 13646
title: '[None][perf] Use bf16 custom router GEMM kernel for DeepSeek-V4'
author: hyukn
date: '2026-05-07'
url: https://github.com/NVIDIA/TensorRT-LLM/pull/13646
source_category: upstream-code
architectures:
- sm100
tags:
- gemm
techniques: []
hardware_features: []
kernel_types:
- gemm
languages:
- cuda-cpp
captured_at: '2026-05-16'
status: merged
merge_sha: a3f37757bdf1920d7ab2455ec0cbb86bbd98f171
inclusion_reason: Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.
changed_paths:
- cpp/tensorrt_llm/kernels/dsv3MinLatencyKernels/dsv3RouterGemm.cu
- cpp/tensorrt_llm/thop/dsv3RouterGemmOp.cpp
- tensorrt_llm/_torch/models/modeling_deepseekv4.py
- tests/unittest/_torch/thop/parallel/test_dsv3_router_gemm.py
artifact_dir: evidence/pull-bundles/tensorrt-llm/gh-13646
head_ref_oid: 591f210d7792ecf05a7916cd0307522db92f6975
---
# [None][perf] Use bf16 custom router GEMM kernel for DeepSeek-V4

- Repository: `NVIDIA/TensorRT-LLM`
- PR: [13646](https://github.com/NVIDIA/TensorRT-LLM/pull/13646)
- Decision: `Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.`
- Reason: Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.

## Changed Paths

- `cpp/tensorrt_llm/kernels/dsv3MinLatencyKernels/dsv3RouterGemm.cu`
- `cpp/tensorrt_llm/thop/dsv3RouterGemmOp.cpp`
- `tensorrt_llm/_torch/models/modeling_deepseekv4.py`
- `tests/unittest/_torch/thop/parallel/test_dsv3_router_gemm.py`

## Evidence Bundle

`evidence/pull-bundles/tensorrt-llm/gh-13646`
