---
id: pr-tensorrt-llm-13761
repo: NVIDIA/TensorRT-LLM
pr: 13761
title: '[None][perf] Optimize DeepSeek-V4 compressor BF16 input'
author: mingyangHao
date: '2026-05-07'
url: https://github.com/NVIDIA/TensorRT-LLM/pull/13761
source_category: upstream-code
architectures:
- sm100
tags:
- attention_kv
- benchmark_test
- recent-kernel-path
techniques: []
hardware_features: []
kernel_types:
- attention
- decode
languages:
- cuda-cpp
captured_at: '2026-05-16'
status: merged
merge_sha: b33d2dc528aa352d30561f54352654c2fca23c2a
inclusion_reason: Mine shape sets, tolerance rules, warmup logic, and profile commands before mutating code.
changed_paths:
- cpp/tensorrt_llm/kernels/compressorKernels/compressorKernels.cu
- cpp/tensorrt_llm/kernels/compressorKernels/compressorKernels.h
- cpp/tensorrt_llm/thop/compressorOp.cpp
- tensorrt_llm/_torch/attention_backend/sparse/deepseek_v4/compressor.py
- tests/unittest/_torch/attention/sparse/deepseek_v4/test_compressor_kernel.py
- tests/unittest/_torch/attention/sparse/deepseek_v4/test_compressor_module.py
- tests/unittest/_torch/attention/sparse/deepseek_v4/test_compressor_tf32.py
artifact_dir: evidence/pull-bundles/tensorrt-llm/gh-13761
head_ref_oid: 68e75e5a4a6a786b4666e7756665580b72bbcc82
---
# [None][perf] Optimize DeepSeek-V4 compressor BF16 input

- Repository: `NVIDIA/TensorRT-LLM`
- PR: [13761](https://github.com/NVIDIA/TensorRT-LLM/pull/13761)
- Decision: `Mine shape sets, tolerance rules, warmup logic, and profile commands before mutating code.`
- Reason: Mine shape sets, tolerance rules, warmup logic, and profile commands before mutating code.

## Changed Paths

- `cpp/tensorrt_llm/kernels/compressorKernels/compressorKernels.cu`
- `cpp/tensorrt_llm/kernels/compressorKernels/compressorKernels.h`
- `cpp/tensorrt_llm/thop/compressorOp.cpp`
- `tensorrt_llm/_torch/attention_backend/sparse/deepseek_v4/compressor.py`
- `tests/unittest/_torch/attention/sparse/deepseek_v4/test_compressor_kernel.py`
- `tests/unittest/_torch/attention/sparse/deepseek_v4/test_compressor_module.py`
- `tests/unittest/_torch/attention/sparse/deepseek_v4/test_compressor_tf32.py`

## Evidence Bundle

`evidence/pull-bundles/tensorrt-llm/gh-13761`
