---
id: pr-tensorrt-llm-13149
repo: NVIDIA/TensorRT-LLM
pr: 13149
title: '[TRTLLM-11958][perf] reduce @torch.library.custom_op host overhead'
author: luyiyun1021
date: '2026-04-24'
url: https://github.com/NVIDIA/TensorRT-LLM/pull/13149
source_category: upstream-code
architectures:
- sm100
tags:
- cuda kernel
- gemm
- nvfp4
techniques: []
hardware_features:
- fp4
- nvfp4
kernel_types:
- gemm
languages:
- cuda-cpp
captured_at: '2026-05-16'
status: merged
merge_sha: 95db86891de30d7d236d2ca051259d5e07c17d7f
inclusion_reason: Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.
changed_paths:
- tensorrt_llm/_torch/custom_ops/fast_custom_op.py
- tensorrt_llm/_torch/custom_ops/torch_custom_ops.py
artifact_dir: evidence/pull-bundles/tensorrt-llm/gh-13149
head_ref_oid: bc098214a4bf8bb2e2170e72b2faa232db54c6d9
---
# [TRTLLM-11958][perf] reduce @torch.library.custom_op host overhead

- Repository: `NVIDIA/TensorRT-LLM`
- PR: [13149](https://github.com/NVIDIA/TensorRT-LLM/pull/13149)
- Decision: `Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.`
- Reason: Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.

## Changed Paths

- `tensorrt_llm/_torch/custom_ops/fast_custom_op.py`
- `tensorrt_llm/_torch/custom_ops/torch_custom_ops.py`

## Evidence Bundle

`evidence/pull-bundles/tensorrt-llm/gh-13149`
