---
id: pr-tensorrt-llm-12911
repo: NVIDIA/TensorRT-LLM
pr: 12911
title: '[TRTLLM-11794][feat] Optimize ViT Attention kernel on Nemotron'
author: yechank-nvidia
date: '2026-04-17'
url: https://github.com/NVIDIA/TensorRT-LLM/pull/12911
source_category: upstream-code
architectures:
- sm100
tags:
- attention kernel
techniques: []
hardware_features: []
kernel_types:
- attention
languages:
- cuda-cpp
captured_at: '2026-05-16'
status: merged
merge_sha: 2a0bcb17d3aab1b656536d7f06050cef600ecd64
inclusion_reason: Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.
changed_paths:
- tensorrt_llm/_torch/attention_backend/flashinfer.py
- tensorrt_llm/_torch/attention_backend/interface.py
- tensorrt_llm/_torch/models/modeling_multimodal_utils.py
- tensorrt_llm/_torch/models/modeling_nemotron_nano.py
- tensorrt_llm/_torch/models/modeling_radio.py
- tests/unittest/_torch/attention/test_flashinfer_attention.py
- tests/unittest/_torch/modeling/test_modeling_nemotron_nano_v2_vl.py
artifact_dir: evidence/pull-bundles/tensorrt-llm/gh-12911
head_ref_oid: 9ef200d7bca897b1e5e3e50a2c977adfb3ddafa3
---
# [TRTLLM-11794][feat] Optimize ViT Attention kernel on Nemotron

- Repository: `NVIDIA/TensorRT-LLM`
- PR: [12911](https://github.com/NVIDIA/TensorRT-LLM/pull/12911)
- Decision: `Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.`
- Reason: Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.

## Changed Paths

- `tensorrt_llm/_torch/attention_backend/flashinfer.py`
- `tensorrt_llm/_torch/attention_backend/interface.py`
- `tensorrt_llm/_torch/models/modeling_multimodal_utils.py`
- `tensorrt_llm/_torch/models/modeling_nemotron_nano.py`
- `tensorrt_llm/_torch/models/modeling_radio.py`
- `tests/unittest/_torch/attention/test_flashinfer_attention.py`
- `tests/unittest/_torch/modeling/test_modeling_nemotron_nano_v2_vl.py`

## Evidence Bundle

`evidence/pull-bundles/tensorrt-llm/gh-12911`
