---
id: pr-tensorrt-llm-10742
repo: NVIDIA/TensorRT-LLM
pr: 10742
title: '[https://nvbugs/5669671][fix] Support GuidedDecoder with sharded logits (pick #10698)'
author: syuoni
date: '2026-01-16'
url: https://github.com/NVIDIA/TensorRT-LLM/pull/10742
source_category: upstream-code
architectures:
- sm100
tags:
- arch_pipeline
- attention_kv
- blockScaleMoe
techniques:
- async-copy
- pipeline-stages
hardware_features:
- tma
kernel_types:
- attention
- decode
- moe
- runtime
languages:
- cuda-cpp
captured_at: '2026-05-16'
status: merged
merge_sha: e87a406243fca6c6c3f308d9fb22b29b8f2c38f1
inclusion_reason: Preserve page/KV/layout and plan-run contracts; profile memory traffic separately from math utilization.
changed_paths:
- cpp/tensorrt_llm/kernels/logitsBitmask.cu
- cpp/tensorrt_llm/kernels/logitsBitmask.h
- cpp/tensorrt_llm/thop/logitsBitmaskOp.cpp
- tensorrt_llm/_torch/pyexecutor/guided_decoder.py
- tensorrt_llm/_torch/pyexecutor/py_executor_creator.py
artifact_dir: evidence/pull-bundles/tensorrt-llm/gh-10742
head_ref_oid: a6e3ff4719459cc20d85d6dc14b3d5352be5051b
---
# [https://nvbugs/5669671][fix] Support GuidedDecoder with sharded logits (pick #10698)

- Repository: `NVIDIA/TensorRT-LLM`
- PR: [10742](https://github.com/NVIDIA/TensorRT-LLM/pull/10742)
- Decision: `Preserve page/KV/layout and plan-run contracts; profile memory traffic separately from math utilization.`
- Reason: Preserve page/KV/layout and plan-run contracts; profile memory traffic separately from math utilization.

## Changed Paths

- `cpp/tensorrt_llm/kernels/logitsBitmask.cu`
- `cpp/tensorrt_llm/kernels/logitsBitmask.h`
- `cpp/tensorrt_llm/thop/logitsBitmaskOp.cpp`
- `tensorrt_llm/_torch/pyexecutor/guided_decoder.py`
- `tensorrt_llm/_torch/pyexecutor/py_executor_creator.py`

## Evidence Bundle

`evidence/pull-bundles/tensorrt-llm/gh-10742`
