---
id: pr-tensorrt-llm-10190
repo: NVIDIA/TensorRT-LLM
pr: 10190
title: '[None][feat] sm100 weight-only kernel'
author: Njuapp
date: '2026-01-05'
url: https://github.com/NVIDIA/TensorRT-LLM/pull/10190
source_category: upstream-code
architectures:
- sm100
- sm90
tags:
- arch_pipeline
- gemm_quant
- scheduler_autotune
- sm100
- sm90
techniques:
- autotuning
- fine-grained-quantization
- pipeline-stages
- tile-scheduling
- warp-specialization
hardware_features:
- blackwell
- hopper
kernel_types:
- gemm
- runtime
- scheduler
languages:
- cuda-cpp
- cute-dsl
captured_at: '2026-05-16'
status: merged
merge_sha: 656c705ff1aba56ec1d7e3f43d52fcefe5dea5cc
inclusion_reason: 'Extract the architecture assumption first: SM target, TMA/WGMMA/tcgen path, cluster use, and pipeline stages.'
changed_paths:
- cpp/tensorrt_llm/cutlass_extensions/include/cutlass_extensions/detail/collective/mixed_input_utils.hpp
- cpp/tensorrt_llm/cutlass_extensions/include/cutlass_extensions/gemm/collective/builders/sm100_umma_builder_weightonly.inl
- cpp/tensorrt_llm/cutlass_extensions/include/cutlass_extensions/gemm/collective/collective_builder_sm100_weightonly.hpp
- cpp/tensorrt_llm/cutlass_extensions/include/cutlass_extensions/gemm/collective/collective_mma_sm100_weightonly.hpp
- cpp/tensorrt_llm/cutlass_extensions/include/cutlass_extensions/gemm/collective/sm100_mma_warpspecialized_mixed_input.hpp
- cpp/tensorrt_llm/cutlass_extensions/include/cutlass_extensions/gemm/kernel/fpA_intB_gemm.h
- cpp/tensorrt_llm/cutlass_extensions/include/cutlass_extensions/gemm/kernel/mixed_gemm_B_layout.h
- cpp/tensorrt_llm/kernels/cutlass_kernels/cutlass_heuristic.cpp
- cpp/tensorrt_llm/kernels/cutlass_kernels/cutlass_preprocessors.cpp
- cpp/tensorrt_llm/kernels/cutlass_kernels/fpA_intB_gemm/fpA_intB_gemm_template.h
- cpp/tensorrt_llm/kernels/cutlass_kernels/fpA_intB_gemm/fpA_intB_gemm_template_sm100.h
- cpp/tensorrt_llm/kernels/cutlass_kernels/fpA_intB_gemm/launchers/fpA_intB_launcher_sm100.h
- cpp/tensorrt_llm/kernels/cutlass_kernels/fpA_intB_gemm/launchers/fpA_intB_launcher_sm100.inl
- cpp/tensorrt_llm/kernels/cutlass_kernels/python/generate_kernels.py
- cpp/tensorrt_llm/kernels/weightOnlyBatchedGemv/kernelDispatcherBf16Int4GroupwiseColumnMajorFalse.cu
- cpp/tensorrt_llm/kernels/weightOnlyBatchedGemv/kernelDispatcherBf16Int4PerChannelColumnMajorFalse.cu
- tensorrt_llm/_torch/custom_ops/torch_custom_ops.py
- docs/source/features/quantization.md
artifact_dir: evidence/pull-bundles/tensorrt-llm/gh-10190
head_ref_oid: 0caa9ed6dc5ca708db65c21ccf020f746f602a1d
---
# [None][feat] sm100 weight-only kernel

- Repository: `NVIDIA/TensorRT-LLM`
- PR: [10190](https://github.com/NVIDIA/TensorRT-LLM/pull/10190)
- Decision: `Extract the architecture assumption first: SM target, TMA/WGMMA/tcgen path, cluster use, and pipeline stages.`
- Reason: Extract the architecture assumption first: SM target, TMA/WGMMA/tcgen path, cluster use, and pipeline stages.

## Changed Paths

- `cpp/tensorrt_llm/cutlass_extensions/include/cutlass_extensions/detail/collective/mixed_input_utils.hpp`
- `cpp/tensorrt_llm/cutlass_extensions/include/cutlass_extensions/gemm/collective/builders/sm100_umma_builder_weightonly.inl`
- `cpp/tensorrt_llm/cutlass_extensions/include/cutlass_extensions/gemm/collective/collective_builder_sm100_weightonly.hpp`
- `cpp/tensorrt_llm/cutlass_extensions/include/cutlass_extensions/gemm/collective/collective_mma_sm100_weightonly.hpp`
- `cpp/tensorrt_llm/cutlass_extensions/include/cutlass_extensions/gemm/collective/sm100_mma_warpspecialized_mixed_input.hpp`
- `cpp/tensorrt_llm/cutlass_extensions/include/cutlass_extensions/gemm/kernel/fpA_intB_gemm.h`
- `cpp/tensorrt_llm/cutlass_extensions/include/cutlass_extensions/gemm/kernel/mixed_gemm_B_layout.h`
- `cpp/tensorrt_llm/kernels/cutlass_kernels/cutlass_heuristic.cpp`
- `cpp/tensorrt_llm/kernels/cutlass_kernels/cutlass_preprocessors.cpp`
- `cpp/tensorrt_llm/kernels/cutlass_kernels/fpA_intB_gemm/fpA_intB_gemm_template.h`
- `cpp/tensorrt_llm/kernels/cutlass_kernels/fpA_intB_gemm/fpA_intB_gemm_template_sm100.h`
- `cpp/tensorrt_llm/kernels/cutlass_kernels/fpA_intB_gemm/launchers/fpA_intB_launcher_sm100.h`
- `cpp/tensorrt_llm/kernels/cutlass_kernels/fpA_intB_gemm/launchers/fpA_intB_launcher_sm100.inl`
- `cpp/tensorrt_llm/kernels/cutlass_kernels/python/generate_kernels.py`
- `cpp/tensorrt_llm/kernels/weightOnlyBatchedGemv/kernelDispatcherBf16Int4GroupwiseColumnMajorFalse.cu`
- `cpp/tensorrt_llm/kernels/weightOnlyBatchedGemv/kernelDispatcherBf16Int4PerChannelColumnMajorFalse.cu`
- `tensorrt_llm/_torch/custom_ops/torch_custom_ops.py`
- `docs/source/features/quantization.md`

## Evidence Bundle

`evidence/pull-bundles/tensorrt-llm/gh-10190`
