---
id: pr-tensorrt-llm-7937
repo: NVIDIA/TensorRT-LLM
pr: 7937
title: '[None][feat] GPT-OSS Sm120/Sm121 Support'
author: farazkh80
date: '2025-10-06'
url: https://github.com/NVIDIA/TensorRT-LLM/pull/7937
source_category: upstream-code
architectures:
- sm100
- sm90
tags:
- arch_pipeline
- attention_kv
- benchmark_test
- cutlass
- gemm_quant
- memory_primitives
- sm90
techniques:
- fine-grained-quantization
- kernel-fusion
- pipeline-stages
hardware_features:
- fp4
- fp8
- hopper
kernel_types:
- attention
- gemm
- memory
- runtime
languages:
- cuda-cpp
- cute-dsl
captured_at: '2026-05-16'
status: merged
merge_sha: 27a5091fcb9410ebcb019bcc785d94c1bed86a13
inclusion_reason: Preserve page/KV/layout and plan-run contracts; profile memory traffic separately from math utilization.
changed_paths:
- cpp/include/tensorrt_llm/common/cudaUtils.h
- cpp/kernels/fmha_v2/fmha_test.py
- cpp/kernels/fmha_v2/src/fmha/fragment.h
- cpp/kernels/fmha_v2/src/fused_multihead_flash_attention_kernel_noloop.h
- cpp/kernels/fmha_v2/src/fused_multihead_flash_attention_kernel_noloop_tiled.h
- cpp/tensorrt_llm/common/cublasMMWrapper.cpp
- cpp/tensorrt_llm/common/cublasMMWrapper.h
- cpp/tensorrt_llm/cutlass_extensions/include/cutlass_extensions/gemm_configs.h
- cpp/tensorrt_llm/kernels/contextFusedMultiHeadAttention/cubin/fmha_v2_flash_attention_bf16_64_128_S_qkv_128_sm90.cubin.cpp
- cpp/tensorrt_llm/kernels/contextFusedMultiHeadAttention/cubin/fmha_v2_flash_attention_bf16_64_128_S_qkv_128_softcapping_sm90.cubin.cpp
- cpp/tensorrt_llm/kernels/contextFusedMultiHeadAttention/cubin/fmha_v2_flash_attention_bf16_64_32_S_qkv_128_sm90.cubin.cpp
- cpp/tensorrt_llm/kernels/contextFusedMultiHeadAttention/cubin/fmha_v2_flash_attention_bf16_64_32_S_qkv_128_softcapping_sm90.cubin.cpp
- cpp/tensorrt_llm/kernels/contextFusedMultiHeadAttention/cubin/fmha_v2_flash_attention_e4m3_fp32_128_128_S_q_kv_32_sm89.cubin.cpp
- cpp/tensorrt_llm/kernels/contextFusedMultiHeadAttention/cubin/fmha_v2_flash_attention_e4m3_fp32_128_128_S_q_kv_64_sm89.cubin.cpp
- cpp/tensorrt_llm/kernels/contextFusedMultiHeadAttention/cubin/fmha_v2_flash_attention_e4m3_fp32_128_128_S_q_paged_kv_32_sm89.cubin.cpp
- cpp/tensorrt_llm/kernels/contextFusedMultiHeadAttention/cubin/fmha_v2_flash_attention_e4m3_fp32_128_128_S_q_paged_kv_40_sm89.cubin.cpp
artifact_dir: evidence/pull-bundles/tensorrt-llm/gh-7937
head_ref_oid: 15e86da5521b24d35b321411b83f3171932bd1a2
---
# [None][feat] GPT-OSS Sm120/Sm121 Support

- Repository: `NVIDIA/TensorRT-LLM`
- PR: [7937](https://github.com/NVIDIA/TensorRT-LLM/pull/7937)
- Decision: `Preserve page/KV/layout and plan-run contracts; profile memory traffic separately from math utilization.`
- Reason: Preserve page/KV/layout and plan-run contracts; profile memory traffic separately from math utilization.

## Changed Paths

- `cpp/include/tensorrt_llm/common/cudaUtils.h`
- `cpp/kernels/fmha_v2/fmha_test.py`
- `cpp/kernels/fmha_v2/src/fmha/fragment.h`
- `cpp/kernels/fmha_v2/src/fused_multihead_flash_attention_kernel_noloop.h`
- `cpp/kernels/fmha_v2/src/fused_multihead_flash_attention_kernel_noloop_tiled.h`
- `cpp/tensorrt_llm/common/cublasMMWrapper.cpp`
- `cpp/tensorrt_llm/common/cublasMMWrapper.h`
- `cpp/tensorrt_llm/cutlass_extensions/include/cutlass_extensions/gemm_configs.h`
- `cpp/tensorrt_llm/kernels/contextFusedMultiHeadAttention/cubin/fmha_v2_flash_attention_bf16_64_128_S_qkv_128_sm90.cubin.cpp`
- `cpp/tensorrt_llm/kernels/contextFusedMultiHeadAttention/cubin/fmha_v2_flash_attention_bf16_64_128_S_qkv_128_softcapping_sm90.cubin.cpp`
- `cpp/tensorrt_llm/kernels/contextFusedMultiHeadAttention/cubin/fmha_v2_flash_attention_bf16_64_32_S_qkv_128_sm90.cubin.cpp`
- `cpp/tensorrt_llm/kernels/contextFusedMultiHeadAttention/cubin/fmha_v2_flash_attention_bf16_64_32_S_qkv_128_softcapping_sm90.cubin.cpp`
- `cpp/tensorrt_llm/kernels/contextFusedMultiHeadAttention/cubin/fmha_v2_flash_attention_e4m3_fp32_128_128_S_q_kv_32_sm89.cubin.cpp`
- `cpp/tensorrt_llm/kernels/contextFusedMultiHeadAttention/cubin/fmha_v2_flash_attention_e4m3_fp32_128_128_S_q_kv_64_sm89.cubin.cpp`
- `cpp/tensorrt_llm/kernels/contextFusedMultiHeadAttention/cubin/fmha_v2_flash_attention_e4m3_fp32_128_128_S_q_paged_kv_32_sm89.cubin.cpp`
- `cpp/tensorrt_llm/kernels/contextFusedMultiHeadAttention/cubin/fmha_v2_flash_attention_e4m3_fp32_128_128_S_q_paged_kv_40_sm89.cubin.cpp`

## Evidence Bundle

`evidence/pull-bundles/tensorrt-llm/gh-7937`
