---
id: pr-tensorrt-llm-12866
repo: NVIDIA/TensorRT-LLM
pr: 12866
title: '[None][feat] AutoDeploy: Onboard google/gemma-4-31B-it dense model, including nvfp4'
author: suyoggupta
date: '2026-04-11'
url: https://github.com/NVIDIA/TensorRT-LLM/pull/12866
source_category: upstream-code
architectures:
- sm100
tags:
- tma
techniques:
- async-copy
hardware_features:
- fp4
- nvfp4
- tma
kernel_types:
- gemm
languages: []
captured_at: '2026-05-16'
status: merged
merge_sha: 2f02816c2994f1ea50fe26a1097f22889da19aa3
inclusion_reason: Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.
changed_paths:
- docs/source/models/supported-models.md
- examples/auto_deploy/model_registry/configs/gemma4_dense.yaml
- examples/auto_deploy/model_registry/models.yaml
- tensorrt_llm/_torch/auto_deploy/custom_ops/attention/triton_paged_attention.py
- tensorrt_llm/_torch/auto_deploy/models/quant_config_reader.py
- tests/unittest/_torch/auto_deploy/unit/singlegpu/models/test_gemma4_modeling.py
- tests/unittest/auto_deploy/singlegpu/custom_ops/attention/test_triton_paged_attention.py
artifact_dir: evidence/pull-bundles/tensorrt-llm/gh-12866
head_ref_oid: 986cff1a2f7c0b0f5dce0d23bf84968b73e43e6e
---
# [None][feat] AutoDeploy: Onboard google/gemma-4-31B-it dense model, including nvfp4

- Repository: `NVIDIA/TensorRT-LLM`
- PR: [12866](https://github.com/NVIDIA/TensorRT-LLM/pull/12866)
- Decision: `Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.`
- Reason: Search-matched CUDA kernel optimization PR; materialize diff/source before synthesis.

## Changed Paths

- `docs/source/models/supported-models.md`
- `examples/auto_deploy/model_registry/configs/gemma4_dense.yaml`
- `examples/auto_deploy/model_registry/models.yaml`
- `tensorrt_llm/_torch/auto_deploy/custom_ops/attention/triton_paged_attention.py`
- `tensorrt_llm/_torch/auto_deploy/models/quant_config_reader.py`
- `tests/unittest/_torch/auto_deploy/unit/singlegpu/models/test_gemma4_modeling.py`
- `tests/unittest/auto_deploy/singlegpu/custom_ops/attention/test_triton_paged_attention.py`

## Evidence Bundle

`evidence/pull-bundles/tensorrt-llm/gh-12866`
