---
id: pr-tensorrt-llm-13938
repo: NVIDIA/TensorRT-LLM
pr: 13938
title: '[None][feat] Keep DSv4 o_a_proj as FP8, and port vLLM''s fused_inv_rope_fp8_quant'
author: lishicheng1996-nv
date: '2026-05-10'
url: https://github.com/NVIDIA/TensorRT-LLM/pull/13938
source_category: upstream-code
architectures:
- sm100
- sm90
tags:
- MLA
- attention kernel
- attention_kv
- blackwell
- cute dsl
- fp8
- gemm_quant
- hopper
- sm100
techniques:
- fine-grained-quantization
- kernel-fusion
hardware_features:
- blackwell
- fp8
- hopper
kernel_types:
- attention
- gemm
- mla
- moe
languages:
- cuda-cpp
- cute-dsl
- triton
captured_at: '2026-05-16'
status: merged
merge_sha: 59b88e3694935d56287b5c0a21870e6fb2683a2d
inclusion_reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.
changed_paths:
- tensorrt_llm/_torch/custom_ops/__init__.py
- tensorrt_llm/_torch/custom_ops/triton_fused_inv_rope_fp8_quant.py
- tensorrt_llm/_torch/models/modeling_deepseekv4.py
- tensorrt_llm/_torch/modules/attention.py
- tests/unittest/_torch/custom_ops/test_fused_inv_rope_fp8_quant.py
artifact_dir: evidence/pull-bundles/tensorrt-llm/gh-13938
head_ref_oid: 6997a88ee8d93f01d9fa7485b63f6bec07003ae5
---
# [None][feat] Keep DSv4 o_a_proj as FP8, and port vLLM's fused_inv_rope_fp8_quant

- Repository: `NVIDIA/TensorRT-LLM`
- PR: [13938](https://github.com/NVIDIA/TensorRT-LLM/pull/13938)
- Decision: `Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.`
- Reason: Inspect scale layout, accumulator type, tile/schedule choice, epilogue fusion, and partial-tile guards before deriving a candidate.

## Changed Paths

- `tensorrt_llm/_torch/custom_ops/__init__.py`
- `tensorrt_llm/_torch/custom_ops/triton_fused_inv_rope_fp8_quant.py`
- `tensorrt_llm/_torch/models/modeling_deepseekv4.py`
- `tensorrt_llm/_torch/modules/attention.py`
- `tests/unittest/_torch/custom_ops/test_fused_inv_rope_fp8_quant.py`

## Evidence Bundle

`evidence/pull-bundles/tensorrt-llm/gh-13938`
