---
id: pr-tensorrt-llm-8405
repo: NVIDIA/TensorRT-LLM
pr: 8405
title: '[TRTLLM-8535][feat] Support DeepSeek V3.2 with FP8 + BF16 KV cache/NVFP4 + BF16 KV cache'
author: chang-l
date: '2025-10-24'
url: https://github.com/NVIDIA/TensorRT-LLM/pull/8405
source_category: upstream-code
architectures:
- sm100
tags:
- attention_kv
- gemm_quant
- paged MQA
techniques:
- cache-policy
- fine-grained-quantization
hardware_features:
- fp4
- fp8
- nvfp4
kernel_types:
- attention
- gemm
- mla
- norm
languages:
- cuda-cpp
captured_at: '2026-05-16'
status: merged
merge_sha: e47c787dd702e498a3b0a4ec2322ed9163df9255
inclusion_reason: Preserve page/KV/layout and plan-run contracts; profile memory traffic separately from math utilization.
changed_paths:
- .gitignore
- .gitmodules
- 3rdparty/flash-mla
- cpp/CMakeLists.txt
- cpp/tensorrt_llm/CMakeLists.txt
- cpp/tensorrt_llm/flash_mla/CMakeLists.txt
- cpp/tensorrt_llm/flash_mla/flash_mla_cpp_tllm.version
- examples/llm-api/llm_sparse_attention.py
- examples/longbench/eval_longbench_v1.py
- scripts/build_wheel.py
- setup.py
- tensorrt_llm/_torch/attention_backend/interface.py
- tensorrt_llm/_torch/attention_backend/sparse/dsa.py
- tensorrt_llm/_torch/attention_backend/sparse/kernel.py
- tensorrt_llm/_torch/attention_backend/sparse/rocket.py
- tensorrt_llm/_torch/attention_backend/sparse/utils.py
- tensorrt_llm/_torch/attention_backend/trtllm.py
- tensorrt_llm/_torch/attention_backend/utils.py
- tensorrt_llm/_torch/models/modeling_deepseekv3.py
- tensorrt_llm/_torch/modules/attention.py
- tensorrt_llm/_torch/modules/layer_norm.py
- tensorrt_llm/_torch/configs/__init__.py
- tensorrt_llm/_torch/configs/deepseek_v3.py
- tensorrt_llm/_torch/model_config.py
- tensorrt_llm/_torch/pyexecutor/_util.py
- tensorrt_llm/_torch/pyexecutor/model_engine.py
- tensorrt_llm/_torch/pyexecutor/py_executor_creator.py
- tensorrt_llm/_torch/pyexecutor/resource_manager.py
- tensorrt_llm/_torch/speculative/mtp.py
- tensorrt_llm/llmapi/__init__.py
- tensorrt_llm/llmapi/llm_args.py
artifact_dir: evidence/pull-bundles/tensorrt-llm/gh-8405
head_ref_oid: a43cf9e363d5657061b5ce0e12f3d993a08d8158
---
# [TRTLLM-8535][feat] Support DeepSeek V3.2 with FP8 + BF16 KV cache/NVFP4 + BF16 KV cache

- Repository: `NVIDIA/TensorRT-LLM`
- PR: [8405](https://github.com/NVIDIA/TensorRT-LLM/pull/8405)
- Decision: `Preserve page/KV/layout and plan-run contracts; profile memory traffic separately from math utilization.`
- Reason: Preserve page/KV/layout and plan-run contracts; profile memory traffic separately from math utilization.

## Changed Paths

- `.gitignore`
- `.gitmodules`
- `3rdparty/flash-mla`
- `cpp/CMakeLists.txt`
- `cpp/tensorrt_llm/CMakeLists.txt`
- `cpp/tensorrt_llm/flash_mla/CMakeLists.txt`
- `cpp/tensorrt_llm/flash_mla/flash_mla_cpp_tllm.version`
- `examples/llm-api/llm_sparse_attention.py`
- `examples/longbench/eval_longbench_v1.py`
- `scripts/build_wheel.py`
- `setup.py`
- `tensorrt_llm/_torch/attention_backend/interface.py`
- `tensorrt_llm/_torch/attention_backend/sparse/dsa.py`
- `tensorrt_llm/_torch/attention_backend/sparse/kernel.py`
- `tensorrt_llm/_torch/attention_backend/sparse/rocket.py`
- `tensorrt_llm/_torch/attention_backend/sparse/utils.py`
- `tensorrt_llm/_torch/attention_backend/trtllm.py`
- `tensorrt_llm/_torch/attention_backend/utils.py`
- `tensorrt_llm/_torch/models/modeling_deepseekv3.py`
- `tensorrt_llm/_torch/modules/attention.py`
- `tensorrt_llm/_torch/modules/layer_norm.py`
- `tensorrt_llm/_torch/configs/__init__.py`
- `tensorrt_llm/_torch/configs/deepseek_v3.py`
- `tensorrt_llm/_torch/model_config.py`
- `tensorrt_llm/_torch/pyexecutor/_util.py`
- `tensorrt_llm/_torch/pyexecutor/model_engine.py`
- `tensorrt_llm/_torch/pyexecutor/py_executor_creator.py`
- `tensorrt_llm/_torch/pyexecutor/resource_manager.py`
- `tensorrt_llm/_torch/speculative/mtp.py`
- `tensorrt_llm/llmapi/__init__.py`
- `tensorrt_llm/llmapi/llm_args.py`

## Evidence Bundle

`evidence/pull-bundles/tensorrt-llm/gh-8405`
