---
id: pr-tensorrt-llm-13570
repo: NVIDIA/TensorRT-LLM
pr: 13570
title: '[TRTLLM-12128][feat] enable SageAttention for Wan/FLUX (new commits)'
author: xrq-phys
date: '2026-05-12'
url: https://github.com/NVIDIA/TensorRT-LLM/pull/13570
source_category: upstream-code
architectures:
- sm100
tags:
- attention kernel
- attention_kv
- benchmark kernel
- benchmark_test
- nvfp4
- scheduler_autotune
techniques:
- autotuning
- pipeline-stages
- tile-scheduling
hardware_features:
- fp4
- nvfp4
kernel_types:
- attention
- scheduler
languages:
- cuda-cpp
captured_at: '2026-05-16'
status: merged
merge_sha: bf4a8435af77205624edc603a60a6910b62f735e
inclusion_reason: Preserve page/KV/layout and plan-run contracts; profile memory traffic separately from math utilization.
changed_paths:
- cpp/tensorrt_llm/thop/attentionOp.cpp
- examples/visual_gen/README.md
- examples/visual_gen/visual_gen_flux.py
- examples/visual_gen/visual_gen_ltx2.py
- examples/visual_gen/visual_gen_wan_i2v.py
- examples/visual_gen/visual_gen_wan_t2v.py
- tensorrt_llm/_torch/attention_backend/trtllm.py
- tensorrt_llm/_torch/visual_gen/attention_backend/parallel.py
- tensorrt_llm/_torch/visual_gen/attention_backend/trtllm.py
- tensorrt_llm/_torch/visual_gen/attention_backend/utils.py
- tensorrt_llm/_torch/visual_gen/config.py
- tensorrt_llm/_torch/visual_gen/models/ltx2/pipeline_ltx2.py
- tensorrt_llm/_torch/visual_gen/modules/attention.py
- tests/unittest/_torch/visual_gen/multi_gpu/test_ulysses_sage_attention.py
- tests/unittest/_torch/visual_gen/test_attention_integration.py
- tests/unittest/_torch/visual_gen/test_attention_perf.py
- tests/unittest/_torch/visual_gen/test_visual_gen_args.py
artifact_dir: evidence/pull-bundles/tensorrt-llm/gh-13570
head_ref_oid: 3f92685565562982d01e9bb1e16997a81c332898
---
# [TRTLLM-12128][feat] enable SageAttention for Wan/FLUX (new commits)

- Repository: `NVIDIA/TensorRT-LLM`
- PR: [13570](https://github.com/NVIDIA/TensorRT-LLM/pull/13570)
- Decision: `Preserve page/KV/layout and plan-run contracts; profile memory traffic separately from math utilization.`
- Reason: Preserve page/KV/layout and plan-run contracts; profile memory traffic separately from math utilization.

## Changed Paths

- `cpp/tensorrt_llm/thop/attentionOp.cpp`
- `examples/visual_gen/README.md`
- `examples/visual_gen/visual_gen_flux.py`
- `examples/visual_gen/visual_gen_ltx2.py`
- `examples/visual_gen/visual_gen_wan_i2v.py`
- `examples/visual_gen/visual_gen_wan_t2v.py`
- `tensorrt_llm/_torch/attention_backend/trtllm.py`
- `tensorrt_llm/_torch/visual_gen/attention_backend/parallel.py`
- `tensorrt_llm/_torch/visual_gen/attention_backend/trtllm.py`
- `tensorrt_llm/_torch/visual_gen/attention_backend/utils.py`
- `tensorrt_llm/_torch/visual_gen/config.py`
- `tensorrt_llm/_torch/visual_gen/models/ltx2/pipeline_ltx2.py`
- `tensorrt_llm/_torch/visual_gen/modules/attention.py`
- `tests/unittest/_torch/visual_gen/multi_gpu/test_ulysses_sage_attention.py`
- `tests/unittest/_torch/visual_gen/test_attention_integration.py`
- `tests/unittest/_torch/visual_gen/test_attention_perf.py`
- `tests/unittest/_torch/visual_gen/test_visual_gen_args.py`

## Evidence Bundle

`evidence/pull-bundles/tensorrt-llm/gh-13570`
