---
id: pr-tensorrt-llm-13873
repo: NVIDIA/TensorRT-LLM
pr: 13873
title: '[TRTLLM-12503][feat] Parallel VAE independent scaling and fix arg passing'
author: NVShreyas
date: '2026-05-14'
url: https://github.com/NVIDIA/TensorRT-LLM/pull/13873
source_category: upstream-code
architectures:
- sm100
tags:
- arch_pipeline
- attention_kv
- benchmark_test
- blackwell
- gemm_quant
- scheduler_autotune
techniques:
- autotuning
- fine-grained-quantization
- pipeline-stages
- tile-scheduling
hardware_features:
- blackwell
- fp4
- fp8
kernel_types:
- attention
- gemm
- runtime
- scheduler
languages: []
captured_at: '2026-05-16'
status: merged
merge_sha: 58e7572c08dc9eb3b318bbce67a3d34a08079349
inclusion_reason: Mine shape sets, tolerance rules, warmup logic, and profile commands before mutating code.
changed_paths:
- docs/source/models/visual-generation.md
- examples/visual_gen/README.md
- examples/visual_gen/configs/wan2.2-t2v-fp4-1gpu.yaml
- examples/visual_gen/configs/wan2.2-t2v-fp4-4gpu.yaml
- examples/visual_gen/configs/wan2.2-t2v-fp8-8gpu.yaml
- examples/visual_gen/visual_gen_wan_i2v.py
- examples/visual_gen/visual_gen_wan_t2v.py
- tensorrt_llm/_torch/visual_gen/config.py
- tensorrt_llm/_torch/visual_gen/mapping.py
- tensorrt_llm/_torch/visual_gen/models/wan/parallel_vae.py
- tensorrt_llm/_torch/visual_gen/modules/vae/attention.py
- tensorrt_llm/_torch/visual_gen/modules/vae/conv.py
- tensorrt_llm/_torch/visual_gen/modules/vae/parallel_vae_interface.py
- tensorrt_llm/_torch/visual_gen/pipeline.py
- tensorrt_llm/_torch/visual_gen/pipeline_loader.py
- tests/integration/defs/perf/README_test_visual_gen_perf_sanity.md
- tests/integration/defs/perf/visual_gen_perf_utils.py
- tests/scripts/perf-sanity/visual_gen/flux2_blackwell.yaml
- tests/scripts/perf-sanity/visual_gen/ltx2_blackwell.yaml
- tests/scripts/perf-sanity/visual_gen/wan21_t2v_14b_blackwell.yaml
- tests/scripts/perf-sanity/visual_gen/wan22_i2v_a14b_blackwell.yaml
- tests/unittest/_torch/visual_gen/multi_gpu/test_parallel_vae.py
- tests/unittest/_torch/visual_gen/multi_gpu/test_visual_gen_mapping.py
- tests/unittest/_torch/visual_gen/multi_gpu/test_wan_pipeline_parallel.py
- tests/unittest/_torch/visual_gen/test_visual_gen_args.py
artifact_dir: evidence/pull-bundles/tensorrt-llm/gh-13873
head_ref_oid: a3ab325b7e22ffe7e958038627b93a5d23d7da25
---
# [TRTLLM-12503][feat] Parallel VAE independent scaling and fix arg passing

- Repository: `NVIDIA/TensorRT-LLM`
- PR: [13873](https://github.com/NVIDIA/TensorRT-LLM/pull/13873)
- Decision: `Mine shape sets, tolerance rules, warmup logic, and profile commands before mutating code.`
- Reason: Mine shape sets, tolerance rules, warmup logic, and profile commands before mutating code.

## Changed Paths

- `docs/source/models/visual-generation.md`
- `examples/visual_gen/README.md`
- `examples/visual_gen/configs/wan2.2-t2v-fp4-1gpu.yaml`
- `examples/visual_gen/configs/wan2.2-t2v-fp4-4gpu.yaml`
- `examples/visual_gen/configs/wan2.2-t2v-fp8-8gpu.yaml`
- `examples/visual_gen/visual_gen_wan_i2v.py`
- `examples/visual_gen/visual_gen_wan_t2v.py`
- `tensorrt_llm/_torch/visual_gen/config.py`
- `tensorrt_llm/_torch/visual_gen/mapping.py`
- `tensorrt_llm/_torch/visual_gen/models/wan/parallel_vae.py`
- `tensorrt_llm/_torch/visual_gen/modules/vae/attention.py`
- `tensorrt_llm/_torch/visual_gen/modules/vae/conv.py`
- `tensorrt_llm/_torch/visual_gen/modules/vae/parallel_vae_interface.py`
- `tensorrt_llm/_torch/visual_gen/pipeline.py`
- `tensorrt_llm/_torch/visual_gen/pipeline_loader.py`
- `tests/integration/defs/perf/README_test_visual_gen_perf_sanity.md`
- `tests/integration/defs/perf/visual_gen_perf_utils.py`
- `tests/scripts/perf-sanity/visual_gen/flux2_blackwell.yaml`
- `tests/scripts/perf-sanity/visual_gen/ltx2_blackwell.yaml`
- `tests/scripts/perf-sanity/visual_gen/wan21_t2v_14b_blackwell.yaml`
- `tests/scripts/perf-sanity/visual_gen/wan22_i2v_a14b_blackwell.yaml`
- `tests/unittest/_torch/visual_gen/multi_gpu/test_parallel_vae.py`
- `tests/unittest/_torch/visual_gen/multi_gpu/test_visual_gen_mapping.py`
- `tests/unittest/_torch/visual_gen/multi_gpu/test_wan_pipeline_parallel.py`
- `tests/unittest/_torch/visual_gen/test_visual_gen_args.py`

## Evidence Bundle

`evidence/pull-bundles/tensorrt-llm/gh-13873`
