tests/cpp/operator/test_normalization.h · 5b4d89c3227fa31743bdb186d25f646e4636c668 · OpenDAS / TransformerEngine

"transformer_engine/common/transpose/transpose_fusion.cu" did not exist on "e4a84a8d6de0bf0d1c9f99f66547a69e91576217"

Add backward RMSNorm+Add fusion (#2028) · 5b4d89c3

Jan Bielak authored Aug 19, 2025



* Add rmsnorm_bwd_add
Signed-off-by: Jan Bielak <jbielak@nvidia.com>

* Add BackwardAddRMSNorm fused operation
Signed-off-by: Jan Bielak <jbielak@nvidia.com>

* Try to optimize register usage in kernels
Signed-off-by: Jan Bielak <jbielak@nvidia.com>

* Add separate BackwardAdd stage for the fused backward add
Signed-off-by: Jan Bielak <jbielak@nvidia.com>

---------
Signed-off-by: Jan Bielak <jbielak@nvidia.com>

5b4d89c3

test_normalization.h 6.15 KB

Replace test_normalization.h