Merge pull request #55 from ROCmSoftwarePlatform/IFU-master-2021-10-15

IFU-2021-10-15 (+ remove redundant defines + C10_CUDA_CHECK)

Merge pull request #55 from ROCmSoftwarePlatform/IFU-master-2021-10-15
IFU-2021-10-15 (+ remove redundant defines + C10_CUDA_CHECK)
cc92a4b4 · Jithun Nair · GitHub · 1e0f9bc6 · fec3141c · cc92a4b4
Unverified Commit cc92a4b4 authored Dec 08, 2021 by Jithun Nair Committed by GitHub Dec 08, 2021
20 changed files
--- a/apex/contrib/test/fmha/test_fmha.py
+++ b/apex/contrib/test/fmha/test_fmha.py
--- a/apex/contrib/test/fused_dense/test_fused_dense.py
+++ b/apex/contrib/test/fused_dense/test_fused_dense.py
--- a/apex/contrib/test/transducer/test_transducer_joint.py
+++ b/apex/contrib/test/transducer/test_transducer_joint.py
--- a/apex/contrib/test/transducer/test_transducer_loss.py
+++ b/apex/contrib/test/transducer/test_transducer_loss.py
--- a/apex/contrib/test/transducer/transducer_ref.py
+++ b/apex/contrib/test/transducer/transducer_ref.py
--- a/apex/contrib/transducer/__init__.py
+++ b/apex/contrib/transducer/__init__.py
--- a/apex/contrib/transducer/transducer.py
+++ b/apex/contrib/transducer/transducer.py
--- a/apex/fused_dense/__init__.py
+++ b/apex/fused_dense/__init__.py
+from .fused_dense import *
--- a/apex/fused_dense/fused_dense.py
+++ b/apex/fused_dense/fused_dense.py
--- a/apex/normalization/__init__.py
+++ b/apex/normalization/__init__.py
--- a/apex/normalization/fused_layer_norm.py
+++ b/apex/normalization/fused_layer_norm.py
--- a/apex/optimizers/fused_adam.py
+++ b/apex/optimizers/fused_adam.py
--- a/apex/optimizers/fused_novograd.py
+++ b/apex/optimizers/fused_novograd.py
--- a/apex/transformer/README.md
+++ b/apex/transformer/README.md
--- a/apex/transformer/__init__.py
+++ b/apex/transformer/__init__.py
--- a/apex/transformer/enums.py
+++ b/apex/transformer/enums.py
--- a/apex/transformer/functional/__init__.py
+++ b/apex/transformer/functional/__init__.py
--- a/apex/transformer/functional/fused_softmax.py
+++ b/apex/transformer/functional/fused_softmax.py
--- a/apex/transformer/parallel_state.py
+++ b/apex/transformer/parallel_state.py
--- a/apex/transformer/tensor_parallel/__init__.py
+++ b/apex/transformer/tensor_parallel/__init__.py