Merge pull request #80 from ROCmSoftwarePlatform/IFU-master-2022-07-29

IFU-master-2022-07-29

Merge pull request #80 from ROCmSoftwarePlatform/IFU-master-2022-07-29
IFU-master-2022-07-29
96850dfa · Jithun Nair · GitHub · 87fc4125 · cc5f83b5 · 96850dfa
Unverified Commit 96850dfa authored Aug 15, 2022 by Jithun Nair Committed by GitHub Aug 15, 2022
20 changed files
--- a/apex/contrib/test/clip_grad/test_clip_grad.py
+++ b/apex/contrib/test/clip_grad/test_clip_grad.py
--- a/apex/contrib/test/conv_bias_relu/test_conv_bias_relu.py
+++ b/apex/contrib/test/conv_bias_relu/test_conv_bias_relu.py
--- a/apex/contrib/test/fmha/test_fmha.py
+++ b/apex/contrib/test/fmha/test_fmha.py
--- a/apex/contrib/test/focal_loss/test_focal_loss.py
+++ b/apex/contrib/test/focal_loss/test_focal_loss.py
--- a/apex/contrib/test/layer_norm/test_fast_layer_norm.py
+++ b/apex/contrib/test/layer_norm/test_fast_layer_norm.py
--- a/apex/contrib/test/multihead_attn/test_encdec_multihead_attn.py
+++ b/apex/contrib/test/multihead_attn/test_encdec_multihead_attn.py
--- a/apex/contrib/test/multihead_attn/test_encdec_multihead_attn_norm_add.py
+++ b/apex/contrib/test/multihead_attn/test_encdec_multihead_attn_norm_add.py
--- a/apex/contrib/test/multihead_attn/test_self_multihead_attn.py
+++ b/apex/contrib/test/multihead_attn/test_self_multihead_attn.py
--- a/apex/contrib/test/multihead_attn/test_self_multihead_attn_norm_add.py
+++ b/apex/contrib/test/multihead_attn/test_self_multihead_attn_norm_add.py
--- a/apex/contrib/test/optimizers/test_dist_adam.py
+++ b/apex/contrib/test/optimizers/test_dist_adam.py
--- a/apex/optimizers/fused_adam.py
+++ b/apex/optimizers/fused_adam.py
--- a/apex/pyprof/FAQs.md
+++ b/apex/pyprof/FAQs.md
--- a/apex/pyprof/README.md
+++ b/apex/pyprof/README.md
--- a/apex/pyprof/__init__.py
+++ b/apex/pyprof/__init__.py
--- a/apex/pyprof/examples/.gitignore
+++ b/apex/pyprof/examples/.gitignore
--- a/apex/pyprof/examples/apex/README.md
+++ b/apex/pyprof/examples/apex/README.md
-This directory has examples of how to use `pyprof` with APEX extensions e.g. `fused_adam_cuda` and `fused_layer_norm_cuda`.
--- a/apex/pyprof/examples/apex/fused_adam.py
+++ b/apex/pyprof/examples/apex/fused_adam.py
--- a/apex/pyprof/examples/apex/fused_layer_norm.py
+++ b/apex/pyprof/examples/apex/fused_layer_norm.py
--- a/apex/pyprof/examples/apex/test.sh
+++ b/apex/pyprof/examples/apex/test.sh
--- a/apex/pyprof/examples/custom_func_module/README.md
+++ b/apex/pyprof/examples/custom_func_module/README.md
-This directory has examples which show how to intercept (monkey patch) custom functions and modules with `pyprof`. No changes are required in `pyprof/parse`, however, users can add support for bytes and flops calculation for custom functions and modules in `pyprof/prof` by extending the `OperatorLayerBase` class.