Merge remote-tracking branch 'upstream/master' into IFU-master-2022-07-29

795a5e5b · hubertlu-tw · 016c8d4f · 3c19f106 · 795a5e5b · 795a5e5b
Commit 795a5e5b authored Jul 29, 2022 by hubertlu-tw
20 changed files
--- a/apex/contrib/test/clip_grad/test_clip_grad.py
+++ b/apex/contrib/test/clip_grad/test_clip_grad.py
--- a/apex/contrib/test/conv_bias_relu/test_conv_bias_relu.py
+++ b/apex/contrib/test/conv_bias_relu/test_conv_bias_relu.py
--- a/apex/contrib/test/fmha/test_fmha.py
+++ b/apex/contrib/test/fmha/test_fmha.py
--- a/apex/contrib/test/focal_loss/test_focal_loss.py
+++ b/apex/contrib/test/focal_loss/test_focal_loss.py
--- a/apex/contrib/test/layer_norm/test_fast_layer_norm.py
+++ b/apex/contrib/test/layer_norm/test_fast_layer_norm.py
--- a/apex/contrib/test/multihead_attn/test_encdec_multihead_attn.py
+++ b/apex/contrib/test/multihead_attn/test_encdec_multihead_attn.py
--- a/apex/contrib/test/multihead_attn/test_encdec_multihead_attn_norm_add.py
+++ b/apex/contrib/test/multihead_attn/test_encdec_multihead_attn_norm_add.py
--- a/apex/contrib/test/multihead_attn/test_self_multihead_attn.py
+++ b/apex/contrib/test/multihead_attn/test_self_multihead_attn.py
--- a/apex/contrib/test/multihead_attn/test_self_multihead_attn_norm_add.py
+++ b/apex/contrib/test/multihead_attn/test_self_multihead_attn_norm_add.py
--- a/apex/contrib/test/optimizers/test_dist_adam.py
+++ b/apex/contrib/test/optimizers/test_dist_adam.py
--- a/apex/optimizers/fused_adam.py
+++ b/apex/optimizers/fused_adam.py
--- a/apex/pyprof/FAQs.md
+++ b/apex/pyprof/FAQs.md
--- a/apex/pyprof/README.md
+++ b/apex/pyprof/README.md
--- a/apex/pyprof/__init__.py
+++ b/apex/pyprof/__init__.py
--- a/apex/pyprof/examples/.gitignore
+++ b/apex/pyprof/examples/.gitignore
--- a/apex/pyprof/examples/apex/README.md
+++ b/apex/pyprof/examples/apex/README.md
-This directory has examples of how to use `pyprof` with APEX extensions e.g. `fused_adam_cuda` and `fused_layer_norm_cuda`.
--- a/apex/pyprof/examples/apex/fused_adam.py
+++ b/apex/pyprof/examples/apex/fused_adam.py
--- a/apex/pyprof/examples/apex/fused_layer_norm.py
+++ b/apex/pyprof/examples/apex/fused_layer_norm.py
--- a/apex/pyprof/examples/apex/test.sh
+++ b/apex/pyprof/examples/apex/test.sh
--- a/apex/pyprof/examples/custom_func_module/README.md
+++ b/apex/pyprof/examples/custom_func_module/README.md
-This directory has examples which show how to intercept (monkey patch) custom functions and modules with `pyprof`. No changes are required in `pyprof/parse`, however, users can add support for bytes and flops calculation for custom functions and modules in `pyprof/prof` by extending the `OperatorLayerBase` class.