version 1

external_ops/fmhalib/README.md

+# preparation
+Accordding to the following PR to produce fmhalib.so
+https://github.com/sneaxiy/apex/pull/1
+
+# build the fmha op
+python setup.py install
+
+# unittest (need to improve)
+python test_fmha.py

external_ops/fused_dense_op/README.md

+# Function 
+Support gemm_nn/nt + bias with float16, float32 and float64 data types.
+
+# Correcness test
+`
+python test_fused_dense_op.py
+`
+
+# performance result
+`
+python test_fused_dense_perf.py
+`

external_ops/fused_dropout_residual_ln/README.md

+# function
+This fused op implements the following logics:
+```
+layer_norm(residual + dropout(input))
+```
+
+# Accuracy test
+python test_fused_dropout_op.py
+
+# Perf test
+python test_fused_dropout_perf.py
+
+
+# TODO
+1. In the unittest, we only test the accuracy when dropout_rate is 0.
+2. how to set is_test is true for dropout in eval phase?