Adding layernorm docs

67ad3065 · Michael Carilli · 64f3d362 · 67ad3065 · 67ad3065
Commit 67ad3065 authored Nov 28, 2018 by Michael Carilli
Hide whitespace changes
Inline Side-by-side

Showing with 20 additions and 0 deletions

docs/source/index.rst docs/source/index.rst +6 -0

docs/source/layernorm.rst docs/source/layernorm.rst +14 -0

No files found.
--- a/docs/source/index.rst
+++ b/docs/source/index.rst
@@ -44,6 +44,12 @@ Installation requires CUDA 9 or later, PyTorch 0.4 or later, and Python 3. Insta
   optimizers
+.. toctree::
+   :maxdepth: 1
+   :caption: Fused Layer Norm
+   layernorm
 ..   reparameterization
 ..   RNN

--- a/docs/source/layernorm.rst
+++ b/docs/source/layernorm.rst
+.. role:: hidden
+    :class: hidden-section
+apex.normalization.fused_layer_norm
+===================================
+.. automodule:: apex.normalization.fused_layer_norm
+.. currentmodule:: apex.normalization.fused_layer_norm
+.. FusedAdam
+   ----------
+.. autoclass:: FusedLayerNorm
+    :members: