Skip to content

GitLab

Unverified Commit bd04f21f authored by Vittorio Caggiano's avatar Vittorio Caggiano Committed by GitHub
Browse files

Update README.md (#443)

parent b6dc98cf
Show whitespace changes
Inline Side-by-side
Showing with 0 additions and 2 deletions
README.md
View file @ bd04f21f
...@@ -12,7 +12,6 @@ FairScale supports: ...@@ -12,7 +12,6 @@ FairScale supports:
* Parallelism: * Parallelism:
* Pipeline parallelism (`fairscale.nn.pipe`) * Pipeline parallelism (`fairscale.nn.pipe`)
* Asynchronous Pipeline parallelism (`fairscale.nn.async_pipe`) * Asynchronous Pipeline parallelism (`fairscale.nn.async_pipe`)
* Mixture of experts (`fairscale.nn.moe.moe_layer`)
* Model Parallelism (`fairscale.nn.model_parallel.layers`) * Model Parallelism (`fairscale.nn.model_parallel.layers`)
* _experimental_ AmpNet (`fairscale.experimental.nn.ampnet_pipe`) * _experimental_ AmpNet (`fairscale.experimental.nn.ampnet_pipe`)
* Sharded training: * Sharded training:
...@@ -23,7 +22,6 @@ FairScale supports: ...@@ -23,7 +22,6 @@ FairScale supports:
* AdaScale SGD (`fairscale.optim.AdaScale`) * AdaScale SGD (`fairscale.optim.AdaScale`)
* GPU memory optimization: * GPU memory optimization:
* Activation checkpointing wrapper (`fairscale.nn.misc.checkpoint_wrapper`) * Activation checkpointing wrapper (`fairscale.nn.misc.checkpoint_wrapper`)
* _experimental_ CPU offloaded model (`fairscale.experimental.nn.offload.OffloadModel`)
* GPU speed optimization: * GPU speed optimization:
* Sharded grad scaler - automatic mixed precision (`fairscale.optim.grad_scaler`) * Sharded grad scaler - automatic mixed precision (`fairscale.optim.grad_scaler`)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment