Unverified Commit bd04f21f authored by Vittorio Caggiano's avatar Vittorio Caggiano Committed by GitHub
Browse files

Update README.md (#443)

parent b6dc98cf
......@@ -12,7 +12,6 @@ FairScale supports:
* Parallelism:
* Pipeline parallelism (`fairscale.nn.pipe`)
* Asynchronous Pipeline parallelism (`fairscale.nn.async_pipe`)
* Mixture of experts (`fairscale.nn.moe.moe_layer`)
* Model Parallelism (`fairscale.nn.model_parallel.layers`)
* _experimental_ AmpNet (`fairscale.experimental.nn.ampnet_pipe`)
* Sharded training:
......@@ -23,7 +22,6 @@ FairScale supports:
* AdaScale SGD (`fairscale.optim.AdaScale`)
* GPU memory optimization:
* Activation checkpointing wrapper (`fairscale.nn.misc.checkpoint_wrapper`)
* _experimental_ CPU offloaded model (`fairscale.experimental.nn.offload.OffloadModel`)
* GPU speed optimization:
* Sharded grad scaler - automatic mixed precision (`fairscale.optim.grad_scaler`)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment