Skip to content

GitLab

Commit 04de0f7a authored by Kexin Yu's avatar Kexin Yu
Browse files

install option for contrib.optimizers.FusedLAMB

parent f3a960f8
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
apex/contrib/optimizers/fused_lamb.py
View file @ 04de0f7a
...@@ -8,7 +8,7 @@ class FusedLAMB(torch.optim.Optimizer): ...@@ -8,7 +8,7 @@ class FusedLAMB(torch.optim.Optimizer):
"""Implements LAMB algorithm. """Implements LAMB algorithm.
Currently GPU-only. Requires Apex to be installed via Currently GPU-only. Requires Apex to be installed via
``pip install -v --no-cache-dir --global-option="--cpp_ext" --global-option="--cuda_ext" ./``. ``pip install -v --no-cache-dir --global-option="--cpp_ext" --global-option="--cuda_ext" --global-option="--deprecated_fused_lamb" ./``.
This version of fused LAMB implements 2 fusions. This version of fused LAMB implements 2 fusions.
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment