Unverified Commit 823b30cf authored by mcarilli's avatar mcarilli Committed by GitHub
Browse files

Allow optional optimizer part 2

parent b80b4d37
...@@ -192,7 +192,7 @@ opt_levels = {"O3": O3(), ...@@ -192,7 +192,7 @@ opt_levels = {"O3": O3(),
# allow user to directly pass Properties struct as well? # allow user to directly pass Properties struct as well?
def initialize( def initialize(
models, models,
optimizers, optimizers=None,
enabled=True, enabled=True,
opt_level=None, opt_level=None,
cast_model_type=None, cast_model_type=None,
...@@ -217,7 +217,8 @@ def initialize( ...@@ -217,7 +217,8 @@ def initialize(
Args: Args:
models (torch.nn.Module or list of torch.nn.Modules): Models to modify/cast. models (torch.nn.Module or list of torch.nn.Modules): Models to modify/cast.
optimizers (torch.optim.Optimizer or list of torch.optim.Optimizers): Optimizers to modify/cast. optimizers (optional, torch.optim.Optimizer or list of torch.optim.Optimizers): Optimizers to modify/cast.
REQUIRED for training, optional for inference.
enabled (bool, optional, default=True): If False, renders all Amp calls no-ops, so your script enabled (bool, optional, default=True): If False, renders all Amp calls no-ops, so your script
should run as if Amp were not present. should run as if Amp were not present.
opt_level (str, required): Pure or mixed precision optimization level. Accepted values are opt_level (str, required): Pure or mixed precision optimization level. Accepted values are
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment