Skip to content

GitLab

Commit 16c3feab authored by Haitang Hu's avatar Haitang Hu Committed by A. Unique TensorFlower
Browse files

Fix documentation for AdamWeightDecayConfig. 

PiperOrigin-RevId: 349314516
parent 412f4d2e
Hide whitespace changes
Inline Side-by-side
Showing with 3 additions and 1 deletion
official/modeling/optimization/configs/optimizer_config.py
View file @ 16c3feab
...@@ -112,8 +112,10 @@ class AdamWeightDecayConfig(BaseOptimizerConfig): ...@@ -112,8 +112,10 @@ class AdamWeightDecayConfig(BaseOptimizerConfig):
weight_decay_rate: float. Weight decay rate. Default to 0. weight_decay_rate: float. Weight decay rate. Default to 0.
include_in_weight_decay: list[str], or None. List of weight names to include include_in_weight_decay: list[str], or None. List of weight names to include
in weight decay. in weight decay.
include_in_weight_decay: list[str], or None. List of weight names to not exclude_from_weight_decay: list[str], or None. List of weight names to not
include in weight decay. include in weight decay.
gradient_clip_norm: A positive float. Clips the gradients to this maximum
L2-norm. Default to 1.0.
""" """
name: str = "AdamWeightDecay" name: str = "AdamWeightDecay"
beta_1: float = 0.9 beta_1: float = 0.9
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment