"...resnet50_tensorflow.git" did not exist on "fd01507550cc99330d44f569b414af7e29a9627d"
Unverified Commit 1aec9916 authored by Patrick von Platen's avatar Patrick von Platen Committed by GitHub
Browse files

[GPT2] Correct typo in docs (#6352)

parent 9f57e39f
...@@ -71,7 +71,7 @@ class GPT2Config(PretrainedConfig): ...@@ -71,7 +71,7 @@ class GPT2Config(PretrainedConfig):
The dropout ratio for the attention. The dropout ratio for the attention.
layer_norm_epsilon (:obj:`float`, optional, defaults to 1e-5): layer_norm_epsilon (:obj:`float`, optional, defaults to 1e-5):
The epsilon to use in the layer normalization layers The epsilon to use in the layer normalization layers
initializer_range (:obj:`float`, optional, defaults to 16): initializer_range (:obj:`float`, optional, defaults to 0.02):
The standard deviation of the truncated_normal_initializer for initializing all weight matrices. The standard deviation of the truncated_normal_initializer for initializing all weight matrices.
summary_type (:obj:`string`, optional, defaults to "cls_index"): summary_type (:obj:`string`, optional, defaults to "cls_index"):
Argument used when doing sequence summary. Used in for the multiple choice head in Argument used when doing sequence summary. Used in for the multiple choice head in
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment