Unverified Commit a3698365 authored by Julian Weber's avatar Julian Weber Committed by GitHub
Browse files

Fix type in gpt2 config docstring (#21782)

Fix docstring gpt2 config
parent 3c0ce608
...@@ -65,7 +65,7 @@ class GPT2Config(PretrainedConfig): ...@@ -65,7 +65,7 @@ class GPT2Config(PretrainedConfig):
Activation function, to be selected in the list `["relu", "silu", "gelu", "tanh", "gelu_new"]`. Activation function, to be selected in the list `["relu", "silu", "gelu", "tanh", "gelu_new"]`.
resid_pdrop (`float`, *optional*, defaults to 0.1): resid_pdrop (`float`, *optional*, defaults to 0.1):
The dropout probability for all fully connected layers in the embeddings, encoder, and pooler. The dropout probability for all fully connected layers in the embeddings, encoder, and pooler.
embd_pdrop (`int`, *optional*, defaults to 0.1): embd_pdrop (`float`, *optional*, defaults to 0.1):
The dropout ratio for the embeddings. The dropout ratio for the embeddings.
attn_pdrop (`float`, *optional*, defaults to 0.1): attn_pdrop (`float`, *optional*, defaults to 0.1):
The dropout ratio for the attention. The dropout ratio for the attention.
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment