Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
chenpangpang
transformers
Commits
d085662c
Unverified
Commit
d085662c
authored
Oct 13, 2023
by
Bojun-Feng
Committed by
GitHub
Oct 13, 2023
Browse files
[docstring] Fix docstring for `RwkvConfig` (#26782)
* update check_docstrings * update docstring
parent
21da3b24
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
2 additions
and
3 deletions
+2
-3
src/transformers/models/rwkv/configuration_rwkv.py
src/transformers/models/rwkv/configuration_rwkv.py
+2
-2
utils/check_docstrings.py
utils/check_docstrings.py
+0
-1
No files found.
src/transformers/models/rwkv/configuration_rwkv.py
View file @
d085662c
...
...
@@ -61,7 +61,7 @@ class RwkvConfig(PretrainedConfig):
Dimensionality of the attention hidden states. Will default to `hidden_size` if unset.
intermediate_size (`int`, *optional*):
Dimensionality of the inner feed-forward layers. Will default to 4 times `hidden_size` if unset.
layer_norm_eps (`float`, *optional*, defaults to 1e-5):
layer_norm_eps
ilon
(`float`, *optional*, defaults to 1e-
0
5):
The epsilon to use in the layer normalization layers.
bos_token_id (`int`, *optional*, defaults to 0):
The id of the beginning of sentence token in the vocabulary. Defaults to 0 as RWKV uses the same tokenizer
...
...
@@ -69,7 +69,7 @@ class RwkvConfig(PretrainedConfig):
eos_token_id (`int`, *optional*, defaults to 0):
The id of the end of sentence token in the vocabulary. Defaults to 0 as RWKV uses the same tokenizer as
GPTNeoX.
rescale_every (`int`, *optional*, default to 6):
rescale_every (`int`, *optional*, default
s
to 6):
At inference, the hidden states (and weights of the correponding output layers) are divided by 2 every
`rescale_every` layer. If set to 0 or a negative number, no rescale is done.
tie_word_embeddings (`bool`, *optional*, defaults to `False`):
...
...
utils/check_docstrings.py
View file @
d085662c
...
...
@@ -471,7 +471,6 @@ OBJECTS_TO_IGNORE = [
"RobertaPreLayerNormConfig"
,
"RobertaPreLayerNormModel"
,
"RobertaTokenizerFast"
,
"RwkvConfig"
,
"SEWConfig"
,
"SEWDConfig"
,
"SEWDForCTC"
,
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment