Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
chenpangpang
transformers
Commits
4df69506
Unverified
Commit
4df69506
authored
Jan 26, 2022
by
Sylvain Gugger
Committed by
GitHub
Jan 26, 2022
Browse files
Fix YosoConfig doc (#15353)
parent
fc8fc400
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
4 additions
and
4 deletions
+4
-4
src/transformers/models/yoso/configuration_yoso.py
src/transformers/models/yoso/configuration_yoso.py
+4
-4
No files found.
src/transformers/models/yoso/configuration_yoso.py
View file @
4df69506
...
@@ -67,17 +67,17 @@ class YosoConfig(PretrainedConfig):
...
@@ -67,17 +67,17 @@ class YosoConfig(PretrainedConfig):
The epsilon used by the layer normalization layers.
The epsilon used by the layer normalization layers.
position_embedding_type (`str`, *optional*, defaults to `"absolute"`):
position_embedding_type (`str`, *optional*, defaults to `"absolute"`):
Type of position embedding. Choose one of `"absolute"`, `"relative_key"`, `"relative_key_query"`.
Type of position embedding. Choose one of `"absolute"`, `"relative_key"`, `"relative_key_query"`.
use_expectation (
*
bool
*
, *optional*, defaults to
*
True
*
):
use_expectation (
`
bool
`
, *optional*, defaults to
`
True
`
):
Whether or not to use YOSO Expectation. Overrides any effect of num_hash.
Whether or not to use YOSO Expectation. Overrides any effect of num_hash.
hash_code_len (`int`, *optional*, defaults to 9):
hash_code_len (`int`, *optional*, defaults to 9):
The length of hashes generated by the hash functions.
The length of hashes generated by the hash functions.
num_hash (`int`, *optional*, defaults to 64):
num_hash (`int`, *optional*, defaults to 64):
Number of hash functions used in [`YosoSelfAttention`].
Number of hash functions used in [`YosoSelfAttention`].
conv_window (`int`, *optional*
, defaults to None
):
conv_window (`int`, *optional*):
Kernel size of depth-wise convolution.
Kernel size of depth-wise convolution.
use_fast_hash (
*
bool
*
, *optional*, defaults to
*
False
*
):
use_fast_hash (
`
bool
`
, *optional*, defaults to
`
False
`
):
Whether or not to use custom cuda kernels which perform fast random projection via hadamard transform.
Whether or not to use custom cuda kernels which perform fast random projection via hadamard transform.
lsh_backward (
*
bool
*
, *optional*, defaults to
*
True
*
):
lsh_backward (
`
bool
`
, *optional*, defaults to
`
True
`
):
Whether or not to perform backpropagation using Locality Sensitive Hashing.
Whether or not to perform backpropagation using Locality Sensitive Hashing.
Example:
Example:
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment