Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
chenpangpang
transformers
Commits
4df69506
"vscode:/vscode.git/clone" did not exist on "f063c56d942737d2c7aac93895cd8310afd9c7a4"
Unverified
Commit
4df69506
authored
Jan 26, 2022
by
Sylvain Gugger
Committed by
GitHub
Jan 26, 2022
Browse files
Fix YosoConfig doc (#15353)
parent
fc8fc400
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
4 additions
and
4 deletions
+4
-4
src/transformers/models/yoso/configuration_yoso.py
src/transformers/models/yoso/configuration_yoso.py
+4
-4
No files found.
src/transformers/models/yoso/configuration_yoso.py
View file @
4df69506
...
...
@@ -67,17 +67,17 @@ class YosoConfig(PretrainedConfig):
The epsilon used by the layer normalization layers.
position_embedding_type (`str`, *optional*, defaults to `"absolute"`):
Type of position embedding. Choose one of `"absolute"`, `"relative_key"`, `"relative_key_query"`.
use_expectation (
*
bool
*
, *optional*, defaults to
*
True
*
):
use_expectation (
`
bool
`
, *optional*, defaults to
`
True
`
):
Whether or not to use YOSO Expectation. Overrides any effect of num_hash.
hash_code_len (`int`, *optional*, defaults to 9):
The length of hashes generated by the hash functions.
num_hash (`int`, *optional*, defaults to 64):
Number of hash functions used in [`YosoSelfAttention`].
conv_window (`int`, *optional*
, defaults to None
):
conv_window (`int`, *optional*):
Kernel size of depth-wise convolution.
use_fast_hash (
*
bool
*
, *optional*, defaults to
*
False
*
):
use_fast_hash (
`
bool
`
, *optional*, defaults to
`
False
`
):
Whether or not to use custom cuda kernels which perform fast random projection via hadamard transform.
lsh_backward (
*
bool
*
, *optional*, defaults to
*
True
*
):
lsh_backward (
`
bool
`
, *optional*, defaults to
`
True
`
):
Whether or not to perform backpropagation using Locality Sensitive Hashing.
Example:
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment