Skip to content

GitLab

"...git@developer.sourcefind.cn:chenpangpang/transformers.git" did not exist on "e3d2bee8d034e0c2f1dfbb5555e157b3c8d4b2a4"
Commit fdc487d8 authored by thomwolf's avatar thomwolf
Browse files

Add max length

parent aa05dc89
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
pytorch_transformers/tokenization_gpt2.py
View file @ fdc487d8
...@@ -58,6 +58,7 @@ PRETRAINED_VOCAB_FILES_MAP = { ...@@ -58,6 +58,7 @@ PRETRAINED_VOCAB_FILES_MAP = {
PRETRAINED_POSITIONAL_EMBEDDINGS_SIZES = { PRETRAINED_POSITIONAL_EMBEDDINGS_SIZES = {
'gpt2': 1024, 'gpt2': 1024,
'gpt2-medium': 1024, 'gpt2-medium': 1024,
'gpt2-large': 1024,
} }
@lru_cache() @lru_cache()
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment