Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
chenpangpang
transformers
Commits
ab7f5d29
"git@developer.sourcefind.cn:chenpangpang/transformers.git" did not exist on "e691fc0963b64e8c19b4a71ddaefe418096776b6"
Commit
ab7f5d29
authored
Feb 18, 2019
by
thomwolf
Browse files
simple
parent
b450a7fa
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
4 deletions
+2
-4
pytorch_pretrained_bert/tokenization_gpt2.py
pytorch_pretrained_bert/tokenization_gpt2.py
+2
-4
No files found.
pytorch_pretrained_bert/tokenization_gpt2.py
View file @
ab7f5d29
...
@@ -27,10 +27,8 @@ try:
...
@@ -27,10 +27,8 @@ try:
except
ImportError
:
except
ImportError
:
# Just a dummy decorator to get the checks to run on python2
# Just a dummy decorator to get the checks to run on python2
# because honestly I don't want to support a byte-level unicode BPE tokenizer on python 2 right now.
# because honestly I don't want to support a byte-level unicode BPE tokenizer on python 2 right now.
def
lru_cache
(
func
):
def
lru_cache
():
def
func_wrapper
(
*
inputs
,
**
args
):
return
lambda
func
:
func
return
func
(
inputs
,
args
)
return
func_wrapper
from
.file_utils
import
cached_path
from
.file_utils
import
cached_path
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment