Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
chenpangpang
transformers
Commits
9ff2b7d8
"vscode:/vscode.git/clone" did not exist on "d2370e1bd8513dcdb92599292ba09ecaa5e68c86"
Commit
9ff2b7d8
authored
Nov 19, 2018
by
weiyumou
Browse files
Fixed README typo
parent
37b6c9b2
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
1 deletion
+1
-1
README.md
README.md
+1
-1
No files found.
README.md
View file @
9ff2b7d8
...
@@ -99,7 +99,7 @@ from pytorch_pretrained_bert import BertTokenizer, BertModel, BertForMaskedLM
...
@@ -99,7 +99,7 @@ from pytorch_pretrained_bert import BertTokenizer, BertModel, BertForMaskedLM
tokenizer
=
BertTokenizer
.
from_pretrained
(
'bert-base-uncased'
)
tokenizer
=
BertTokenizer
.
from_pretrained
(
'bert-base-uncased'
)
# Tokenized input
# Tokenized input
tokenized_
text
=
"Who was Jim Henson ? Jim Henson was a puppeteer"
text
=
"Who was Jim Henson ? Jim Henson was a puppeteer"
tokenized_text
=
tokenizer
.
tokenize
(
text
)
tokenized_text
=
tokenizer
.
tokenize
(
text
)
# Mask a token that we will try to predict back with `BertForMaskedLM`
# Mask a token that we will try to predict back with `BertForMaskedLM`
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment