Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
chenpangpang
transformers
Commits
d8213588
Commit
d8213588
authored
Dec 14, 2018
by
thomwolf
Browse files
update readme
parent
37378898
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
8 additions
and
6 deletions
+8
-6
README.md
README.md
+8
-6
No files found.
README.md
View file @
d8213588
...
...
@@ -19,7 +19,7 @@ This implementation is provided with [Google's pre-trained models](https://githu
## Installation
This repo was tested on Python 3.
6
+ and PyTorch 0.4.1
This repo was tested on Python 3.
5
+ and PyTorch 0.4.1
/1.0.0
### With pip
...
...
@@ -372,9 +372,9 @@ Where `$THIS_MACHINE_INDEX` is an sequential index assigned to each of your mach
We showcase several fine-tuning examples based on (and extended from)
[
the original implementation
](
https://github.com/google-research/bert/
)
:
-
a sequence-level classifier on the MRPC classification corpus,
-
a token-level classifier on the question answering dataset SQuAD, and
-
a sequence-level multiple-choice classifier on the SWAG classification corpus.
-
a
*
sequence-level classifier
*
on the MRPC classification corpus,
-
a
*
token-level classifier
*
on the question answering dataset SQuAD, and
-
a
*
sequence-level multiple-choice classifier
*
on the SWAG classification corpus.
#### MRPC
...
...
@@ -427,7 +427,7 @@ python run_classifier.py \
#### SQuAD
This example code fine-tunes BERT on the SQuAD dataset. It runs in 24 min (with BERT-base) or 68 min (with BERT-large) on single tesla V100 16GB.
This example code fine-tunes BERT on the SQuAD dataset. It runs in 24 min (with BERT-base) or 68 min (with BERT-large) on
a
single tesla V100 16GB.
The data for SQuAD can be downloaded with the following links and should be saved in a
`$SQUAD_DIR`
directory.
...
...
@@ -458,7 +458,9 @@ Training with the previous hyper-parameters gave us the following results:
{
"f1"
: 88.52381567990474,
"exact_match"
: 81.22043519394512
}
```
The data for Swag can be downloaded by cloning the following
[
repository
](
https://github.com/rowanz/swagaf
)
#### SWAG
The data for SWAG can be downloaded by cloning the following
[
repository
](
https://github.com/rowanz/swagaf
)
```
shell
export
SWAG_DIR
=
/path/to/SWAG
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment