Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
chenpangpang
transformers
Commits
76be189b
Commit
76be189b
authored
Jul 21, 2019
by
Peiqin Lin
Browse files
typos
parent
a6154990
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
4 additions
and
4 deletions
+4
-4
examples/run_glue.py
examples/run_glue.py
+2
-2
examples/run_squad.py
examples/run_squad.py
+2
-2
No files found.
examples/run_glue.py
View file @
76be189b
...
...
@@ -116,8 +116,8 @@ def train(args, train_dataset, model, tokenizer):
'attention_mask'
:
batch
[
1
],
'token_type_ids'
:
batch
[
2
]
if
args
.
model_type
in
[
'bert'
,
'xlnet'
]
else
None
,
# XLM don't use segment_ids
'labels'
:
batch
[
3
]}
ouputs
=
model
(
**
inputs
)
loss
=
ouputs
[
0
]
# model outputs are always tuple in pytorch-transformers (see doc)
ou
t
puts
=
model
(
**
inputs
)
loss
=
ou
t
puts
[
0
]
# model outputs are always tuple in pytorch-transformers (see doc)
if
args
.
n_gpu
>
1
:
loss
=
loss
.
mean
()
# mean() to average on multi-gpu parallel training
...
...
examples/run_squad.py
View file @
76be189b
...
...
@@ -129,8 +129,8 @@ def train(args, train_dataset, model, tokenizer):
if
args
.
model_type
in
[
'xlnet'
,
'xlm'
]:
inputs
.
update
({
'cls_index'
:
batch
[
5
],
'p_mask'
:
batch
[
6
]})
ouputs
=
model
(
**
inputs
)
loss
=
ouputs
[
0
]
# model outputs are always tuple in pytorch-transformers (see doc)
ou
t
puts
=
model
(
**
inputs
)
loss
=
ou
t
puts
[
0
]
# model outputs are always tuple in pytorch-transformers (see doc)
if
args
.
n_gpu
>
1
:
loss
=
loss
.
mean
()
# mean() to average on multi-gpu parallel (not distributed) training
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment