Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
chenpangpang
transformers
Commits
d4614729
"docs/git@developer.sourcefind.cn:Wenxuan/LightX2V.git" did not exist on "64c017df7db7eafd5418b9751066f3349f1609ad"
Commit
d4614729
authored
Dec 13, 2019
by
Lysandre
Browse files
return for SQuAD [BLACKED]
parent
f24a228a
Changes
2
Expand all
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
172 additions
and
110 deletions
+172
-110
transformers/data/processors/glue.py
transformers/data/processors/glue.py
+1
-1
transformers/data/processors/squad.py
transformers/data/processors/squad.py
+171
-109
No files found.
transformers/data/processors/glue.py
View file @
d4614729
...
...
@@ -133,7 +133,7 @@ def glue_convert_examples_to_features(examples, tokenizer,
if
is_tf_available
()
and
is_tf_dataset
:
def
gen
():
for
ex
in
features
:
yield
({
'input_ids'
:
ex
.
input_ids
,
yield
({
'input_ids'
:
ex
.
input_ids
,
'attention_mask'
:
ex
.
attention_mask
,
'token_type_ids'
:
ex
.
token_type_ids
},
ex
.
label
)
...
...
transformers/data/processors/squad.py
View file @
d4614729
This diff is collapsed.
Click to expand it.
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment