Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
chenpangpang
transformers
Commits
49c06132
"tasks/git@developer.sourcefind.cn:wuxk1/megatron-lm.git" did not exist on "80389ef6e28cfe6cb85fe98e5313d6876c4391e4"
Unverified
Commit
49c06132
authored
May 20, 2020
by
Rens
Committed by
GitHub
May 20, 2020
Browse files
pass on tokenizer to pipeline (#4489)
parent
cacb654c
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
1 deletion
+1
-1
src/transformers/convert_graph_to_onnx.py
src/transformers/convert_graph_to_onnx.py
+1
-1
No files found.
src/transformers/convert_graph_to_onnx.py
View file @
49c06132
...
...
@@ -103,7 +103,7 @@ def load_graph_from_args(framework: str, model: str, tokenizer: Optional[str] =
print
(
"Loading pipeline (model: {}, tokenizer: {})"
.
format
(
model
,
tokenizer
))
# Allocate tokenizer and model
return
pipeline
(
"feature-extraction"
,
model
=
model
,
framework
=
framework
)
return
pipeline
(
"feature-extraction"
,
model
=
model
,
tokenizer
=
tokenizer
,
framework
=
framework
)
def
convert_pytorch
(
nlp
:
Pipeline
,
opset
:
int
,
output
:
str
,
use_external_format
:
bool
):
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment