Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
chenpangpang
transformers
Commits
ee1bff06
"next_docs/en/git@developer.sourcefind.cn:wangsen/mineru.git" did not exist on "ea8f7e0fbd8e8b907482b95b12edc8a4093a5c40"
Unverified
Commit
ee1bff06
authored
Sep 02, 2020
by
Harry Wang
Committed by
GitHub
Sep 02, 2020
Browse files
minor docs grammar fixes (#6889)
parent
8abd7f69
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
2 additions
and
2 deletions
+2
-2
docs/source/glossary.rst
docs/source/glossary.rst
+1
-1
docs/source/quicktour.rst
docs/source/quicktour.rst
+1
-1
No files found.
docs/source/glossary.rst
View file @
ee1bff06
...
...
@@ -128,7 +128,7 @@ The encoded versions have different lengths:
>>>
len
(
encoded_sequence_a
),
len
(
encoded_sequence_b
)
(
8
,
19
)
Therefore
,
we
can
't
be
put the
n
together in
a
same tensor as-is. The first sequence needs to be padded up to the length
Therefore
,
we
can
't put the
m
together in
the
same tensor as-is. The first sequence needs to be padded up to the length
of the second one, or the second one needs to be truncated down to the length of the first one.
In the first case, the list of IDs will be extended by the padding indices. We can pass a list to the tokenizer and ask
...
...
docs/source/quicktour.rst
View file @
ee1bff06
...
...
@@ -214,7 +214,7 @@ Using the model
Once
your
input
has
been
preprocessed
by
the
tokenizer
,
you
can
send
it
directly
to
the
model
.
As
we
mentioned
,
it
will
contain
all
the
relevant
information
the
model
needs
.
If
you
're using a TensorFlow model, you can pass the
dictionary keys directly to tensor, for a PyTorch model, you need to unpack the dictionary by adding :obj:`**`.
dictionary keys directly to tensor
s
, for a PyTorch model, you need to unpack the dictionary by adding :obj:`**`.
.. code-block::
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment