Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
chenpangpang
transformers
Commits
cc263e9b
Unverified
Commit
cc263e9b
authored
Oct 04, 2022
by
gouqi_nju
Committed by
GitHub
Oct 04, 2022
Browse files
alter retrived to retrieved (#18863)
parent
9b630168
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
6 additions
and
6 deletions
+6
-6
src/transformers/models/rag/retrieval_rag.py
src/transformers/models/rag/retrieval_rag.py
+6
-6
No files found.
src/transformers/models/rag/retrieval_rag.py
View file @
cc263e9b
...
@@ -612,17 +612,17 @@ class RagRetriever:
...
@@ -612,17 +612,17 @@ class RagRetriever:
)
)
if
self
.
return_tokenized_docs
:
if
self
.
return_tokenized_docs
:
retrived_doc_text
=
[]
retri
e
ved_doc_text
=
[]
retrived_doc_title
=
[]
retri
e
ved_doc_title
=
[]
for
b_idx
in
range
(
len
(
docs
)):
for
b_idx
in
range
(
len
(
docs
)):
for
doc_idx
in
range
(
n_docs
):
for
doc_idx
in
range
(
n_docs
):
retrived_doc_text
.
append
(
docs
[
b_idx
][
"text"
][
doc_idx
])
retri
e
ved_doc_text
.
append
(
docs
[
b_idx
][
"text"
][
doc_idx
])
retrived_doc_title
.
append
(
docs
[
b_idx
][
"title"
][
doc_idx
])
retri
e
ved_doc_title
.
append
(
docs
[
b_idx
][
"title"
][
doc_idx
])
tokenized_docs
=
self
.
ctx_encoder_tokenizer
(
tokenized_docs
=
self
.
ctx_encoder_tokenizer
(
retrived_doc_title
,
retri
e
ved_doc_title
,
retrived_doc_text
,
retri
e
ved_doc_text
,
truncation
=
True
,
truncation
=
True
,
padding
=
"longest"
,
padding
=
"longest"
,
return_tensors
=
return_tensors
,
return_tensors
=
return_tensors
,
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment