Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
chenpangpang
transformers
Commits
7af2791d
"...git@developer.sourcefind.cn:chenpangpang/ComfyUI.git" did not exist on "1f2f4eaa6f04660a7df7d71eede3118d09b1c2c2"
Unverified
Commit
7af2791d
authored
Sep 15, 2020
by
Patrick von Platen
Committed by
GitHub
Sep 15, 2020
Browse files
Create README.md
parent
153ec2f1
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
24 additions
and
0 deletions
+24
-0
model_cards/facebook/rag-token-nq_new/README.md
model_cards/facebook/rag-token-nq_new/README.md
+24
-0
No files found.
model_cards/facebook/rag-token-nq_new/README.md
0 → 100644
View file @
7af2791d
The model can be loaded and used as follows on
[
this branch
](
https://github.com/huggingface/transformers/tree/finalize_rag
)
as follows.
# Load model
```
python
from
transformers
import
RagTokenizer
,
RagTokenForGeneration
,
RagRetriever
# create Retriever augmented model
retriever
=
RagRetriever
.
from_pretrained
(
"facebook/rag-token-nq_new"
,
use_dummy_dataset
=
True
)
model
=
RagTokenForGeneration
.
from_pretrained
(
"facebook/rag-token-nq_new"
,
retriever
=
retriever
)
tokenizer
=
RagTokenizer
.
from_pretrained
(
"facebook/rag-token-nq_new"
)
# create input ids and labels
input_ids
=
tokenizer
(
"who sings does he love me with reba"
,
return_tensors
=
"pt"
).
input_ids
# use labels
labels
=
tokenizer
.
generator
(
"Linda Davis"
,
return_tensors
=
"pt"
).
input_ids
# compute loss
outputs
=
model
(
input_ids
,
labels
=
labels
)
```
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment