Unverified Commit 8aa01d2a authored by Sasha Luccioni's avatar Sasha Luccioni Committed by GitHub
Browse files

Create perplexity.rst (#13004)

Updating the import for load_dataset
parent 83e5a106
...@@ -96,7 +96,7 @@ dataset in memory. ...@@ -96,7 +96,7 @@ dataset in memory.
.. code-block:: python .. code-block:: python
from nlp import load_dataset from datasets import load_dataset
test = load_dataset('wikitext', 'wikitext-2-raw-v1', split='test') test = load_dataset('wikitext', 'wikitext-2-raw-v1', split='test')
encodings = tokenizer('\n\n'.join(test['text']), return_tensors='pt') encodings = tokenizer('\n\n'.join(test['text']), return_tensors='pt')
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment