Skip to content

GitLab

Commit 7984983f authored by lintangsutawika's avatar lintangsutawika
Browse files

edit wikitext

parent bb869c27
Hide whitespace changes
Inline Side-by-side
Showing with 7 additions and 4 deletions
lm_eval/tasks/wikitext/README.md
View file @ 7984983f
...@@ -26,7 +26,13 @@ Homepage: https://www.salesforce.com/products/einstein/ai-research/the-wikitext- ...@@ -26,7 +26,13 @@ Homepage: https://www.salesforce.com/products/einstein/ai-research/the-wikitext-
} }
``` ```
### Subtasks ### Groups and Tasks
#### Groups
* Not part of a group yet.
#### Tasks
* `wikitext`: measure perplexity on the Wikitext dataset, via rolling loglikelihoods. * `wikitext`: measure perplexity on the Wikitext dataset, via rolling loglikelihoods.
......
lm_eval/tasks/wikitext/wikitext.yaml
View file @ 7984983f
group:
- perplexity
- loglikelihood_rolling
task: wikitext task: wikitext
dataset_path: EleutherAI/wikitext_document_level dataset_path: EleutherAI/wikitext_document_level
dataset_name: wikitext-2-raw-v1 dataset_name: wikitext-2-raw-v1
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment