Skip to content

GitLab

Commit 38c45de7 authored by Mostofa Patwary's avatar Mostofa Patwary
Browse files

fixed wiki evaluation issue

parent 42d21122
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
tasks/zeroshot_gpt2/detokenizer.py
View file @ 38c45de7
...@@ -70,6 +70,7 @@ def lambada_detokenizer(string): ...@@ -70,6 +70,7 @@ def lambada_detokenizer(string):
_DETOKENIZERS = { _DETOKENIZERS = {
'ptb': ptb_detokenizer, 'ptb': ptb_detokenizer,
'wikitext': wikitext_detokenizer, 'wikitext': wikitext_detokenizer,
'wiki': wikitext_detokenizer,
'lambada': lambada_detokenizer, 'lambada': lambada_detokenizer,
} }
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment