Merge branch 'main_evaluate_wiki' into 'main'

fixed wiki evaluation See merge request ADLR/megatron-lm!157

Merge branch 'main_evaluate_wiki' into 'main'
fixed wiki evaluation See merge request ADLR/megatron-lm!157
79888e16 · Mohammad Shoeybi · 64cf3d98 · ef2adb5d · 79888e16
Commit 79888e16 authored Oct 14, 2020 by Mohammad Shoeybi
Hide whitespace changes
Inline Side-by-side

Showing with 1 addition and 1 deletion

tasks/zeroshot_gpt2/detokenizer.py tasks/zeroshot_gpt2/detokenizer.py +1 -1

No files found.
--- a/tasks/zeroshot_gpt2/detokenizer.py
+++ b/tasks/zeroshot_gpt2/detokenizer.py
@@ -69,7 +69,7 @@ def lambada_detokenizer(string):

 _DETOKENIZERS = {
    'ptb': ptb_detokenizer,
-    'wikitext': wikitext_detokenizer,
+    'wiki': wikitext_detokenizer,
    'lambada': lambada_detokenizer,
 }