Skip to content

GitLab

Commit 79888e16 authored by Mohammad Shoeybi's avatar Mohammad Shoeybi
Browse files

Merge branch 'main_evaluate_wiki' into 'main' 

fixed wiki evaluation

See merge request ADLR/megatron-lm!157
parents 64cf3d98 ef2adb5d
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
tasks/zeroshot_gpt2/detokenizer.py
View file @ 79888e16
...@@ -69,7 +69,7 @@ def lambada_detokenizer(string): ...@@ -69,7 +69,7 @@ def lambada_detokenizer(string):
_DETOKENIZERS = { _DETOKENIZERS = {
'ptb': ptb_detokenizer, 'ptb': ptb_detokenizer,
'wikitext': wikitext_detokenizer, 'wiki': wikitext_detokenizer,
'lambada': lambada_detokenizer, 'lambada': lambada_detokenizer,
} }
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment