"vscode:/vscode.git/clone" did not exist on "a91a22567d03ff66c7867c6c9ca87390e455509b"
Unverified Commit 6dac8c69 authored by Boda Sadallah's avatar Boda Sadallah Committed by GitHub
Browse files

New arabicmmlu (#2541)

* point to the original ArabicMMLU dataset

* create the new subtasks files

* fix bug when the context filed is empty
parent a5c344cf
"dataset_name": "Univ Accounting"
"tag": "arabicmmlu_social_science_tasks"
"include": "_default_arabicmmlu_template_yaml"
"task": "arabicmmlu_univ_accounting"
"task_alias": "Univ Accounting"
"dataset_name": "Univ Computer Science"
"tag": "arabicmmlu_stem_tasks"
"include": "_default_arabicmmlu_template_yaml"
"task": "arabicmmlu_univ_computer_science"
"task_alias": "Univ Computer Science"
"dataset_name": "Univ Economics"
"tag": "arabicmmlu_social_science_tasks"
"include": "_default_arabicmmlu_template_yaml"
"task": "arabicmmlu_univ_economics"
"task_alias": "Univ Economics"
"dataset_name": "Univ Political Science"
"tag": "arabicmmlu_social_science_tasks"
"include": "_default_arabicmmlu_template_yaml"
"task": "arabicmmlu_univ_political_science"
"task_alias": "Univ Political Science"
...@@ -23,7 +23,7 @@ def doc_to_text(doc): ...@@ -23,7 +23,7 @@ def doc_to_text(doc):
question = ( question = (
doc["Question"] doc["Question"]
if doc["Context"] == "" if not doc["Context"]
else f"{doc['Context']}\n\n{doc['Question']}" else f"{doc['Context']}\n\n{doc['Question']}"
) )
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment