afrimmlu folder update

f64b943d · Israel Abebe Azime · 64490d95 · 64490d95
Commit f64b943d authored May 08, 2024 by Israel Abebe Azime
Hide whitespace changes
Inline Side-by-side

Showing with 0 additions and 13 deletions

lm_eval/tasks/masakhane/utils.py lm_eval/tasks/masakhane/utils.py +0 -13

No files found.
--- a/lm_eval/tasks/masakhane/utils.py
+++ b/lm_eval/tasks/masakhane/utils.py
-from sklearn.metrics import f1_score
-def doc_to_choice(doc):
-    choices = eval(doc["choices"])
-    return choices
-def weighted_f1_score(items):
-    unzipped_list = list(zip(*items))
-    golds = unzipped_list[0]
-    preds = unzipped_list[1]
-    fscore = f1_score(golds, preds, average="weighted")
-    return fscore
\ No newline at end of file