add Darija (Moroccan dialects) tasks including darijammlu. darijahellaswag and darija_bench (#2521)

* add Darija tasks * fix multiple groups issue in darijammlu * add MT to the description of the Darija tasks * Update README.md nit * fix the recursion error caused by the darija_summarization task * use a custom filter instead of the decorator for the strip function --------- Co-authored-by: Baber Abbasi <92168766+baberabb@users.noreply.github.com>

add Darija (Moroccan dialects) tasks including darijammlu. darijahellaswag and darija_bench (#2521)
* add Darija tasks * fix multiple groups issue in darijammlu * add MT to the description of the Darija tasks * Update README.md nit * fix the recursion error caused by the darija_summarization task * use a custom filter instead of the decorator for the strip function --------- Co-authored-by: Baber Abbasi <92168766+baberabb@users.noreply.github.com>
ebbbb968 · Hadi Abdine · GitHub · 5a9d5ba0 · ebbbb968 · ebbbb968
Unverified Commit ebbbb968 authored Mar 28, 2025 by Hadi Abdine Committed by GitHub Mar 28, 2025
9 changed files
--- a/lm_eval/tasks/darijammlu/darijammlu_political_science.yaml
+++ b/lm_eval/tasks/darijammlu/darijammlu_political_science.yaml
--- a/lm_eval/tasks/darijammlu/darijammlu_professional_law.yaml
+++ b/lm_eval/tasks/darijammlu/darijammlu_professional_law.yaml
--- a/lm_eval/tasks/darijammlu/darijammlu_professional_psychology.yaml
+++ b/lm_eval/tasks/darijammlu/darijammlu_professional_psychology.yaml
--- a/lm_eval/tasks/darijammlu/darijammlu_public_relations.yaml
+++ b/lm_eval/tasks/darijammlu/darijammlu_public_relations.yaml
--- a/lm_eval/tasks/darijammlu/darijammlu_security_studies.yaml
+++ b/lm_eval/tasks/darijammlu/darijammlu_security_studies.yaml
--- a/lm_eval/tasks/darijammlu/darijammlu_social_science.yaml
+++ b/lm_eval/tasks/darijammlu/darijammlu_social_science.yaml
--- a/lm_eval/tasks/darijammlu/darijammlu_sociology.yaml
+++ b/lm_eval/tasks/darijammlu/darijammlu_sociology.yaml
--- a/lm_eval/tasks/darijammlu/darijammlu_world_religions.yaml
+++ b/lm_eval/tasks/darijammlu/darijammlu_world_religions.yaml
--- a/lm_eval/tasks/darijammlu/utils.py
+++ b/lm_eval/tasks/darijammlu/utils.py