Add INCLUDE tasks (#2769)

* Add INCLUDE tasks * pacify pre-commit --------- Co-authored-by: Baber <baber@hey.com>

Add INCLUDE tasks (#2769)
* Add INCLUDE tasks * pacify pre-commit --------- Co-authored-by: Baber <baber@hey.com>
6fbebb4b · Angelika Romanou · GitHub · bb4fa95e · 6fbebb4b · 6fbebb4b
Unverified Commit 6fbebb4b authored Mar 17, 2025 by Angelika Romanou Committed by GitHub Mar 18, 2025
20 changed files
--- a/lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_arts_humanities.yaml
+++ b/lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_arts_humanities.yaml
--- a/lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_driving_license.yaml
+++ b/lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_driving_license.yaml
--- a/lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_social_science.yaml
+++ b/lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_social_science.yaml
--- a/lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_stem.yaml
+++ b/lm_eval/tasks/include/few_shot_og/Armenian/include_base_44_armenian_stem.yaml
--- a/lm_eval/tasks/include/few_shot_og/Armenian/utils.py
+++ b/lm_eval/tasks/include/few_shot_og/Armenian/utils.py
--- a/lm_eval/tasks/include/few_shot_og/Azerbaijani/_azerbaijani_few_shot_og_template_yaml
+++ b/lm_eval/tasks/include/few_shot_og/Azerbaijani/_azerbaijani_few_shot_og_template_yaml
--- a/lm_eval/tasks/include/few_shot_og/Azerbaijani/_include_base_44_azerbaijani.yaml
+++ b/lm_eval/tasks/include/few_shot_og/Azerbaijani/_include_base_44_azerbaijani.yaml
--- a/lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml
+++ b/lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_applied_science.yaml
--- a/lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml
+++ b/lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_arts_humanities.yaml
--- a/lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml
+++ b/lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_business_commerce.yaml
--- a/lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml
+++ b/lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_health_oriented_education.yaml
--- a/lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_social_science.yaml
+++ b/lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_social_science.yaml
--- a/lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_stem.yaml
+++ b/lm_eval/tasks/include/few_shot_og/Azerbaijani/include_base_44_azerbaijani_stem.yaml
--- a/lm_eval/tasks/include/few_shot_og/Azerbaijani/utils.py
+++ b/lm_eval/tasks/include/few_shot_og/Azerbaijani/utils.py
--- a/lm_eval/tasks/include/few_shot_og/Basque/_basque_few_shot_og_template_yaml
+++ b/lm_eval/tasks/include/few_shot_og/Basque/_basque_few_shot_og_template_yaml
--- a/lm_eval/tasks/include/few_shot_og/Basque/_include_base_44_basque.yaml
+++ b/lm_eval/tasks/include/few_shot_og/Basque/_include_base_44_basque.yaml
--- a/lm_eval/tasks/include/few_shot_og/Basque/include_base_44_basque_professional_certification.yaml
+++ b/lm_eval/tasks/include/few_shot_og/Basque/include_base_44_basque_professional_certification.yaml
--- a/lm_eval/tasks/include/few_shot_og/Basque/utils.py
+++ b/lm_eval/tasks/include/few_shot_og/Basque/utils.py
--- a/lm_eval/tasks/include/few_shot_og/Belarusian/_belarusian_few_shot_og_template_yaml
+++ b/lm_eval/tasks/include/few_shot_og/Belarusian/_belarusian_few_shot_og_template_yaml
--- a/lm_eval/tasks/include/few_shot_og/Belarusian/_include_base_44_belarusian.yaml
+++ b/lm_eval/tasks/include/few_shot_og/Belarusian/_include_base_44_belarusian.yaml