Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
3a4e4674
Unverified
Commit
3a4e4674
authored
Jan 21, 2025
by
Minho Ryu
Committed by
GitHub
Jan 21, 2025
Browse files
apply precommit (#2636)
parent
6dac8c69
Changes
1000
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
100 additions
and
0 deletions
+100
-0
lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_conceptual_physics.yaml
..._mmlu/full/ar/global_mmlu_full_ar_conceptual_physics.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_econometrics.yaml
...global_mmlu/full/ar/global_mmlu_full_ar_econometrics.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_electrical_engineering.yaml
...u/full/ar/global_mmlu_full_ar_electrical_engineering.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_elementary_mathematics.yaml
...u/full/ar/global_mmlu_full_ar_elementary_mathematics.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_formal_logic.yaml
...global_mmlu/full/ar/global_mmlu_full_ar_formal_logic.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_global_facts.yaml
...global_mmlu/full/ar/global_mmlu_full_ar_global_facts.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_biology.yaml
...mmlu/full/ar/global_mmlu_full_ar_high_school_biology.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_chemistry.yaml
...lu/full/ar/global_mmlu_full_ar_high_school_chemistry.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_computer_science.yaml
.../ar/global_mmlu_full_ar_high_school_computer_science.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_european_history.yaml
.../ar/global_mmlu_full_ar_high_school_european_history.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_geography.yaml
...lu/full/ar/global_mmlu_full_ar_high_school_geography.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_government_and_politics.yaml
...bal_mmlu_full_ar_high_school_government_and_politics.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_macroeconomics.yaml
...ll/ar/global_mmlu_full_ar_high_school_macroeconomics.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_mathematics.yaml
.../full/ar/global_mmlu_full_ar_high_school_mathematics.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_microeconomics.yaml
...ll/ar/global_mmlu_full_ar_high_school_microeconomics.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_physics.yaml
...mmlu/full/ar/global_mmlu_full_ar_high_school_physics.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_psychology.yaml
...u/full/ar/global_mmlu_full_ar_high_school_psychology.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_statistics.yaml
...u/full/ar/global_mmlu_full_ar_high_school_statistics.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_us_history.yaml
...u/full/ar/global_mmlu_full_ar_high_school_us_history.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_world_history.yaml
...ull/ar/global_mmlu_full_ar_high_school_world_history.yaml
+5
-0
No files found.
Too many changes to show.
To preserve performance only
1000 of 1000+
files are displayed.
Plain diff
Email patch
lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_conceptual_physics.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_ar_template_yaml
process_docs
:
!function
utils.process_conceptual_physics
tag
:
global_mmlu_full_ar_stem_tasks
task
:
global_mmlu_full_ar_conceptual_physics
lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_econometrics.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_ar_template_yaml
process_docs
:
!function
utils.process_econometrics
tag
:
global_mmlu_full_ar_social_sciences_tasks
task
:
global_mmlu_full_ar_econometrics
lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_electrical_engineering.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_ar_template_yaml
process_docs
:
!function
utils.process_electrical_engineering
tag
:
global_mmlu_full_ar_stem_tasks
task
:
global_mmlu_full_ar_electrical_engineering
lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_elementary_mathematics.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_ar_template_yaml
process_docs
:
!function
utils.process_elementary_mathematics
tag
:
global_mmlu_full_ar_stem_tasks
task
:
global_mmlu_full_ar_elementary_mathematics
lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_formal_logic.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_ar_template_yaml
process_docs
:
!function
utils.process_formal_logic
tag
:
global_mmlu_full_ar_humanities_tasks
task
:
global_mmlu_full_ar_formal_logic
lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_global_facts.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_ar_template_yaml
process_docs
:
!function
utils.process_global_facts
tag
:
global_mmlu_full_ar_other_tasks
task
:
global_mmlu_full_ar_global_facts
lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_biology.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_ar_template_yaml
process_docs
:
!function
utils.process_high_school_biology
tag
:
global_mmlu_full_ar_stem_tasks
task
:
global_mmlu_full_ar_high_school_biology
lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_chemistry.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_ar_template_yaml
process_docs
:
!function
utils.process_high_school_chemistry
tag
:
global_mmlu_full_ar_stem_tasks
task
:
global_mmlu_full_ar_high_school_chemistry
lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_computer_science.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_ar_template_yaml
process_docs
:
!function
utils.process_high_school_computer_science
tag
:
global_mmlu_full_ar_stem_tasks
task
:
global_mmlu_full_ar_high_school_computer_science
lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_european_history.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_ar_template_yaml
process_docs
:
!function
utils.process_high_school_european_history
tag
:
global_mmlu_full_ar_humanities_tasks
task
:
global_mmlu_full_ar_high_school_european_history
lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_geography.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_ar_template_yaml
process_docs
:
!function
utils.process_high_school_geography
tag
:
global_mmlu_full_ar_social_sciences_tasks
task
:
global_mmlu_full_ar_high_school_geography
lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_government_and_politics.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_ar_template_yaml
process_docs
:
!function
utils.process_high_school_government_and_politics
tag
:
global_mmlu_full_ar_social_sciences_tasks
task
:
global_mmlu_full_ar_high_school_government_and_politics
lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_macroeconomics.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_ar_template_yaml
process_docs
:
!function
utils.process_high_school_macroeconomics
tag
:
global_mmlu_full_ar_social_sciences_tasks
task
:
global_mmlu_full_ar_high_school_macroeconomics
lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_mathematics.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_ar_template_yaml
process_docs
:
!function
utils.process_high_school_mathematics
tag
:
global_mmlu_full_ar_stem_tasks
task
:
global_mmlu_full_ar_high_school_mathematics
lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_microeconomics.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_ar_template_yaml
process_docs
:
!function
utils.process_high_school_microeconomics
tag
:
global_mmlu_full_ar_social_sciences_tasks
task
:
global_mmlu_full_ar_high_school_microeconomics
lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_physics.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_ar_template_yaml
process_docs
:
!function
utils.process_high_school_physics
tag
:
global_mmlu_full_ar_stem_tasks
task
:
global_mmlu_full_ar_high_school_physics
lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_psychology.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_ar_template_yaml
process_docs
:
!function
utils.process_high_school_psychology
tag
:
global_mmlu_full_ar_social_sciences_tasks
task
:
global_mmlu_full_ar_high_school_psychology
lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_statistics.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_ar_template_yaml
process_docs
:
!function
utils.process_high_school_statistics
tag
:
global_mmlu_full_ar_stem_tasks
task
:
global_mmlu_full_ar_high_school_statistics
lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_us_history.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_ar_template_yaml
process_docs
:
!function
utils.process_high_school_us_history
tag
:
global_mmlu_full_ar_humanities_tasks
task
:
global_mmlu_full_ar_high_school_us_history
lm_eval/tasks/global_mmlu/full/ar/global_mmlu_full_ar_high_school_world_history.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_ar_template_yaml
process_docs
:
!function
utils.process_high_school_world_history
tag
:
global_mmlu_full_ar_humanities_tasks
task
:
global_mmlu_full_ar_high_school_world_history
Prev
1
2
3
4
5
6
7
8
9
10
…
50
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment