Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
3a4e4674
Unverified
Commit
3a4e4674
authored
Jan 21, 2025
by
Minho Ryu
Committed by
GitHub
Jan 21, 2025
Browse files
apply precommit (#2636)
parent
6dac8c69
Changes
1000
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
100 additions
and
0 deletions
+100
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_formal_logic.yaml
...global_mmlu/full/am/global_mmlu_full_am_formal_logic.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_global_facts.yaml
...global_mmlu/full/am/global_mmlu_full_am_global_facts.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_biology.yaml
...mmlu/full/am/global_mmlu_full_am_high_school_biology.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_chemistry.yaml
...lu/full/am/global_mmlu_full_am_high_school_chemistry.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_computer_science.yaml
.../am/global_mmlu_full_am_high_school_computer_science.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_european_history.yaml
.../am/global_mmlu_full_am_high_school_european_history.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_geography.yaml
...lu/full/am/global_mmlu_full_am_high_school_geography.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_government_and_politics.yaml
...bal_mmlu_full_am_high_school_government_and_politics.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_macroeconomics.yaml
...ll/am/global_mmlu_full_am_high_school_macroeconomics.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_mathematics.yaml
.../full/am/global_mmlu_full_am_high_school_mathematics.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_microeconomics.yaml
...ll/am/global_mmlu_full_am_high_school_microeconomics.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_physics.yaml
...mmlu/full/am/global_mmlu_full_am_high_school_physics.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_psychology.yaml
...u/full/am/global_mmlu_full_am_high_school_psychology.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_statistics.yaml
...u/full/am/global_mmlu_full_am_high_school_statistics.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_us_history.yaml
...u/full/am/global_mmlu_full_am_high_school_us_history.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_world_history.yaml
...ull/am/global_mmlu_full_am_high_school_world_history.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_human_aging.yaml
.../global_mmlu/full/am/global_mmlu_full_am_human_aging.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_human_sexuality.yaml
...bal_mmlu/full/am/global_mmlu_full_am_human_sexuality.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_international_law.yaml
...l_mmlu/full/am/global_mmlu_full_am_international_law.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_jurisprudence.yaml
...lobal_mmlu/full/am/global_mmlu_full_am_jurisprudence.yaml
+5
-0
No files found.
Too many changes to show.
To preserve performance only
1000 of 1000+
files are displayed.
Plain diff
Email patch
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_formal_logic.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_formal_logic
tag
:
global_mmlu_full_am_humanities_tasks
task
:
global_mmlu_full_am_formal_logic
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_global_facts.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_global_facts
tag
:
global_mmlu_full_am_other_tasks
task
:
global_mmlu_full_am_global_facts
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_biology.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_high_school_biology
tag
:
global_mmlu_full_am_stem_tasks
task
:
global_mmlu_full_am_high_school_biology
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_chemistry.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_high_school_chemistry
tag
:
global_mmlu_full_am_stem_tasks
task
:
global_mmlu_full_am_high_school_chemistry
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_computer_science.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_high_school_computer_science
tag
:
global_mmlu_full_am_stem_tasks
task
:
global_mmlu_full_am_high_school_computer_science
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_european_history.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_high_school_european_history
tag
:
global_mmlu_full_am_humanities_tasks
task
:
global_mmlu_full_am_high_school_european_history
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_geography.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_high_school_geography
tag
:
global_mmlu_full_am_social_sciences_tasks
task
:
global_mmlu_full_am_high_school_geography
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_government_and_politics.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_high_school_government_and_politics
tag
:
global_mmlu_full_am_social_sciences_tasks
task
:
global_mmlu_full_am_high_school_government_and_politics
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_macroeconomics.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_high_school_macroeconomics
tag
:
global_mmlu_full_am_social_sciences_tasks
task
:
global_mmlu_full_am_high_school_macroeconomics
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_mathematics.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_high_school_mathematics
tag
:
global_mmlu_full_am_stem_tasks
task
:
global_mmlu_full_am_high_school_mathematics
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_microeconomics.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_high_school_microeconomics
tag
:
global_mmlu_full_am_social_sciences_tasks
task
:
global_mmlu_full_am_high_school_microeconomics
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_physics.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_high_school_physics
tag
:
global_mmlu_full_am_stem_tasks
task
:
global_mmlu_full_am_high_school_physics
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_psychology.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_high_school_psychology
tag
:
global_mmlu_full_am_social_sciences_tasks
task
:
global_mmlu_full_am_high_school_psychology
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_statistics.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_high_school_statistics
tag
:
global_mmlu_full_am_stem_tasks
task
:
global_mmlu_full_am_high_school_statistics
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_us_history.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_high_school_us_history
tag
:
global_mmlu_full_am_humanities_tasks
task
:
global_mmlu_full_am_high_school_us_history
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_high_school_world_history.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_high_school_world_history
tag
:
global_mmlu_full_am_humanities_tasks
task
:
global_mmlu_full_am_high_school_world_history
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_human_aging.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_human_aging
tag
:
global_mmlu_full_am_other_tasks
task
:
global_mmlu_full_am_human_aging
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_human_sexuality.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_human_sexuality
tag
:
global_mmlu_full_am_social_sciences_tasks
task
:
global_mmlu_full_am_human_sexuality
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_international_law.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_international_law
tag
:
global_mmlu_full_am_humanities_tasks
task
:
global_mmlu_full_am_international_law
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_jurisprudence.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_jurisprudence
tag
:
global_mmlu_full_am_humanities_tasks
task
:
global_mmlu_full_am_jurisprudence
Prev
1
2
3
4
5
6
7
…
50
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment