Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
3a4e4674
Unverified
Commit
3a4e4674
authored
Jan 21, 2025
by
Minho Ryu
Committed by
GitHub
Jan 21, 2025
Browse files
apply precommit (#2636)
parent
6dac8c69
Changes
1000
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
112 additions
and
0 deletions
+112
-0
lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_humanities.yaml
.../global_mmlu/full/am/_global_mmlu_full_am_humanities.yaml
+8
-0
lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_other.yaml
...tasks/global_mmlu/full/am/_global_mmlu_full_am_other.yaml
+8
-0
lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_social_sciences.yaml
...al_mmlu/full/am/_global_mmlu_full_am_social_sciences.yaml
+8
-0
lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_stem.yaml
.../tasks/global_mmlu/full/am/_global_mmlu_full_am_stem.yaml
+8
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_abstract_algebra.yaml
...al_mmlu/full/am/global_mmlu_full_am_abstract_algebra.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_anatomy.yaml
...asks/global_mmlu/full/am/global_mmlu_full_am_anatomy.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_astronomy.yaml
...ks/global_mmlu/full/am/global_mmlu_full_am_astronomy.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_business_ethics.yaml
...bal_mmlu/full/am/global_mmlu_full_am_business_ethics.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_clinical_knowledge.yaml
..._mmlu/full/am/global_mmlu_full_am_clinical_knowledge.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_biology.yaml
...bal_mmlu/full/am/global_mmlu_full_am_college_biology.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_chemistry.yaml
...l_mmlu/full/am/global_mmlu_full_am_college_chemistry.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_computer_science.yaml
...full/am/global_mmlu_full_am_college_computer_science.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_mathematics.yaml
...mmlu/full/am/global_mmlu_full_am_college_mathematics.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_medicine.yaml
...al_mmlu/full/am/global_mmlu_full_am_college_medicine.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_physics.yaml
...bal_mmlu/full/am/global_mmlu_full_am_college_physics.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_computer_security.yaml
...l_mmlu/full/am/global_mmlu_full_am_computer_security.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_conceptual_physics.yaml
..._mmlu/full/am/global_mmlu_full_am_conceptual_physics.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_econometrics.yaml
...global_mmlu/full/am/global_mmlu_full_am_econometrics.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_electrical_engineering.yaml
...u/full/am/global_mmlu_full_am_electrical_engineering.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_elementary_mathematics.yaml
...u/full/am/global_mmlu_full_am_elementary_mathematics.yaml
+5
-0
No files found.
Too many changes to show.
To preserve performance only
1000 of 1000+
files are displayed.
Plain diff
Email patch
lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_humanities.yaml
0 → 100644
View file @
3a4e4674
group
:
global_mmlu_full_am_humanities
task
:
-
global_mmlu_full_am_humanities_tasks
aggregate_metric_list
:
-
metric
:
acc
weight_by_size
:
true
metadata
:
version
:
0.0
lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_other.yaml
0 → 100644
View file @
3a4e4674
group
:
global_mmlu_full_am_other
task
:
-
global_mmlu_full_am_other_tasks
aggregate_metric_list
:
-
metric
:
acc
weight_by_size
:
true
metadata
:
version
:
0.0
lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_social_sciences.yaml
0 → 100644
View file @
3a4e4674
group
:
global_mmlu_full_am_social_sciences
task
:
-
global_mmlu_full_am_social_sciences_tasks
aggregate_metric_list
:
-
metric
:
acc
weight_by_size
:
true
metadata
:
version
:
0.0
lm_eval/tasks/global_mmlu/full/am/_global_mmlu_full_am_stem.yaml
0 → 100644
View file @
3a4e4674
group
:
global_mmlu_full_am_stem
task
:
-
global_mmlu_full_am_stem_tasks
aggregate_metric_list
:
-
metric
:
acc
weight_by_size
:
true
metadata
:
version
:
0.0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_abstract_algebra.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_abstract_algebra
tag
:
global_mmlu_full_am_stem_tasks
task
:
global_mmlu_full_am_abstract_algebra
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_anatomy.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_anatomy
tag
:
global_mmlu_full_am_stem_tasks
task
:
global_mmlu_full_am_anatomy
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_astronomy.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_astronomy
tag
:
global_mmlu_full_am_stem_tasks
task
:
global_mmlu_full_am_astronomy
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_business_ethics.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_business_ethics
tag
:
global_mmlu_full_am_other_tasks
task
:
global_mmlu_full_am_business_ethics
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_clinical_knowledge.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_clinical_knowledge
tag
:
global_mmlu_full_am_other_tasks
task
:
global_mmlu_full_am_clinical_knowledge
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_biology.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_college_biology
tag
:
global_mmlu_full_am_stem_tasks
task
:
global_mmlu_full_am_college_biology
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_chemistry.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_college_chemistry
tag
:
global_mmlu_full_am_stem_tasks
task
:
global_mmlu_full_am_college_chemistry
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_computer_science.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_college_computer_science
tag
:
global_mmlu_full_am_stem_tasks
task
:
global_mmlu_full_am_college_computer_science
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_mathematics.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_college_mathematics
tag
:
global_mmlu_full_am_stem_tasks
task
:
global_mmlu_full_am_college_mathematics
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_medicine.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_college_medicine
tag
:
global_mmlu_full_am_other_tasks
task
:
global_mmlu_full_am_college_medicine
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_college_physics.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_college_physics
tag
:
global_mmlu_full_am_stem_tasks
task
:
global_mmlu_full_am_college_physics
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_computer_security.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_computer_security
tag
:
global_mmlu_full_am_stem_tasks
task
:
global_mmlu_full_am_computer_security
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_conceptual_physics.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_conceptual_physics
tag
:
global_mmlu_full_am_stem_tasks
task
:
global_mmlu_full_am_conceptual_physics
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_econometrics.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_econometrics
tag
:
global_mmlu_full_am_social_sciences_tasks
task
:
global_mmlu_full_am_econometrics
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_electrical_engineering.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_electrical_engineering
tag
:
global_mmlu_full_am_stem_tasks
task
:
global_mmlu_full_am_electrical_engineering
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_elementary_mathematics.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_elementary_mathematics
tag
:
global_mmlu_full_am_stem_tasks
task
:
global_mmlu_full_am_elementary_mathematics
Prev
1
2
3
4
5
6
…
50
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment