Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
3a4e4674
Unverified
Commit
3a4e4674
authored
Jan 21, 2025
by
Minho Ryu
Committed by
GitHub
Jan 21, 2025
Browse files
apply precommit (#2636)
parent
6dac8c69
Changes
1000
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
100 additions
and
0 deletions
+100
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_logical_fallacies.yaml
...l_mmlu/full/am/global_mmlu_full_am_logical_fallacies.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_machine_learning.yaml
...al_mmlu/full/am/global_mmlu_full_am_machine_learning.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_management.yaml
...s/global_mmlu/full/am/global_mmlu_full_am_management.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_marketing.yaml
...ks/global_mmlu/full/am/global_mmlu_full_am_marketing.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_medical_genetics.yaml
...al_mmlu/full/am/global_mmlu_full_am_medical_genetics.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_miscellaneous.yaml
...lobal_mmlu/full/am/global_mmlu_full_am_miscellaneous.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_moral_disputes.yaml
...obal_mmlu/full/am/global_mmlu_full_am_moral_disputes.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_moral_scenarios.yaml
...bal_mmlu/full/am/global_mmlu_full_am_moral_scenarios.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_nutrition.yaml
...ks/global_mmlu/full/am/global_mmlu_full_am_nutrition.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_philosophy.yaml
...s/global_mmlu/full/am/global_mmlu_full_am_philosophy.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_prehistory.yaml
...s/global_mmlu/full/am/global_mmlu_full_am_prehistory.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_accounting.yaml
.../full/am/global_mmlu_full_am_professional_accounting.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_law.yaml
...al_mmlu/full/am/global_mmlu_full_am_professional_law.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_medicine.yaml
...lu/full/am/global_mmlu_full_am_professional_medicine.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_psychology.yaml
.../full/am/global_mmlu_full_am_professional_psychology.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_public_relations.yaml
...al_mmlu/full/am/global_mmlu_full_am_public_relations.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_security_studies.yaml
...al_mmlu/full/am/global_mmlu_full_am_security_studies.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_sociology.yaml
...ks/global_mmlu/full/am/global_mmlu_full_am_sociology.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_us_foreign_policy.yaml
...l_mmlu/full/am/global_mmlu_full_am_us_foreign_policy.yaml
+5
-0
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_virology.yaml
...sks/global_mmlu/full/am/global_mmlu_full_am_virology.yaml
+5
-0
No files found.
Too many changes to show.
To preserve performance only
1000 of 1000+
files are displayed.
Plain diff
Email patch
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_logical_fallacies.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_logical_fallacies
tag
:
global_mmlu_full_am_humanities_tasks
task
:
global_mmlu_full_am_logical_fallacies
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_machine_learning.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_machine_learning
tag
:
global_mmlu_full_am_stem_tasks
task
:
global_mmlu_full_am_machine_learning
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_management.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_management
tag
:
global_mmlu_full_am_other_tasks
task
:
global_mmlu_full_am_management
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_marketing.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_marketing
tag
:
global_mmlu_full_am_other_tasks
task
:
global_mmlu_full_am_marketing
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_medical_genetics.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_medical_genetics
tag
:
global_mmlu_full_am_other_tasks
task
:
global_mmlu_full_am_medical_genetics
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_miscellaneous.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_miscellaneous
tag
:
global_mmlu_full_am_other_tasks
task
:
global_mmlu_full_am_miscellaneous
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_moral_disputes.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_moral_disputes
tag
:
global_mmlu_full_am_humanities_tasks
task
:
global_mmlu_full_am_moral_disputes
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_moral_scenarios.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_moral_scenarios
tag
:
global_mmlu_full_am_humanities_tasks
task
:
global_mmlu_full_am_moral_scenarios
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_nutrition.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_nutrition
tag
:
global_mmlu_full_am_other_tasks
task
:
global_mmlu_full_am_nutrition
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_philosophy.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_philosophy
tag
:
global_mmlu_full_am_humanities_tasks
task
:
global_mmlu_full_am_philosophy
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_prehistory.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_prehistory
tag
:
global_mmlu_full_am_humanities_tasks
task
:
global_mmlu_full_am_prehistory
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_accounting.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_professional_accounting
tag
:
global_mmlu_full_am_other_tasks
task
:
global_mmlu_full_am_professional_accounting
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_law.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_professional_law
tag
:
global_mmlu_full_am_humanities_tasks
task
:
global_mmlu_full_am_professional_law
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_medicine.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_professional_medicine
tag
:
global_mmlu_full_am_other_tasks
task
:
global_mmlu_full_am_professional_medicine
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_professional_psychology.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_professional_psychology
tag
:
global_mmlu_full_am_social_sciences_tasks
task
:
global_mmlu_full_am_professional_psychology
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_public_relations.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_public_relations
tag
:
global_mmlu_full_am_social_sciences_tasks
task
:
global_mmlu_full_am_public_relations
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_security_studies.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_security_studies
tag
:
global_mmlu_full_am_social_sciences_tasks
task
:
global_mmlu_full_am_security_studies
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_sociology.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_sociology
tag
:
global_mmlu_full_am_social_sciences_tasks
task
:
global_mmlu_full_am_sociology
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_us_foreign_policy.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_us_foreign_policy
tag
:
global_mmlu_full_am_social_sciences_tasks
task
:
global_mmlu_full_am_us_foreign_policy
lm_eval/tasks/global_mmlu/full/am/global_mmlu_full_am_virology.yaml
0 → 100644
View file @
3a4e4674
# Generated by _generate_configs.py
include
:
_am_template_yaml
process_docs
:
!function
utils.process_virology
tag
:
global_mmlu_full_am_other_tasks
task
:
global_mmlu_full_am_virology
Prev
1
2
3
4
5
6
7
8
…
50
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment