Merge branch 'main' of https://github.com/EleutherAI/lm-evaluation-harness into t5v2-alt-plus

02e841ce · lintangsutawika · 90ad5db7 · e74ec966 · 02e841ce · 02e841ce
Commit 02e841ce authored Mar 14, 2024 by lintangsutawika
14 changed files
--- a/lm_eval/tasks/unscramble/anagrams1.yaml
+++ b/lm_eval/tasks/unscramble/anagrams1.yaml
--- a/lm_eval/tasks/unscramble/anagrams2.yaml
+++ b/lm_eval/tasks/unscramble/anagrams2.yaml
--- a/lm_eval/tasks/unscramble/cycle_letters.yaml
+++ b/lm_eval/tasks/unscramble/cycle_letters.yaml
--- a/lm_eval/tasks/unscramble/random_insertion.yaml
+++ b/lm_eval/tasks/unscramble/random_insertion.yaml
--- a/lm_eval/tasks/wikitext/wikitext.yaml
+++ b/lm_eval/tasks/wikitext/wikitext.yaml
--- a/lm_eval/tasks/wmdp/README.md
+++ b/lm_eval/tasks/wmdp/README.md
--- a/lm_eval/tasks/wmdp/_default_template_yaml
+++ b/lm_eval/tasks/wmdp/_default_template_yaml
--- a/lm_eval/tasks/wmdp/wmdp_bio.yaml
+++ b/lm_eval/tasks/wmdp/wmdp_bio.yaml
--- a/lm_eval/tasks/wmdp/wmdp_chem.yaml
+++ b/lm_eval/tasks/wmdp/wmdp_chem.yaml
--- a/lm_eval/tasks/wmdp/wmdp_cyber.yaml
+++ b/lm_eval/tasks/wmdp/wmdp_cyber.yaml
--- a/pyproject.toml
+++ b/pyproject.toml
--- a/scripts/clean_training_data/janitor_util.cpp
+++ b/scripts/clean_training_data/janitor_util.cpp
--- a/scripts/cost_estimate.py
+++ b/scripts/cost_estimate.py
--- a/tests/test_tasks.py
+++ b/tests/test_tasks.py