Merge branch 'big-refactor' of https://github.com/EleutherAI/lm-evaluation-harness into squadv2

3263c572 · lintangsutawika · a27e8ed1 · 33d52483 · 3263c572 · 3263c572
Commit 3263c572 authored Sep 18, 2023 by lintangsutawika
14 changed files
--- a/lm_eval/tasks/wsc273/default.yaml
+++ b/lm_eval/tasks/wsc273/default.yaml
--- a/lm_eval/tasks/wsc273/utils.py
+++ b/lm_eval/tasks/wsc273/utils.py
--- a/lm_eval/utils.py
+++ b/lm_eval/utils.py
--- a/main.py
+++ b/main.py
--- a/mypy.ini
+++ b/mypy.ini
--- a/pyproject.toml
+++ b/pyproject.toml
--- a/scripts/write_out.py
+++ b/scripts/write_out.py
--- a/setup.py
+++ b/setup.py
--- a/tests/extra/test_new_tasks.py
+++ b/tests/extra/test_new_tasks.py
--- a/tests/extra/test_utils.py
+++ b/tests/extra/test_utils.py
--- a/tests/models/test_huggingface.py
+++ b/tests/models/test_huggingface.py
--- a/tests/test_evaluator.py
+++ b/tests/test_evaluator.py
--- a/tests/test_tasks.py
+++ b/tests/test_tasks.py
--- a/tests/extra/utilities_testing.py
+++ b/tests/extra/utilities_testing.py