GitLab

Merge branch 'dataset-metric-log' of github.com:EleutherAI/lm-evaluation-harness into dataset-metric-log

fixed typo

* add wip gsm8k yaml

* cleanup tasks dir

* push gsm8k yaml changes

* rename gpt2.py

* add updated gsm8k , triviaqa baseline

* add new cot yaml

* allow for multiple filter pipelines, new filter types

* updated gsm8k + sampling gen configs

* cleanup self-consistency yaml

Merge branch 'big-refactor' of https://github.com/EleutherAI/lm-evaluation-harness into big-refactor

[Refactor] Make promptsource an extra / not required for installation