GitLab

Best-download have backward compatibility issue

Fix multirc

Replace `fewshot_description` API with a `description_dict` based interface

Merge branch 'master' of github.com:EleutherAI/lm-evaluation-harness into evaluator-description-option

Merge branch 'evaluator-description-option' of https://github.com/jon-tow/lm-evaluation-harness into evaluator-description-option

add asdiv task

Fix bits_per_byte metric in PerplexityTask

# Conflicts:
#	lm_eval/tasks/pile.py

Nit on BoolQ

This is due to the change in the bits_per_byte calculation.

This reverts commit 23a42067.

We can have fallback instead after @researcher2 implements it in best_download

Allow users to specify headqa subset