GitLab

Fix BUG: TypeError: create_from_arg_string() takes 2 positional arguments but 3 were given

This reverts commit 05590e11.

Update `headqa` deprecation warning to display on init only

Fix CB

Conform `asidv` to the new description api

Best download fix

Best-download have backward compatibility issue

Fix multirc

Replace `fewshot_description` API with a `description_dict` based interface

Merge branch 'master' of github.com:EleutherAI/lm-evaluation-harness into evaluator-description-option

Merge branch 'evaluator-description-option' of https://github.com/jon-tow/lm-evaluation-harness into evaluator-description-option

add asdiv task

Fix bits_per_byte metric in PerplexityTask

# Conflicts:
#	lm_eval/tasks/pile.py

Nit on BoolQ

This is due to the change in the bits_per_byte calculation.