lm_eval/tasks/pile.py · 6653cc509e810752eeda2349c20c315a18c7fd5d · gaoqiong / lm-evaluation-harness · GitLab

"lm_eval/tasks/arabicmmlu/_default_template_yaml" did not exist on "c2c8e2384166edcaf5f46084311334981234422c"

Find file Blame History Permalink

Bump the version number for all tasks based on PerplexityTask · 6653cc50
Igor Ostrovsky authored Dec 30, 2021
```
This is due to the change in the bits_per_byte calculation.
```
6653cc50

pile.py 3.13 KB