GitLab

Fix automatic batching for greedy_until
Fix stop sequences bug for greedy_until
Fix max length bug when model max length is not specified in tokenizer

* Support bigbench-hard json tasks using multiple_choice_grade

* Add support for greedy decoding in bigbench tasks

* move bigbench_resources to datasets

* rectify changes to rf.greedy_until w upstream

* make path to resource import reflect new location

---------
Co-authored-by: haileyschoelkopf <hailey.schoelkopf@yale.edu>

* Add 8 bit support

* added trust remote code

* Update main.py

* Update huggingface.py

* Update huggingface.py

* Fix bugs

* Fix PR #422 issues

* fix(style): remove empty newline

* fix(stlye,args): run `pre-commit` and re-order args for backward-compat

* fix(style): pre-commit the `README.md`

* host wikitext on hf

* transfer wikitext to Eleuther HF org

ll_rolling computes adaptive bs separately and passes computed bs to _ll_tokens to avoid recomputation

* add accuracy metric to crows-pairs

* Added CrowSPairs

* Fixed Bug

* Changed to absolute Value

* Docstring Changes

* Update crowspairs.py

Finegrained Tasks

* Update __init__.py

* Finegrained Tasks

* Add `crows_pairs` version metadata

* added toxigen task

* removed previous doc_to_text

* Add train split for few-shot samples

* Add task version metadata

* use pile links hosted on the eye

* update links in dataset_infos