GitLab

* Support bigbench-hard json tasks using multiple_choice_grade

* Add support for greedy decoding in bigbench tasks

* move bigbench_resources to datasets

* rectify changes to rf.greedy_until w upstream

* make path to resource import reflect new location

---------
Co-authored-by: haileyschoelkopf <hailey.schoelkopf@yale.edu>

* Add 8 bit support

* added trust remote code

* Update main.py

* Update huggingface.py

* Update huggingface.py

* Fix bugs

* Fix PR #422 issues

* fix(style): remove empty newline

* fix(stlye,args): run `pre-commit` and re-order args for backward-compat

* fix(style): pre-commit the `README.md`

* host wikitext on hf

* transfer wikitext to Eleuther HF org

* add accuracy metric to crows-pairs

* Added CrowSPairs

* Fixed Bug

* Changed to absolute Value

* Docstring Changes

* Update crowspairs.py

Finegrained Tasks

* Update __init__.py

* Finegrained Tasks

* Add `crows_pairs` version metadata

* added toxigen task

* removed previous doc_to_text

* Add train split for few-shot samples

* Add task version metadata

* use pile links hosted on the eye

* update links in dataset_infos

This reverts commit 63bdb4b0.

* Add `TextSynth` API

When the continuation list contains a single entry,
make_disjoint_window incorrectly truncates the context list to be
empty.

The fix checks for the non-overlapping case and, in that case, simply
returns the existing lists.