GitLab

Updated handling for device in lm_eval/models/gpt2.py

* Support bigbench-hard json tasks using multiple_choice_grade

* Add support for greedy decoding in bigbench tasks

* move bigbench_resources to datasets

* rectify changes to rf.greedy_until w upstream

* make path to resource import reflect new location

---------
Co-authored-by: haileyschoelkopf <hailey.schoelkopf@yale.edu>

Document task name wildcard support in README

Hotfix: patch issues with the `huggingface.py` model classes

* Add 8 bit support

* added trust remote code

* Update main.py

* Update huggingface.py

* Update huggingface.py

* Fix bugs

* Fix PR #422 issues

* fix(style): remove empty newline

* fix(stlye,args): run `pre-commit` and re-order args for backward-compat

* fix(style): pre-commit the `README.md`

fix: add seq2seq peft

Update setup.py dependencies

feat: evaluation using peft models with CLM

Update README installation instructions

Change device parameter to cuda:0 to avoid runtime error

* host wikitext on hf

* transfer wikitext to Eleuther HF org

Hosting arithmetic dataset on HuggingFace

[WIP] Upstream `hf-causal` and `hf-seq2seq` model implementations

Enable "low_cpu_mem_usage" to reduce the memory usage of HF models