GitLab

Co-authored-by: kennymckormick <dhd@pku.edu.cn>

* [Feat] update postprocessor to get first option

* minor fix

* minor fix

* add llama-oriented dataset configs

* update

* revert cvalues & update llama_example

* [Feat] add safety to collections

* minor fix

[Enhancement] Add humaneval postprocessor for GPT models & eval config for GPT4, enhance the original humaneval postprocessor (#129)

* [Enhancement] Enhance humaneval postprocessor

* add human-eval testcase

* update

* update

---------
Co-authored-by: Leymore <zfz-960727@163.com>

* add Xiezhi SQuAD2.0 ANLI; update WSC

* update

* update

* update doc string

* update agieval data

* rename variables

* [Feature] Support evaluating acc based on minimum edit distance, update SIQA

* update

* add self-consistency

* add CoT method Self-Consistency

* fix typo error and update openicl_eval

* add tydiQA-GoldP task

* fix sc

* rename gsm8k_sc

* fix sc

* add self-consistency doc

* refine sc

---------
Authored-by: liushz <qq1791167085@163.com>

* [Refactor] Update crows-pairs evaluation

* [Refactor] Update crows-pairs evaluation

* minor

* add CMMLU

* debug cmmlu

* add slurm args `qos`

* fix format: space before comment

* remove unused variable

* change the location of `answer is`

---------
Co-authored-by: 李浩楠 <lihaonan@lihaonandeMacBook-Air.local>
Co-authored-by: 李浩楠 <haonan.li>
Co-authored-by: Leymore <zfz-960727@163.com>

* [Feat] support CValues

* minor fix

Co-authored-by: liuhongwei <liuhongwei@pjlab.org.cn>

* Add logger info and remove dataset bugs

* fix typo

* Update implements

* Update

* fix bbh

* fix bbh

* rename