GitLab

* add self-consistency

* add CoT method Self-Consistency

* fix typo error and update openicl_eval

* add tydiQA-GoldP task

* fix sc

* rename gsm8k_sc

* fix sc

* add self-consistency doc

* refine sc

---------
Authored-by: liushz <qq1791167085@163.com>

* allow explicitly setting the temperature

* update

* support internLM

* support internLM

* simplify intern model files

* update storage_manager

* support internLM

* Modify the file organization structure

* support internLM

* support internLM

* support internLM

* support internLM

* change some details

* update reame and fix failed links

* update

* update review

* [Feat] add auto assignee bot

* minor fix

* [Refactor] Update crows-pairs evaluation

* [Refactor] Update crows-pairs evaluation

* minor

* update

* update

* fix lint

Co-authored-by: Leymore <zfz-960727@163.com>

* add CMMLU

* debug cmmlu

* add slurm args `qos`

* fix format: space before comment

* remove unused variable

* change the location of `answer is`

---------
Co-authored-by: 李浩楠 <lihaonan@lihaonandeMacBook-Air.local>
Co-authored-by: 李浩楠 <haonan.li>
Co-authored-by: Leymore <zfz-960727@163.com>

* [Feature] Add heuristic size partitioner

* update

* add llama-2 models

* update docs

---------
Co-authored-by: gaotongxiao <gaotongxiao@gmail.com>

* [Feat] support CValues

* minor fix

* support peft for HuggingFace model

* add docstring

Co-authored-by: liuhongwei <liuhongwei@pjlab.org.cn>

* [Feat] add falcon-40b

* minor fix

* [Fix] Fix CI

* [Fix] Fix CI

* [Fix] Fix CI

* update

* [Enhancement] Test linting in CI

* fix linting

* [Feature] Add baichuan13b

* update num_gpus

* Add logger info and remove dataset bugs

* fix typo

* [Docs] Polish docs

* apply suggestions

* apply suggestions

* [Feature] Enhance OpenAI API, add example config for GPT evaluation

* fix

* [Feat] add bs for perspective api eval

* fix according to comments

* fix according to comments

* update logo_icon and fix type in docs

* rebase:

* update get_started

* update .gitignore

* remove extra lines

* remove extra 'S'

* update

* update

* update docs

* update docs

* update docs

---------
Co-authored-by: gaotongxiao <gaotongxiao@gmail.com>

* Auto re-generate port number during retry

* Fix slurm command