GitLab

* update medbench

* medbench update

* format medbench

* format

---------
Co-authored-by: 施晓明 <PJLAB\shixiaoming@pjnl104220118l.pjlab.org>
Co-authored-by: Leymore <zfz-960727@163.com>

* TabMWP

* TabMWP

* fixed

* fixed

* fixed

* done

* done

* done

* add new subjective judgement

* add new subjective judgement

* add new subjective judgement

* add new subjective judgement

* add new subjective judgement

* modified to a more general way

* modified to a more general way

* final

* final

* add summarizer

* add new summarize

* fixed

* fixed

* fixed

---------
Co-authored-by: caomaosong <caomaosong@pjlab.org.cn>

* Add WikiBench

* Add WikiBench

* format

---------
Co-authored-by: Leymore <zfz-960727@163.com>

* add Chinese version: csqa crowspairs nq

* Update cn_data

* Update cn_data

* update format

---------
Co-authored-by: liuhongwei <liuhongwei@pjlab.org.cn>
Co-authored-by: Leymore <zfz-960727@163.com>

* Add SVAMP dataset

* Add SVAMP dataset

* Add SVAMP dataset

* Add gsm_hard dataset

* Add gsm_hard dataset

* format

---------
Co-authored-by: Leymore <zfz-960727@163.com>

* refactor default, add circular summarizer

* add circular

* update impl

* update doc

* minor update

* no more to be added

* Add SVAMP dataset

* Add SVAMP dataset

* Add SVAMP dataset

* rename

* fix sub bugs and update docs

* update

* update

* [feat] add clozeTesst_maxmin dataset

* [feat] add py150 datasets

* [feat] change __init__.py in opencompass/datasets

* [fix] pre-commit check

* [fix] rename py150 and masxmin datasets in configs

* [feat] add gen.py of py150 and maxmin in configs/datasets

* [Feat] support cidataset

* [Feat] support cidataset

* [Feat] support cidataset

* [Feat] support cidataset

* minor fix

* minor fix

* minor fix

* minor fix

* minor fix

* minor fix

* rename cibench

* rename cibench

* rename cibench

* rename cibench

* minor fix

* minor fix

* minor fix

* TabMWP

* TabMWP

* fixed

* fixed

* fixed

* done

* done

* done

---------
Co-authored-by: caomaosong <caomaosong@pjlab.org.cn>

* add_mathbench

* update mathbench

* support non circular eval dataset

---------
Co-authored-by: liuhongwei <liuhongwei@pjlab.org.cn>
Co-authored-by: yingfhu <yingfhu@gmail.com>

* add lawbench

* update requirements

* update

* Add ToT method

* Update ToT

* Update ToT

* Update ToT

* Update ToT

* Update ToT

* Add Koashi

* Update Kaoshi

* Update Kaoshi

* Update kaoshi

* Update kaoshi

* Update Kaoshi

* Update Kaoshi

* Update Kaoshi

* Update Kaoshi

* update Kaoshi

* update

* update

* fix

---------
Co-authored-by: gaotongxiao <gaotongxiao@gmail.com>

* add evaluation of scibench

* add evaluation of scibench

* update scibench

* remove scibench evaluator

---------
Co-authored-by: Leymore <zfz-960727@163.com>

* [Feat] support anthropics ai risk dataset

* [Feat] support anthropics evals dataset

* [Feat] support anthropics evals dataset

* [Feat] support adv_glue dataset for adversarial robustness

* reorg files

* minor fix

* minor fix

* support prompt bench demo

* minor fix

* minor fix

* minor fix

* minor fix

* minor fix

* minor fix

* minor fix

* minor fix

* [Feat] support ds1000 datase

* Add CMB

* modify CMB

---------
Co-authored-by: wangxidong <xidongw@163.com>

* Add ToT method

* Update ToT

* Update ToT

* Update ToT

* Update ToT

* Update ToT

* Update ToT

* Update ToT

* Update chain_of_thought.md

* Update icl_tot_inferencer.py

---------
Co-authored-by: liuhongwei <liuhongwei@pjlab.org.cn>

Co-authored-by: wangchonghua <wangchonghua@pjlab.org.cn>

* add codegeex2

* add humanevalx dataset

* add evaluator

* update evaluator

* update configs

* update clean code

* update configs

* fix lint

* remove sleep

* fix lint

* update docs

* fix lint

* [Feat] support adv_glue dataset for adversarial robustness

* reorg files

* minor fix

* minor fix

Co-authored-by: kennymckormick <dhd@pku.edu.cn>

* add Xiezhi SQuAD2.0 ANLI; update WSC

* update

* update

* update doc string

* add CMMLU

* debug cmmlu

* add slurm args `qos`

* fix format: space before comment

* remove unused variable

* change the location of `answer is`

---------
Co-authored-by: 李浩楠 <lihaonan@lihaonandeMacBook-Air.local>
Co-authored-by: 李浩楠 <haonan.li>
Co-authored-by: Leymore <zfz-960727@163.com>

* [Feat] support CValues

* minor fix

Co-authored-by: liuhongwei <liuhongwei@pjlab.org.cn>