GitLab

* update alignmentbench

* update alignmentbench

* update alignmentbench

* alignmentbench infer and judge

* alignmentbench

* alignmentbench done

* alignment all done

* alignment all done

[Feature] Add double order of subjective evaluation and removing duplicated response among two models (#692)

* add features

* add doc string

* add doc string

* new version of subject

* fixed draw

* fixed draw

* fixed draw

* done

* done

* done

* done

* fixed lint

* update medbench

* medbench update

* format medbench

* format

---------
Co-authored-by: 施晓明 <PJLAB\shixiaoming@pjnl104220118l.pjlab.org>
Co-authored-by: Leymore <zfz-960727@163.com>

* add contamination analysis to ceval

* fix bugs

* add contamination docs

* to pass CI check

* update

---------
Co-authored-by: zhangyifan1 <zhangyifan1@pjlab.org.cn>
Co-authored-by: Leymore <zfz-960727@163.com>

* TabMWP

* TabMWP

* fixed

* fixed

* fixed

* done

* done

* done

* add new subjective judgement

* add new subjective judgement

* add new subjective judgement

* add new subjective judgement

* add new subjective judgement

* modified to a more general way

* modified to a more general way

* final

* final

* add summarizer

* add new summarize

* fixed

* fixed

* fixed

---------
Co-authored-by: caomaosong <caomaosong@pjlab.org.cn>

* added rolebench

* 修改了不合理的变量名

* 修改了评论中的变量名

* Update MathBench CodeInterpreter & fix MathBench Bug

* Fix errors

* update

---------
Co-authored-by: liuhongwei <liuhongwei@pjlab.org.cn>
Co-authored-by: Fengzhe Zhou <zfz-960727@163.com>

* [Feat] update gsm8k and math agent config

* minor fix

* Add WikiBench

* Add WikiBench

* format

---------
Co-authored-by: Leymore <zfz-960727@163.com>

* add Chinese version: csqa crowspairs nq

* Update cn_data

* Update cn_data

* update format

---------
Co-authored-by: liuhongwei <liuhongwei@pjlab.org.cn>
Co-authored-by: Leymore <zfz-960727@163.com>

* [Feature] Support chat style inferencer.

* [Fix] use new prompt

* [Fix] use new prompt

---------
Co-authored-by: yingfhu <yingfhu@gmail.com>

* Add SVAMP dataset

* Add SVAMP dataset

* Add SVAMP dataset

* Add gsm_hard dataset

* Add gsm_hard dataset

* format

---------
Co-authored-by: Leymore <zfz-960727@163.com>

* Add SVAMP dataset

* Add SVAMP dataset

* Add SVAMP dataset

* [Feature] Support 360API and FixKRetriever for CSQA dataset

* Update API

* Update API

* [Feature] Support 360API and FixKRetriever for CSQA dataset

* Update API

* Update API

* rm mathbench

* fix_lint

* Update opencompass/models/bytedance_api.py
Co-authored-by: Hubert <42952108+yingfhu@users.noreply.github.com>

* update

* update

* update

---------
Co-authored-by: Hubert <42952108+yingfhu@users.noreply.github.com>

* Update mathbench

* Update mathbench

* [Feature] Add multi-prompt generation demo

* [Fix] change form in winogrande_gen_XXX.py

* [Fix] make multi prompt demo more directly

* [Fix] fix bug

* [Fix] minor fix

---------
Co-authored-by: yingfhu <yingfhu@gmail.com>

* update xunfei api

* fix lint

* update mathbench to avoid incomplete prediction

* update commonsenseqa

* update drop

* update flores_first100

* update gsm8k

* update humaneval

* update lambda

* update obqa

* update piqa

* update race

* update siqa

* update story_cloze

* update strategyqa

* update tydiqa

* update winogrande

* update doc

* update hellaswag

* fix obqa

* update collections

* update .zip name

* [Docs] add humanevalx dataset link in config

* [Docs] add humanevalx dataset link in config

* minor fix

* [feat] add clozeTesst_maxmin dataset

* [feat] add py150 datasets

* [feat] change __init__.py in opencompass/datasets

* [fix] pre-commit check

* [fix] rename py150 and masxmin datasets in configs

* [feat] add gen.py of py150 and maxmin in configs/datasets

* [Feat] support cidataset

* [Feat] support cidataset

* [Feat] support cidataset

* [Feat] support cidataset

* minor fix

* minor fix

* minor fix

* minor fix

* minor fix

* minor fix

* rename cibench

* rename cibench

* rename cibench

* rename cibench

* minor fix

* minor fix

* minor fix

* Update mathbench

* Update mathbench

* Update mathbench

* TabMWP

* TabMWP

* fixed

* fixed

* fixed

* done

* done

* done

---------
Co-authored-by: caomaosong <caomaosong@pjlab.org.cn>

Co-authored-by: wq.chu <wq.chu@tianrang-inc.com>

* rename

* add en subdoc

* fix name

* fix writing

* update

---------
Co-authored-by: Leymore <zfz-960727@163.com>

* support math agent

* support gsm8k agent

* support gsm8k agent

* minor fix

* minor fix

* minor fix

* Update configs/eval_codeagent.py