GitLab

* [Feat] support pass@ k

* [Feat] support pass@k

* [Feat] support pass@k

* [Feat] support pass@k

* [Feat] support pass@k

* [Feat] support pass@k docs

* update naming

---------
Co-authored-by: Leymore <zfz-960727@163.com>

* update commonsenseqa

* update drop

* update flores_first100

* update gsm8k

* update humaneval

* update lambda

* update obqa

* update piqa

* update race

* update siqa

* update story_cloze

* update strategyqa

* update tydiqa

* update winogrande

* update doc

* update hellaswag

* fix obqa

* update collections

* update .zip name

* [Docs] add humanevalx dataset link in config

* [Docs] add humanevalx dataset link in config

* minor fix

* update requirement

* update requirement

* update with minimax

* update api model

* Update readme

* fix error

---------
Co-authored-by: zhangsongyang <zhangsongyang@pjlab.org.cn>

* update readme

* update readme and faq

* rename

* add en subdoc

* fix name

* fix writing

* update

---------
Co-authored-by: Leymore <zfz-960727@163.com>

* use jieba rouge in lcsts

* use rouge_chinese

* [Refactor] Move fix_id_list to Retriever

* update

* move to base

* fix

* [Docs] update get_started

* [Docs] Refactor get_started

* update

* add zh FAQ

* add cn doc

* update

* fix dead links

---------
Co-authored-by: Leymore <zfz-960727@163.com>

* support tis

* integrate turbomind inference via its RPC API instead of its python API

* update guide

* update ip address spec

* update according to reviewer's comments

* add multimodal docs

* fix lint

---------
Co-authored-by: Tong Gao <gaotongxiao@gmail.com>

* [Docs] Add intro figure to README

* update

* [Docs] Readme in longeval

* [Docs] Readme in longeval

* [Docs] Readme in longeval

* [Docs] Readme in longeval

* [Docs] Readme in longeval

* [Docs] Readme in longeval

* [Docs] Readme in longeval

* [Feat] support adv_glue dataset for adversarial robustness

* reorg files

* minor fix

* minor fix

* support prompt bench demo

* minor fix

* minor fix

* minor fix

* minor fix

* minor fix

* minor fix

* minor fix

* minor fix

* [Docs] Add FAQ

* [Docs] Add FAQ

* add bag of new models: baichuan2, tigerbot, vicuna v1.5

* update

* re-organize models

* update readme

* update

* Update news

* update overview

* add framework

* update index

* update

---------
Co-authored-by: Leymore <zfz-960727@163.com>

* [Docs] update code evaluator docs

* minor fix

* minor fix

Fix minor problem in the doc

* update docs

* update docs

* update

* update en docs

* update

* update

---------
Co-authored-by: Leymore <zfz-960727@163.com>

* add and apply update suffix tool

* add dataset suffix updater as precommit hook

* update workflow

* update scripts

* update ci

* update

* ci with py3.8

* run in serial

* update bbh

* use py 3.10

* update pre commit zh cn

* Update README.md

* update news and readme

* update

* update

---------
Co-authored-by: gaotongxiao <gaotongxiao@gmail.com>

* Add ToT method

* Update ToT

* Update ToT

* Update ToT

* Update ToT

* Update ToT

* Update ToT

* Update ToT

* Update chain_of_thought.md

* Update icl_tot_inferencer.py

---------
Co-authored-by: liuhongwei <liuhongwei@pjlab.org.cn>

* add summarizer doc

* update

* update doc

* Apply suggestions from code review

---------
Co-authored-by: Tong Gao <gaotongxiao@gmail.com>

* add codegeex2

* add humanevalx dataset

* add evaluator

* update evaluator

* update configs

* update clean code

* update configs

* fix lint

* remove sleep

* fix lint

* update docs

* fix lint

* [Docs] Update contribution guide & toc

* update

* Update docs/en/notes/contribution_guide.md
Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com>

* update

* update

---------
Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com>

* update news

* update

---------
Co-authored-by: gaotongxiao <gaotongxiao@gmail.com>

* Update sc

* Update sc doc

* Apply suggestions from code review
Co-authored-by: Hubert <42952108+yingfhu@users.noreply.github.com>

---------
Co-authored-by: liuhongwei <liuhongwei@pjlab.org.cn>
Co-authored-by: Hubert <42952108+yingfhu@users.noreply.github.com>

* support turbomind

* update doc

* Update docs/en/advanced_guides/evaluation_turbomind.md
Co-authored-by: Tong Gao <gaotongxiao@gmail.com>

* Update docs/zh_cn/advanced_guides/evaluation_turbomind.md
Co-authored-by: Tong Gao <gaotongxiao@gmail.com>

* Update docs/zh_cn/advanced_guides/evaluation_turbomind.md
Co-authored-by: Tong Gao <gaotongxiao@gmail.com>

* Update docs/en/advanced_guides/evaluation_turbomind.md
Co-authored-by: Tong Gao <gaotongxiao@gmail.com>

* update

---------
Co-authored-by: Tong Gao <gaotongxiao@gmail.com>

* [Feature]: Add minigpt-4

* [Feature]: Add mm local runner

* [Feature]: Add instructblip

* [Feature]: Delete redundant file

* [Feature]: Delete redundant file

* [Feature]: Add README to InstructBLIP

* [Feature]: Update MiniGPT-4

* [Fix]: Fix lint

* [Feature]add omnibenchmark readme (#49)

* add omnibenchmark readme

* fix

* Update OmniMMBench.md

* Update OmniMMBench.md

* Update OmniMMBench.md

* [Fix]: Refine name (#54)

* [Feature]: Unify out and err

* [Fix]: Fix lint

* [Feature]: Rename to mmbench and change weight path

* [Feature]: Delete Omni in instructblip

* [Feature]: Check the avaliablity of lavis

* [Fix]: Fix lint

* [Feature]: Refactor MM

* [Refactor]: Refactor path

* [Feature]: Delete redundant files

* [Refactor]: Delete redundant files

---------
Co-authored-by: Wangbo Zhao(黑色枷锁) <56866854+wangbo-zhao@users.noreply.github.com>

* update

* update

* update metric docs

* update index.rst

* update metrics

* Update README.md

* update README_zh-CN.md

* update get_started

---------
Co-authored-by: Leymore <zfz-960727@163.com>