GitLab

* [Fix] fix bug for postprocessor

* minor fix

Co-authored-by: kennymckormick <dhd@pku.edu.cn>

* [Feat] update postprocessor to get first option

* minor fix

* minor fix

* add llama-oriented dataset configs

* update

* revert cvalues & update llama_example

* [Docs] Update contribution guide & toc

* update

* Update docs/en/notes/contribution_guide.md
Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com>

* update

* update

---------
Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com>

* [Feat] add safety to collections

* minor fix

* Support filtering message

* minor fix

* update news

* update

---------
Co-authored-by: gaotongxiao <gaotongxiao@gmail.com>

* Skip invalid keys to avoid requesting API

* get expected key

* print warning info

* [Feature] Support CUDA_VISIBLE_DEVICES and multiple tasks on one GPU

* Fix UT

* Update according to comments

* Update sc

* Update sc doc

* Apply suggestions from code review
Co-authored-by: Hubert <42952108+yingfhu@users.noreply.github.com>

---------
Co-authored-by: liuhongwei <liuhongwei@pjlab.org.cn>
Co-authored-by: Hubert <42952108+yingfhu@users.noreply.github.com>

[Enhancement] Add humaneval postprocessor for GPT models & eval config for GPT4, enhance the original humaneval postprocessor (#129)

* [Enhancement] Enhance humaneval postprocessor

* add human-eval testcase

* update

* update

---------
Co-authored-by: Leymore <zfz-960727@163.com>

* support turbomind

* update doc

* Update docs/en/advanced_guides/evaluation_turbomind.md
Co-authored-by: Tong Gao <gaotongxiao@gmail.com>

* Update docs/zh_cn/advanced_guides/evaluation_turbomind.md
Co-authored-by: Tong Gao <gaotongxiao@gmail.com>

* Update docs/zh_cn/advanced_guides/evaluation_turbomind.md
Co-authored-by: Tong Gao <gaotongxiao@gmail.com>

* Update docs/en/advanced_guides/evaluation_turbomind.md
Co-authored-by: Tong Gao <gaotongxiao@gmail.com>

* update

---------
Co-authored-by: Tong Gao <gaotongxiao@gmail.com>

* add Xiezhi SQuAD2.0 ANLI; update WSC

* update

* update

* update doc string

* [Feature]: Refactor input and output

* [Feature]: Update tasks

* update agieval data

* rename variables

Bumps [requests](https://github.com/psf/requests) from 2.28.1 to 2.31.0.
- [Release notes](https://github.com/psf/requests/releases)
- [Changelog](https://github.com/psf/requests/blob/main/HISTORY.md)
- [Commits](https://github.com/psf/requests/compare/v2.28.1...v2.31.0

)

---
updated-dependencies:
- dependency-name: requests
  dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* calulate max_out_len without hard code

* set default value

* update configs

* Update configs/eval_gpt3.5.py
Co-authored-by: Tong Gao <gaotongxiao@gmail.com>

---------
Co-authored-by: Tong Gao <gaotongxiao@gmail.com>

* update

* update

* Update README.md
Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com>

* refine

* update default

* update CN README

---------
Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com>

* [Feature] Enhance OpenAI API, add example config for GPT evaluation

* update

* update

* [Feature]: Add minigpt-4

* [Feature]: Add mm local runner

* [Feature]: Add instructblip

* [Feature]: Delete redundant file

* [Feature]: Delete redundant file

* [Feature]: Add README to InstructBLIP

* [Feature]: Update MiniGPT-4

* [Fix]: Fix lint

* [Feature]add omnibenchmark readme (#49)

* add omnibenchmark readme

* fix

* Update OmniMMBench.md

* Update OmniMMBench.md

* Update OmniMMBench.md

* [Fix]: Refine name (#54)

* [Feature]: Unify out and err

* [Fix]: Fix lint

* [Feature]: Rename to mmbench and change weight path

* [Feature]: Delete Omni in instructblip

* [Feature]: Check the avaliablity of lavis

* [Fix]: Fix lint

* [Feature]: Refactor MM

* [Refactor]: Refactor path

* [Feature]: Delete redundant files

* [Refactor]: Delete redundant files

---------
Co-authored-by: Wangbo Zhao(黑色枷锁) <56866854+wangbo-zhao@users.noreply.github.com>

* [Feature] Support evaluating acc based on minimum edit distance, update SIQA

* update

* update

* update

* update metric docs

* update index.rst

* update metrics

* Update README.md

* update README_zh-CN.md

* update get_started

---------
Co-authored-by: Leymore <zfz-960727@163.com>

* [Docs] Update prompt docs

* update

* [Docs] Prompt docs (#112)

* update docs

* update

* update

* Update en prompt template

* Update en prompt doc

* fix

* fix

---------
Co-authored-by: Tong Gao <gaotongxiao@gmail.com>

* add self-consistency

* add CoT method Self-Consistency

* fix typo error and update openicl_eval

* add tydiQA-GoldP task

* fix sc

* rename gsm8k_sc

* fix sc

* add self-consistency doc

* refine sc

---------
Authored-by: liushz <qq1791167085@163.com>