GitLab

* [Feature]: Add minigpt-4

* [Feature]: Add mm local runner

* [Feature]: Add instructblip

* [Feature]: Delete redundant file

* [Feature]: Delete redundant file

* [Feature]: Add README to InstructBLIP

* [Feature]: Update MiniGPT-4

* [Fix]: Fix lint

* [Feature]add omnibenchmark readme (#49)

* add omnibenchmark readme

* fix

* Update OmniMMBench.md

* Update OmniMMBench.md

* Update OmniMMBench.md

* [Fix]: Refine name (#54)

* [Feature]: Unify out and err

* [Fix]: Fix lint

* [Feature]: Rename to mmbench and change weight path

* [Feature]: Delete Omni in instructblip

* [Feature]: Check the avaliablity of lavis

* [Fix]: Fix lint

* [Feature]: Refactor MM

* [Refactor]: Refactor path

* [Feature]: Delete redundant files

* [Refactor]: Delete redundant files

---------
Co-authored-by: Wangbo Zhao(黑色枷锁) <56866854+wangbo-zhao@users.noreply.github.com>

* [Feature] Support evaluating acc based on minimum edit distance, update SIQA

* update

* update

* update

* update metric docs

* update index.rst

* update metrics

* Update README.md

* update README_zh-CN.md

* update get_started

---------
Co-authored-by: Leymore <zfz-960727@163.com>

* [Docs] Update prompt docs

* update

* [Docs] Prompt docs (#112)

* update docs

* update

* update

* Update en prompt template

* Update en prompt doc

* fix

* fix

---------
Co-authored-by: Tong Gao <gaotongxiao@gmail.com>

* add self-consistency

* add CoT method Self-Consistency

* fix typo error and update openicl_eval

* add tydiQA-GoldP task

* fix sc

* rename gsm8k_sc

* fix sc

* add self-consistency doc

* refine sc

---------
Authored-by: liushz <qq1791167085@163.com>

* allow explicitly setting the temperature

* update

* support internLM

* support internLM

* simplify intern model files

* update storage_manager

* support internLM

* Modify the file organization structure

* support internLM

* support internLM

* support internLM

* support internLM

* change some details

* update reame and fix failed links

* update

* update review

* [Feat] add auto assignee bot

* minor fix

* [Refactor] Update crows-pairs evaluation

* [Refactor] Update crows-pairs evaluation

* minor

* update

* update

* fix lint

Co-authored-by: Leymore <zfz-960727@163.com>

* add CMMLU

* debug cmmlu

* add slurm args `qos`

* fix format: space before comment

* remove unused variable

* change the location of `answer is`

---------
Co-authored-by: 李浩楠 <lihaonan@lihaonandeMacBook-Air.local>
Co-authored-by: 李浩楠 <haonan.li>
Co-authored-by: Leymore <zfz-960727@163.com>

* [Feature] Add heuristic size partitioner

* update

* add llama-2 models

* update docs

---------
Co-authored-by: gaotongxiao <gaotongxiao@gmail.com>

* [Feat] support CValues

* minor fix

* support peft for HuggingFace model

* add docstring

Co-authored-by: liuhongwei <liuhongwei@pjlab.org.cn>

* [Feat] add falcon-40b

* minor fix

* [Fix] Fix CI

* [Fix] Fix CI

* [Fix] Fix CI

* update

* [Enhancement] Test linting in CI

* fix linting

* [Feature] Add baichuan13b

* update num_gpus

* Add logger info and remove dataset bugs

* fix typo

* [Docs] Polish docs

* apply suggestions

* apply suggestions

* [Feature] Enhance OpenAI API, add example config for GPT evaluation

* fix