1. 24 Aug, 2023 1 commit
    • Yuan Liu's avatar
      [Feature]: Add Flamingo (#258) · 343f785b
      Yuan Liu authored
      * [Feature]: Add Openflamingo MMBench
      
      * [Fix]: Fix import error
      
      * [Fix]: Revert task config
      
      * [Fix]: Fix path bug
      343f785b
  2. 23 Aug, 2023 1 commit
  3. 21 Aug, 2023 2 commits
    • Yike Yuan's avatar
      [Feat] Support visualglm and llava for MMBench evaluation. (#211) · 8d368d1c
      Yike Yuan authored
      * [Feat] Support visualglm inference on MMBench.
      
      * [Feat] Support llava inference on MMBench.
      
      * [Fix] Fix pre-commit format.
      
      * [Fix] Add docstring for llava
      
      * [Fix] Fix multi-process inference error of LlaVA and add comments.
      1. Set `low_cpu_mem_usage` to False to address device issue.
      2. Add docstring and type hints.
      3. Rename class and remove registry.
      
      * [Fix] Pre-commit fix.
      
      * [Fix] add forward entry, add dynamic import to seedbench
      
      * [Fix] Fix pre-commit.
      
      * [Fix] Fix missing context.
      
      * [Fix] Fix docstring.
      8d368d1c
    • Yike Yuan's avatar
      [Feat] Support multi-modal evaluation on MME benchmark. (#197) · a6552224
      Yike Yuan authored
      * [Feat] Support multi-modal evaluation on MME benchmark.
      
      * [Fix] Remove debug code.
      
      * [Fix] Remove redundant codes and add type hints.
      
      * [Fix] Rename in config.
      
      * [Fix] Rebase main.
      
      * [Fix] Fix isort and yapf conflict.
      a6552224
  4. 17 Aug, 2023 4 commits
  5. 16 Aug, 2023 1 commit
    • Yuan Liu's avatar
      [Feature]: Add other public datasets (#206) · 78df9bd0
      Yuan Liu authored
      * [Feature]: Refactor class name
      
      * [Feature]: Add minigpt-4 coco caption
      
      * [Feature]: Update minigpt-4 coco caption
      
      * [Feature]: Add MiniGPT-4 ScienceQA
      
      * [Feature]: Add minigpt-4 vqav2
      
      * [Feature]: Add VSR
      
      * [Feature]: Revert task to previous version
      78df9bd0
  6. 10 Aug, 2023 1 commit
  7. 08 Aug, 2023 1 commit
  8. 03 Aug, 2023 1 commit
    • Yuan Liu's avatar
      [Feature]: Use multimodal (#73) · 191a3f6f
      Yuan Liu authored
      
      
      * [Feature]: Add minigpt-4
      
      * [Feature]: Add mm local runner
      
      * [Feature]: Add instructblip
      
      * [Feature]: Delete redundant file
      
      * [Feature]: Delete redundant file
      
      * [Feature]: Add README to InstructBLIP
      
      * [Feature]: Update MiniGPT-4
      
      * [Fix]: Fix lint
      
      * [Feature]add omnibenchmark readme (#49)
      
      * add omnibenchmark readme
      
      * fix
      
      * Update OmniMMBench.md
      
      * Update OmniMMBench.md
      
      * Update OmniMMBench.md
      
      * [Fix]: Refine name (#54)
      
      * [Feature]: Unify out and err
      
      * [Fix]: Fix lint
      
      * [Feature]: Rename to mmbench and change weight path
      
      * [Feature]: Delete Omni in instructblip
      
      * [Feature]: Check the avaliablity of lavis
      
      * [Fix]: Fix lint
      
      * [Feature]: Refactor MM
      
      * [Refactor]: Refactor path
      
      * [Feature]: Delete redundant files
      
      * [Refactor]: Delete redundant files
      
      ---------
      Co-authored-by: default avatarWangbo Zhao(黑色枷锁) <56866854+wangbo-zhao@users.noreply.github.com>
      191a3f6f