Commits · 2d4e5597630c1935042135959c53a7a690962437 · OpenDAS / opencompass

02 Apr, 2024 1 commit

[Feature] Add multi-model judge and fix some problems (#1016) · 2d4e5597

bittersweet1999 authored Apr 02, 2024

* support multi-model judge and moe judge

* test_moe

* test_moe

* test

* add moe judge

* support multi-judge-model

2d4e5597

22 Mar, 2024 1 commit
- [Fix] Quick fix (#995) · 0665bb91
  bittersweet1999 authored Mar 22, 2024
  
  0665bb91
05 Feb, 2024 1 commit

[Fix] add do sample demo for subjective dataset (#873) · 32b5948f

bittersweet1999 authored Feb 05, 2024



* add do sample demo for subjective dataset

* fix strings

* format

---------
Co-authored-by: Leymore <zfz-960727@163.com>

32b5948f

30 Jan, 2024 1 commit
- fix compass arena (#854) · 5c6dc908
  bittersweet1999 authored Jan 30, 2024
  
  5c6dc908
23 Jan, 2024 1 commit

[Feature] Add CompassArena (#828) · 2d4da8dd

bittersweet1999 authored Jan 23, 2024



* add compass arena

* add compass_arena

* add compass arena

* Update opencompass/summarizers/subjective/compass_arena.py
Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com>

* Update opencompass/summarizers/subjective/__init__.py
Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com>

* Update opencompass/datasets/subjective/compass_arena.py
Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com>

* Update opencompass/datasets/subjective/__init__.py
Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com>

* Update configs/eval_subjective_compassarena.py
Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com>

* Update configs/datasets/subjective/compassarena/compassarena_compare.py
Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com>

* Update configs/eval_subjective_compassarena.py
Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com>

* Update configs/datasets/subjective/compassarena/compassarena_compare.py
Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com>

* fix check position bias

---------
Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com>

2d4da8dd