Commits · aa2dd2b58c65dcb171c2ef328d1f60d1dc7ea27a · OpenDAS / opencompass

"vscode:/vscode.git/clone" did not exist on "0aa37743218177935bcdcbbf8576c98a6b4810ac"

14 May, 2024 1 commit
- [Format] Add config lints (#892) · aa2dd2b5
  Fengzhe Zhou authored May 14, 2024
  
  aa2dd2b5
02 Apr, 2024 1 commit

[Feature] Add multi-model judge and fix some problems (#1016) · 2d4e5597

bittersweet1999 authored Apr 02, 2024

* support multi-model judge and moe judge

* test_moe

* test_moe

* test

* add moe judge

* support multi-judge-model

2d4e5597

19 Mar, 2024 1 commit
- add support for set prediction path (#984) · c78a4df9
  bittersweet1999 authored Mar 19, 2024
  
  c78a4df9
30 Jan, 2024 1 commit
- fix compass arena (#854) · 5c6dc908
  bittersweet1999 authored Jan 30, 2024
  
  5c6dc908
23 Jan, 2024 1 commit

[Feature] Add CompassArena (#828) · 2d4da8dd

bittersweet1999 authored Jan 23, 2024



* add compass arena

* add compass_arena

* add compass arena

* Update opencompass/summarizers/subjective/compass_arena.py
Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com>

* Update opencompass/summarizers/subjective/__init__.py
Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com>

* Update opencompass/datasets/subjective/compass_arena.py
Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com>

* Update opencompass/datasets/subjective/__init__.py
Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com>

* Update configs/eval_subjective_compassarena.py
Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com>

* Update configs/datasets/subjective/compassarena/compassarena_compare.py
Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com>

* Update configs/eval_subjective_compassarena.py
Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com>

* Update configs/datasets/subjective/compassarena/compassarena_compare.py
Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com>

* fix check position bias

---------
Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com>

2d4da8dd