Commits · 1fe152b3e869aed30171418584f30d033a04b5a5 · OpenDAS / opencompass

"mmdet3d/models/vscode:/vscode.git/clone" did not exist on "5b42b7393e1c2b8bad12ee060722bd5d2ba92150"

13 Dec, 2023 1 commit

[Feature] Support AlignmentBench infer and judge (#697) · 1fe152b3

bittersweet1999 authored Dec 13, 2023

* alignmentbench infer and judge

* alignmentbench

* alignmentbench done

* alignment all done

* alignment all done

1fe152b3

11 Dec, 2023 1 commit

[Feature] Add Subjective Evaluation (#680) · 465308e4

bittersweet1999 authored Dec 11, 2023

* new version of subject

* fixed draw

* fixed draw

* fixed draw

* done

* done

* done

* done

* fixed lint

465308e4

09 Dec, 2023 1 commit

[Feature] Add medbench (#678) · 1bf85949

Xiaoming Shi authored Dec 09, 2023



* update medbench

* medbench update

* format medbench

* format

---------
Co-authored-by: 施晓明 <PJLAB\shixiaoming@pjnl104220118l.pjlab.org>
Co-authored-by: Leymore <zfz-960727@163.com>

1bf85949

06 Dec, 2023 1 commit

New subjective judgement (#660) · 1c95790f

bittersweet1999 authored Dec 06, 2023



* TabMWP

* TabMWP

* fixed

* fixed

* fixed

* done

* done

* done

* add new subjective judgement

* add new subjective judgement

* add new subjective judgement

* add new subjective judgement

* add new subjective judgement

* modified to a more general way

* modified to a more general way

* final

* final

* add summarizer

* add new summarize

* fixed

* fixed

* fixed

---------
Co-authored-by: caomaosong <caomaosong@pjlab.org.cn>

1c95790f

01 Dec, 2023 1 commit

[Feature] Add wikibench dataset (#655) · a331c9ab

liushz authored Dec 01, 2023



* Add WikiBench

* Add WikiBench

* format

---------
Co-authored-by: Leymore <zfz-960727@163.com>

a331c9ab

30 Nov, 2023 1 commit

[Feature] Add Chinese version: commonsenseqa, crowspairs and nq (#144) · e019c831

liushz authored Nov 30, 2023



* add Chinese version: csqa crowspairs nq

* Update cn_data

* Update cn_data

* update format

---------
Co-authored-by: liuhongwei <liuhongwei@pjlab.org.cn>
Co-authored-by: Leymore <zfz-960727@163.com>

e019c831

27 Nov, 2023 1 commit

[Feature] Add GSM_Hard dataset (#619) · 6d0d7898

liushz authored Nov 27, 2023



* Add SVAMP dataset

* Add SVAMP dataset

* Add SVAMP dataset

* Add gsm_hard dataset

* Add gsm_hard dataset

* format

---------
Co-authored-by: Leymore <zfz-960727@163.com>

6d0d7898

23 Nov, 2023 1 commit

[Feature] Add circular eval (#610) · d949e3c0

Fengzhe Zhou authored Nov 23, 2023

* refactor default, add circular summarizer

* add circular

* update impl

* update doc

* minor update

* no more to be added

d949e3c0

22 Nov, 2023 1 commit
- [Feature] Add SVAMP dataset (#604) · 04877519
  liushz authored Nov 22, 2023
```
* Add SVAMP dataset

* Add SVAMP dataset

* Add SVAMP dataset
```
  04877519
16 Nov, 2023 1 commit
- [Feature] Add FinanceIQ dataset (#596) · c0acd06b
  Raymond Zhang authored Nov 16, 2023
  
  c0acd06b
14 Nov, 2023 1 commit
- Fix bugs in subjective evaluation (#589) · 14e6fe6f
  Wei Jueqi authored Nov 14, 2023
```
* rename

* fix sub bugs and update docs

* update

* update
```
  14e6fe6f
09 Nov, 2023 1 commit

[Feature] Add py150 and maxmin (#562) · b3cbef32

jingmingzhuo authored Nov 09, 2023

* [feat] add clozeTesst_maxmin dataset

* [feat] add py150 datasets

* [feat] change __init__.py in opencompass/datasets

* [fix] pre-commit check

* [fix] rename py150 and masxmin datasets in configs

* [feat] add gen.py of py150 and maxmin in configs/datasets

b3cbef32

07 Nov, 2023 1 commit

[Feat] Support cibench (#538) · bb2ecf41

Hubert authored Nov 07, 2023

* [Feat] support cidataset

* [Feat] support cidataset

* [Feat] support cidataset

* [Feat] support cidataset

* minor fix

* minor fix

* minor fix

* minor fix

* minor fix

* minor fix

* rename cibench

* rename cibench

* rename cibench

* rename cibench

* minor fix

* minor fix

* minor fix

bb2ecf41

03 Nov, 2023 1 commit

[fFeat] Add an opensource dataset Tabmwp (#505) · f25a9800

bittersweet1999 authored Nov 03, 2023



* TabMWP

* TabMWP

* fixed

* fixed

* fixed

* done

* done

* done

---------
Co-authored-by: caomaosong <caomaosong@pjlab.org.cn>

f25a9800

18 Oct, 2023 1 commit

[Feature] Add mathbench dataset and circular evaluator (#408) · 2737249f

liushz authored Oct 18, 2023



* add_mathbench

* update mathbench

* support non circular eval dataset

---------
Co-authored-by: liuhongwei <liuhongwei@pjlab.org.cn>
Co-authored-by: yingfhu <yingfhu@gmail.com>

2737249f

13 Oct, 2023 1 commit
- [Feature] Add lawbench (#460) · 861942ab
  Leymore authored Oct 13, 2023
```
* add lawbench

* update requirements

* update
```
  861942ab
22 Sep, 2023 2 commits

[Feature] Add kaoshi dataset (#392) · c5224c2a

liushz authored Sep 22, 2023



* Add ToT method

* Update ToT

* Update ToT

* Update ToT

* Update ToT

* Update ToT

* Add Koashi

* Update Kaoshi

* Update Kaoshi

* Update kaoshi

* Update kaoshi

* Update Kaoshi

* Update Kaoshi

* Update Kaoshi

* Update Kaoshi

* update Kaoshi

* update

* update

* fix

---------
Co-authored-by: gaotongxiao <gaotongxiao@gmail.com>

c5224c2a

add evaluation of scibench (#393) · 2a62bea1

TTTTTiam authored Sep 22, 2023



* add evaluation of scibench

* add evaluation of scibench

* update scibench

* remove scibench evaluator

---------
Co-authored-by: Leymore <zfz-960727@163.com>

2a62bea1

20 Sep, 2023 1 commit

[Feat] support antropics evals dataset (#422) · 8803f7f7

Hubert authored Sep 20, 2023

* [Feat] support anthropics ai risk dataset

* [Feat] support anthropics evals dataset

* [Feat] support anthropics evals dataset

8803f7f7

15 Sep, 2023 2 commits

[Feat] implementation for support promptbench (#239) · a11cb45c

Hubert authored Sep 15, 2023

* [Feat] support adv_glue dataset for adversarial robustness

* reorg files

* minor fix

* minor fix

* support prompt bench demo

* minor fix

* minor fix

* minor fix

* minor fix

* minor fix

* minor fix

* minor fix

* minor fix

a11cb45c

[Feat] support ds1000 dataset (#395) · de8a1547
Hubert authored Sep 15, 2023
```
* [Feat] support ds1000 datase
```
de8a1547

12 Sep, 2023 1 commit

[Dataset] Add CMB (#376) · 47a752cd

Xidong Wang authored Sep 12, 2023



* Add CMB

* modify CMB

---------
Co-authored-by: wangxidong <xidongw@163.com>

47a752cd

25 Aug, 2023 1 commit
- [Dataset] Refactor LEval · 3f37c40a
  philipwangOvO authored Aug 25, 2023
  
  3f37c40a
23 Aug, 2023 1 commit

[Feature] Add Tree-of-Thought method (#173) · 02ce139b

liushz authored Aug 23, 2023



* Add ToT method

* Update ToT

* Update ToT

* Update ToT

* Update ToT

* Update ToT

* Update ToT

* Update ToT

* Update chain_of_thought.md

* Update icl_tot_inferencer.py

---------
Co-authored-by: liuhongwei <liuhongwei@pjlab.org.cn>

02ce139b

21 Aug, 2023 1 commit
- [Dataset] LongBench (#236) · 655a807f
  philipwangOvO authored Aug 21, 2023
```
Co-authored-by: wangchonghua <wangchonghua@pjlab.org.cn>
```
  655a807f
17 Aug, 2023 1 commit

[Feat] Add codegeex2 and Humanevalx (#210) · 17ccaa59

Ezra-Yu authored Aug 17, 2023

* add codegeex2

* add humanevalx dataset

* add evaluator

* update evaluator

* update configs

* update clean code

* update configs

* fix lint

* remove sleep

* fix lint

* update docs

* fix lint

17ccaa59

16 Aug, 2023 1 commit
- [Feat] support adv_glue dataset for adversarial robustness (#205) · 0fe2366a
  Hubert authored Aug 16, 2023
```
* [Feat] support adv_glue dataset for adversarial robustness

* reorg files

* minor fix

* minor fix
```
  0fe2366a
11 Aug, 2023 1 commit
- [Feature] Add LEval datasets · bf79ff1c
  Tong Gao authored Aug 11, 2023
```
Co-authored-by: kennymckormick <dhd@pku.edu.cn>
```
  bf79ff1c
10 Aug, 2023 1 commit
- [Feature] Add Xiezhi SQuAD2.0 ANLI (#101) · e7fc54ba
  Leymore authored Aug 10, 2023
```
* add Xiezhi SQuAD2.0 ANLI; update WSC

* update

* update

* update doc string
```
  e7fc54ba
25 Jul, 2023 1 commit

[Feature] Add CMMLU dataset (#91) · e9cdb24d

Haonan Li authored Jul 25, 2023



* add CMMLU

* debug cmmlu

* add slurm args `qos`

* fix format: space before comment

* remove unused variable

* change the location of `answer is`

---------
Co-authored-by: 李浩楠 <lihaonan@lihaonandeMacBook-Air.local>
Co-authored-by: 李浩楠 <haonan.li>
Co-authored-by: Leymore <zfz-960727@163.com>

e9cdb24d

18 Jul, 2023 2 commits
- [Feat] Support CValues Responsibility dataset (#78) · f83e125e
  Hubert authored Jul 18, 2023
```
* [Feat] support CValues

* minor fix
```
  f83e125e
- [Feature] Add tydiqa-goldp (#75) · f36c0496
  liushz authored Jul 18, 2023
```
Co-authored-by: liuhongwei <liuhongwei@pjlab.org.cn>
```
  f36c0496
04 Jul, 2023 1 commit
- initial commit · 7d346000
  gaotongxiao authored Jul 04, 2023
  
  7d346000