Commits · e9e75fb4eb052228bf4468cceccba26fa58d2e53 · OpenDAS / opencompass

27 Nov, 2023 2 commits

[Feature] Add GSM_Hard dataset (#619) · 6d0d7898

liushz authored Nov 27, 2023



* Add SVAMP dataset

* Add SVAMP dataset

* Add SVAMP dataset

* Add gsm_hard dataset

* Add gsm_hard dataset

* format

---------
Co-authored-by: Leymore <zfz-960727@163.com>

6d0d7898

[Sync] some renaming (#641) · 9083dea6
Fengzhe Zhou authored Nov 27, 2023

9083dea6

23 Nov, 2023 1 commit
- [Sync] Fix cmnli, fix vicuna meta template, fix longbench postprocess and other minor fixes (#625) · d4d1330a
  Fengzhe Zhou authored Nov 23, 2023
  
  d4d1330a
22 Nov, 2023 1 commit
- [Feature] Add SVAMP dataset (#604) · 04877519
  liushz authored Nov 22, 2023
```
* Add SVAMP dataset

* Add SVAMP dataset

* Add SVAMP dataset
```
  04877519
21 Nov, 2023 1 commit

[Feature] Support 360API and FixKRetriever for CSQA dataset (#601) · d9257482

Songyang Zhang authored Nov 21, 2023



* [Feature] Support 360API and FixKRetriever for CSQA dataset

* Update API

* Update API

* [Feature] Support 360API and FixKRetriever for CSQA dataset

* Update API

* Update API

* rm mathbench

* fix_lint

* Update opencompass/models/bytedance_api.py
Co-authored-by: Hubert <42952108+yingfhu@users.noreply.github.com>

* update

* update

* update

---------
Co-authored-by: Hubert <42952108+yingfhu@users.noreply.github.com>

d9257482

20 Nov, 2023 3 commits

Add aritch to mathbench (#607) · dbacd363
liushz authored Nov 20, 2023

dbacd363
Mathbench update postprocess (#600) · c9c5c5d9
liushz authored Nov 20, 2023
```
* Update mathbench

* Update mathbench
```
c9c5c5d9

[Feature] Add multi-prompt generation demo (#568) · 5e75e297

Jingming authored Nov 20, 2023



* [Feature] Add multi-prompt generation demo

* [Fix] change form in winogrande_gen_XXX.py

* [Fix] make multi prompt demo more directly

* [Fix] fix bug

* [Fix] minor fix

---------
Co-authored-by: yingfhu <yingfhu@gmail.com>

5e75e297

16 Nov, 2023 1 commit
- [Feature] Add FinanceIQ dataset (#596) · c0acd06b
  Raymond Zhang authored Nov 16, 2023
  
  c0acd06b
15 Nov, 2023 1 commit
- update word spell (#594) · 8160cb84
  Yu authored Nov 15, 2023
  
  8160cb84
14 Nov, 2023 1 commit
- [Feature] Update mathbench (#580) · c8cb38e8
  Songyang Zhang authored Nov 14, 2023
```
* update xunfei api

* fix lint

* update mathbench to avoid incomplete prediction
```
  c8cb38e8
13 Nov, 2023 3 commits

[Sync] Bump version to 0.1.8 (#576) · 1ea88d58
Fengzhe Zhou authored Nov 13, 2023

1ea88d58
[Sync] update model configs (#574) · d3de5c41
Fengzhe Zhou authored Nov 13, 2023

d3de5c41

[Feature] Use dataset in local path (#570) · 689ffe5b

Fengzhe Zhou authored Nov 13, 2023

* update commonsenseqa

* update drop

* update flores_first100

* update gsm8k

* update humaneval

* update lambda

* update obqa

* update piqa

* update race

* update siqa

* update story_cloze

* update strategyqa

* update tydiqa

* update winogrande

* update doc

* update hellaswag

* fix obqa

* update collections

* update .zip name

689ffe5b

12 Nov, 2023 1 commit
- [Feature] Update cmb (#571) · d6aaac22
  Fengzhe Zhou authored Nov 13, 2023
  
  d6aaac22
10 Nov, 2023 2 commits
- [Docs] fix dataset name error (#533) · 7f77e8da
  Kevin Wang authored Nov 10, 2023
  
  7f77e8da
- [Docs] add humanevalx dataset link in config (#559) · 95e0da01
  Hubert authored Nov 10, 2023
```
* [Docs] add humanevalx dataset link in config

* [Docs] add humanevalx dataset link in config

* minor fix
```
  95e0da01
09 Nov, 2023 1 commit

[Feature] Add py150 and maxmin (#562) · b3cbef32

jingmingzhuo authored Nov 09, 2023

* [feat] add clozeTesst_maxmin dataset

* [feat] add py150 datasets

* [feat] change __init__.py in opencompass/datasets

* [fix] pre-commit check

* [fix] rename py150 and masxmin datasets in configs

* [feat] add gen.py of py150 and maxmin in configs/datasets

b3cbef32

07 Nov, 2023 1 commit

[Feat] Support cibench (#538) · bb2ecf41

Hubert authored Nov 07, 2023

* [Feat] support cidataset

* [Feat] support cidataset

* [Feat] support cidataset

* [Feat] support cidataset

* minor fix

* minor fix

* minor fix

* minor fix

* minor fix

* minor fix

* rename cibench

* rename cibench

* rename cibench

* rename cibench

* minor fix

* minor fix

* minor fix

bb2ecf41

06 Nov, 2023 1 commit
- 【Feature】Update Mathbench dataset prompt and fix small errors (#546) · 214a34f0
  liushz authored Nov 06, 2023
```
* Update mathbench

* Update mathbench

* Update mathbench
```
  214a34f0
03 Nov, 2023 1 commit

[fFeat] Add an opensource dataset Tabmwp (#505) · f25a9800

bittersweet1999 authored Nov 03, 2023



* TabMWP

* TabMWP

* fixed

* fixed

* fixed

* done

* done

* done

---------
Co-authored-by: caomaosong <caomaosong@pjlab.org.cn>

f25a9800

30 Oct, 2023 1 commit
- [Fix] Fix typo in WSC prompt (#520) · 229a65f3
  Qing authored Oct 30, 2023
```
Co-authored-by: wq.chu <wq.chu@tianrang-inc.com>
```
  229a65f3
27 Oct, 2023 2 commits
- [Sync] update (#517) · dbb20b82
  Fengzhe Zhou authored Oct 27, 2023
  
  dbb20b82
- [Doc] Update Subjective docs (#510) · b6284233
  Wei Jueqi authored Oct 27, 2023
```
* rename

* add en subdoc

* fix name

* fix writing

* update

---------
Co-authored-by: Leymore <zfz-960727@163.com>
```
  b6284233
25 Oct, 2023 1 commit

[Feat] support math/gms8k agent config (#494) · b3f5d9e4

Hubert authored Oct 25, 2023

* support math agent

* support gsm8k agent

* support gsm8k agent

* minor fix

* minor fix

* minor fix

* Update configs/eval_codeagent.py

b3f5d9e4

18 Oct, 2023 1 commit

[Feature] Add mathbench dataset and circular evaluator (#408) · 2737249f

liushz authored Oct 18, 2023



* add_mathbench

* update mathbench

* support non circular eval dataset

---------
Co-authored-by: liuhongwei <liuhongwei@pjlab.org.cn>
Co-authored-by: yingfhu <yingfhu@gmail.com>

2737249f

13 Oct, 2023 2 commits
- [Feature] Add lawbench (#460) · 861942ab
  Leymore authored Oct 13, 2023
```
* add lawbench

* update requirements

* update
```
  861942ab
- [Sync] update github token (#475) · fbf5089c
  Leymore authored Oct 13, 2023
  
  fbf5089c
09 Oct, 2023 1 commit
- [Fix] Use jieba rouge in lcsts (#459) · d7ff933a
  Leymore authored Oct 08, 2023
```
* use jieba rouge in lcsts

* use rouge_chinese
```
  d7ff933a
07 Oct, 2023 1 commit
- [Refactor] Move fix_id_list to Retriever (#442) · 119bfd15
  Tong Gao authored Oct 06, 2023
```
* [Refactor] Move fix_id_list to Retriever

* update

* move to base

* fix
```
  119bfd15
27 Sep, 2023 4 commits
- [Sync] Update LongEval (#443) · 3bb3d330
  philipwangOvO authored Sep 27, 2023
  
  3bb3d330
- [SIG] add GLUE_MRPC dataset (#440) · dc1b82c3
  Kevin Wang authored Sep 27, 2023
  
  dc1b82c3
- [Dataset] add GLUE QQP dataset (#438) · 14fdecfe
  Kevin Wang authored Sep 27, 2023
  
  14fdecfe
- [SIG] add GLUE_CoLA dataset (#406) · d8354fe5
  Kevin Wang authored Sep 27, 2023
```
* [Dataset] add GLUE_CoLA dataset

* [update] use HFDataset to load glue/cola dataset

* update

---------
Co-authored-by: gaotongxiao <gaotongxiao@gmail.com>
```
  d8354fe5
26 Sep, 2023 1 commit
- [SIG] add WikiText-2&103 (#397) · 01254666
  Kevin Wang authored Sep 26, 2023
```
* fix conflict

* add eval_cfg
```
  01254666
22 Sep, 2023 2 commits

[Feature] Add kaoshi dataset (#392) · c5224c2a

liushz authored Sep 22, 2023



* Add ToT method

* Update ToT

* Update ToT

* Update ToT

* Update ToT

* Update ToT

* Add Koashi

* Update Kaoshi

* Update Kaoshi

* Update kaoshi

* Update kaoshi

* Update Kaoshi

* Update Kaoshi

* Update Kaoshi

* Update Kaoshi

* update Kaoshi

* update

* update

* fix

---------
Co-authored-by: gaotongxiao <gaotongxiao@gmail.com>

c5224c2a

add evaluation of scibench (#393) · 2a62bea1

TTTTTiam authored Sep 22, 2023



* add evaluation of scibench

* add evaluation of scibench

* update scibench

* remove scibench evaluator

---------
Co-authored-by: Leymore <zfz-960727@163.com>

2a62bea1

20 Sep, 2023 1 commit

[Feat] support antropics evals dataset (#422) · 8803f7f7

Hubert authored Sep 20, 2023

* [Feat] support anthropics ai risk dataset

* [Feat] support anthropics evals dataset

* [Feat] support anthropics evals dataset

8803f7f7

18 Sep, 2023 1 commit
- [Feat] refine docs and codes for more user guides (#409) · 2c15a0c0
  Hubert authored Sep 18, 2023
  
  2c15a0c0
15 Sep, 2023 1 commit

[Feat] implementation for support promptbench (#239) · a11cb45c

Hubert authored Sep 15, 2023

* [Feat] support adv_glue dataset for adversarial robustness

* reorg files

* minor fix

* minor fix

* support prompt bench demo

* minor fix

* minor fix

* minor fix

* minor fix

* minor fix

* minor fix

* minor fix

* minor fix

a11cb45c