Commits · e78857ac36959d0294c816822dbda41bb6853c34 · OpenDAS / opencompass

11 Dec, 2023 3 commits

[Sync] minor test (#683) · e78857ac
Hubert authored Dec 11, 2023

e78857ac

[Feature] enhance the ability of humaneval_postprocess (#676) · dd4318f6

Jingming authored Dec 11, 2023



* [Feature] enhance the ability of humaneval_postprocess

* refactor

* [Feature] Keep the old version of the function and realize the new function in humaneval_postprocess_v2.

* Update opencompass/datasets/humaneval.py

---------
Co-authored-by: Leymore <zfz-960727@163.com>
Co-authored-by: Hubert <42952108+yingfhu@users.noreply.github.com>

dd4318f6

[Feat] support pr merge test ci (#669) · 1029119e

Hubert authored Dec 11, 2023

* [Feat] support ci

* [Feat] support ci

* [Feat] support ci

* [Feat] support ci

* init docs

* init docs

* init docs

1029119e

10 Dec, 2023 2 commits
- [Doc] Update README (#682) · 6a928b99
  Haodong Duan authored Dec 10, 2023
  
  6a928b99
- [Enhancement] Update API Interface and Mixtral (#681) · e25c5f95
  Songyang Zhang authored Dec 10, 2023
```
* [Enhancement] Update API interface

* [Enhancement] Update API interface

* Update mixtral

* Update readme
```
  e25c5f95
09 Dec, 2023 1 commit

[Feature] Add medbench (#678) · 1bf85949

Xiaoming Shi authored Dec 09, 2023



* update medbench

* medbench update

* format medbench

* format

---------
Co-authored-by: 施晓明 <PJLAB\shixiaoming@pjnl104220118l.pjlab.org>
Co-authored-by: Leymore <zfz-960727@163.com>

1bf85949

08 Dec, 2023 2 commits

[Fix] fix bug on standart_deviation summarizer (#675) · 7cb53a95
Jingming authored Dec 08, 2023

7cb53a95

[Feature] Add Data Contamination Analysis (#639) · 05bbce8b

liyucheng09 authored Dec 08, 2023



* add contamination analysis to ceval

* fix bugs

* add contamination docs

* to pass CI check

* update

---------
Co-authored-by: zhangyifan1 <zhangyifan1@pjlab.org.cn>
Co-authored-by: Leymore <zfz-960727@163.com>

05bbce8b

07 Dec, 2023 1 commit
- add qwen and deepseek configs (#672) · 3a354bd1
  Fengzhe Zhou authored Dec 07, 2023
  
  3a354bd1
06 Dec, 2023 1 commit

New subjective judgement (#660) · 1c95790f

bittersweet1999 authored Dec 06, 2023



* TabMWP

* TabMWP

* fixed

* fixed

* fixed

* done

* done

* done

* add new subjective judgement

* add new subjective judgement

* add new subjective judgement

* add new subjective judgement

* add new subjective judgement

* modified to a more general way

* modified to a more general way

* final

* final

* add summarizer

* add new summarize

* fixed

* fixed

* fixed

---------
Co-authored-by: caomaosong <caomaosong@pjlab.org.cn>

1c95790f

01 Dec, 2023 4 commits

added rolebench dataset. (#633) · e10f1c91

rolellm authored Dec 01, 2023

* added rolebench

* 修改了不合理的变量名

* 修改了评论中的变量名

e10f1c91

[Feature] Update MathBench CodeInterpreter & fix MathBench Bug (#657) · f4bbff65

liushz authored Dec 01, 2023



* Update MathBench CodeInterpreter & fix MathBench Bug

* Fix errors

* update

---------
Co-authored-by: liuhongwei <liuhongwei@pjlab.org.cn>
Co-authored-by: Fengzhe Zhou <zfz-960727@163.com>

f4bbff65

[Feat] update gsm8k and math agent config (#652) · 9eb5cadc
Hubert authored Dec 01, 2023
```
* [Feat] update gsm8k and math agent config

* minor fix
```
9eb5cadc

[Feature] Add wikibench dataset (#655) · a331c9ab

liushz authored Dec 01, 2023



* Add WikiBench

* Add WikiBench

* format

---------
Co-authored-by: Leymore <zfz-960727@163.com>

a331c9ab

30 Nov, 2023 2 commits

[Feature] Add Chinese version: commonsenseqa, crowspairs and nq (#144) · e019c831

liushz authored Nov 30, 2023



* add Chinese version: csqa crowspairs nq

* Update cn_data

* Update cn_data

* update format

---------
Co-authored-by: liuhongwei <liuhongwei@pjlab.org.cn>
Co-authored-by: Leymore <zfz-960727@163.com>

e019c831

[Feature] Support chat style inferencer. (#643) · 6aaf3b91

Ma Zerun authored Nov 30, 2023



* [Feature] Support chat style inferencer.

* [Fix] use new prompt

* [Fix] use new prompt

---------
Co-authored-by: yingfhu <yingfhu@gmail.com>

6aaf3b91

29 Nov, 2023 1 commit
- fix hellaswag_ppl_47bff9 (#648) · 5933c04f
  Fengzhe Zhou authored Nov 29, 2023
  
  5933c04f
28 Nov, 2023 2 commits
- [Fix] remove colossalai dependency (#645) · e9e75fb4
  Hubert authored Nov 28, 2023
  
  e9e75fb4
- [Sync] Bump version to 0.1.9 (#644) · e20d654c
  Fengzhe Zhou authored Nov 28, 2023
  
  e20d654c
27 Nov, 2023 3 commits

[Feat] support zhipu post process (#642) · d4af31ba

Hubert authored Nov 27, 2023

* [Feat] support zhipu post

* [Feat] support zhipu post

* [Feat] support zhipu post

d4af31ba

[Feature] Add GSM_Hard dataset (#619) · 6d0d7898

liushz authored Nov 27, 2023



* Add SVAMP dataset

* Add SVAMP dataset

* Add SVAMP dataset

* Add gsm_hard dataset

* Add gsm_hard dataset

* format

---------
Co-authored-by: Leymore <zfz-960727@163.com>

6d0d7898

[Sync] some renaming (#641) · 9083dea6
Fengzhe Zhou authored Nov 27, 2023

9083dea6

24 Nov, 2023 4 commits
- [Fix] fix typo in README (#637) · 68c4c1ef
  Yggdrasill7D6 authored Nov 24, 2023
  
  68c4c1ef
- [Fix] Fix lightllmapi list bug (#635) · 522241a8
  Yang Yong authored Nov 24, 2023
  
  522241a8
- [Bug] fix icl eval with nested list (#632) · 18849126
  Hubert authored Nov 24, 2023
  
  18849126
- [Doc] Update README (#629) · 81b67e8d
  Songyang Zhang authored Nov 24, 2023
```
* update readme

* fix typo

* Update README.md

---------
Co-authored-by: liushz <qq1791167085@163.com>
```
  81b67e8d
23 Nov, 2023 4 commits

[Doc] Update FAQ (#628) · 79f6449d

Fengzhe Zhou authored Nov 23, 2023



* update faq

* Update docs/zh_cn/get_started/faq.md

* Update docs/en/get_started/faq.md

* Update docs/zh_cn/get_started/faq.md

---------
Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com>

79f6449d

[Feature] Add circular eval (#610) · d949e3c0

Fengzhe Zhou authored Nov 23, 2023

* refactor default, add circular summarizer

* add circular

* update impl

* update doc

* minor update

* no more to be added

d949e3c0

[API] Update API (#624) · 5202456b

Songyang Zhang authored Nov 23, 2023



* update api

* update generation_kwargs impl

* update api

* refactor

---------
Co-authored-by: Leymore <zfz-960727@163.com>

5202456b

[Sync] Fix cmnli, fix vicuna meta template, fix longbench postprocess and other minor fixes (#625) · d4d1330a
Fengzhe Zhou authored Nov 23, 2023

d4d1330a

22 Nov, 2023 6 commits
- [Doc] Update README and requirements. (#622) · 5329724b
  Songyang Zhang authored Nov 22, 2023
```
* update readme

* update doc
```
  5329724b
- [Feature] support download from modelscope (#534) · c0785e53
  Kevin Wang authored Nov 22, 2023
```
* [Feature] download from modelscope

* [Feature] download from modelscope

* minor fix

---------
Co-authored-by: yingfhu <yingfhu@gmail.com>
```
  c0785e53
- [Feature] Add SVAMP dataset (#604) · 04877519
  liushz authored Nov 22, 2023
```
* Add SVAMP dataset

* Add SVAMP dataset

* Add SVAMP dataset
```
  04877519
- [Docs] update ds1000 code eval docs (#618) · 8c1483e3
  Hubert authored Nov 22, 2023
  
  8c1483e3
- [Fix] Fix gen inferencer (#615) · fb30b7c7
  Fengzhe Zhou authored Nov 22, 2023
  
  fb30b7c7
- [Bug] Update api with generation_kargs (#614) · 721a45c6
  Songyang Zhang authored Nov 22, 2023
```
* update api

* update generation_kwargs impl

---------
Co-authored-by: Leymore <zfz-960727@163.com>
```
  721a45c6
21 Nov, 2023 4 commits

Integrate turbomind python api (#484) · eb56fd6d

Lyu Han authored Nov 21, 2023



* integrate turbomind python api

* update

* update user guide

* update

* fix according to reviewer's comments

* fix error

* fix linting

* update user guide

* remove debug log

---------
Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com>

eb56fd6d

[Feature] Support 360API and FixKRetriever for CSQA dataset (#601) · d9257482

Songyang Zhang authored Nov 21, 2023



* [Feature] Support 360API and FixKRetriever for CSQA dataset

* Update API

* Update API

* [Feature] Support 360API and FixKRetriever for CSQA dataset

* Update API

* Update API

* rm mathbench

* fix_lint

* Update opencompass/models/bytedance_api.py
Co-authored-by: Hubert <42952108+yingfhu@users.noreply.github.com>

* update

* update

* update

---------
Co-authored-by: Hubert <42952108+yingfhu@users.noreply.github.com>

d9257482

[Feature] Support Lightllm API (#613) · d3b0d5c4

Yang Yong authored Nov 21, 2023



* [Feature] Support Lightllm api

* formatting & renaming

---------
Co-authored-by: Leymore <zfz-960727@163.com>

d3b0d5c4

Add support for DataCanvas Alaya LM (#612) · 7199acc2
Yuan Feng authored Nov 21, 2023
```
* Support for Alaya

* Remove useless requirements
```
7199acc2