Commits · acae560911d52620680da95d62eeae8f9a0aa9eb · OpenDAS / opencompass

"tests/pipelines/versatile_diffusion/__init__.py" did not exist on "3f1e95928e905daccb4ae8bce0049612c53f0737"

17 Jan, 2024 1 commit

Added support for multi-needle testing in needle-in-a-haystack test (#802) · acae5609

Mo Li authored Jan 17, 2024



* Add NeedleInAHaystack Test

* Apply pre-commit formatting

* Update configs/eval_hf_internlm_chat_20b_cdme.py
Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com>

* add needle in haystack test

* update needle in haystack test

* update plot function in tools_needleinahaystack.py

* optimizing needleinahaystack dataset generation strategy

* modify minor formatting issues

* add English version support

* change NeedleInAHaystackDataset to dynamic loading

* change NeedleInAHaystackDataset to dynamic loading

* fix needleinahaystack test eval bug

* fix needleinahaystack config bug

* Added support for multi-needle testing in needle-in-a-haystack test

* Optimize the code for plotting in the needle-in-a-haystack test.

* Correct the typo in the dataset parameters.

* update needleinahaystack test docs

---------
Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com>

acae5609

08 Jan, 2024 1 commit
- [Sync] Sync with internal codes 2023.01.08 (#777) · 32f40a8f
  Fengzhe Zhou authored Jan 08, 2024
  
  32f40a8f
03 Jan, 2024 1 commit
- [Fix] Fix small bug in alignbench (#764) · 7cd65d49
  bittersweet1999 authored Jan 03, 2024
```
* fix small bugs

* fix small bugs
```
  7cd65d49
02 Jan, 2024 1 commit

[Update] Change NeedleInAHaystackDataset to dynamic dataset loading (#754) · 33f8df1c

Mo Li authored Jan 02, 2024



* Add NeedleInAHaystack Test

* Apply pre-commit formatting

* Update configs/eval_hf_internlm_chat_20b_cdme.py
Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com>

* add needle in haystack test

* update needle in haystack test

* update plot function in tools_needleinahaystack.py

* optimizing needleinahaystack dataset generation strategy

* modify minor formatting issues

* add English version support

* change NeedleInAHaystackDataset to dynamic loading

* change NeedleInAHaystackDataset to dynamic loading

* fix needleinahaystack test eval bug

* fix needleinahaystack config bug

---------
Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com>

33f8df1c

29 Dec, 2023 1 commit

[Feature] Update plot function in tools_needleinahaystack.py (#747) · 17b8e929

Mo Li authored Dec 29, 2023



* Add NeedleInAHaystack Test

* Apply pre-commit formatting

* Update configs/eval_hf_internlm_chat_20b_cdme.py
Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com>

* add needle in haystack test

* update needle in haystack test

* update plot function in tools_needleinahaystack.py

* optimizing needleinahaystack dataset generation strategy

* modify minor formatting issues

---------
Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com>

17b8e929

25 Dec, 2023 1 commit
- Update merge script (#733) · ad96f215
  Songyang Zhang authored Dec 25, 2023
  
  ad96f215
23 Dec, 2023 1 commit

[Feature] Add NeedleInAHaystack Test Support (#714) · 0e24f421

Mo Li authored Dec 23, 2023



* Add NeedleInAHaystack Test

* Apply pre-commit formatting

* Update configs/eval_hf_internlm_chat_20b_cdme.py
Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com>

* add needle in haystack test

* update needle in haystack test

---------
Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com>

0e24f421

21 Dec, 2023 1 commit
- [Feature] Add abbr for judgemodel in subjective evaluation (#724) · fbb912dd
  bittersweet1999 authored Dec 21, 2023
```
* add_judgemodel_abbr

* add judgemodel abbr
```
  fbb912dd
15 Dec, 2023 1 commit
- [Doc] Update Doc for Alignbench (#707) · 637628a7
  Songyang Zhang authored Dec 15, 2023
```
* update alignmentbench

* update alignmentbench

* update doc

* update

* update
```
  637628a7
13 Dec, 2023 1 commit

[Feature] Support AlignmentBench infer and judge (#697) · 1fe152b3

bittersweet1999 authored Dec 13, 2023

* alignmentbench infer and judge

* alignmentbench

* alignmentbench done

* alignment all done

* alignment all done

1fe152b3

27 Nov, 2023 1 commit
- [Sync] some renaming (#641) · 9083dea6
  Fengzhe Zhou authored Nov 27, 2023
  
  9083dea6
30 Oct, 2023 1 commit

[Feature] Add multi model viz (#509) · e2355a2e

Qing authored Oct 30, 2023



* add viz_multi_model.py tool

* Modify the viz_multi_model.py script according to the review

* highlight multiple optimal scores

---------
Co-authored-by: wq.chu <wq.chu@tianrang-inc.com>
Co-authored-by: Leymore <zfz-960727@163.com>

e2355a2e

07 Oct, 2023 1 commit
- [Refactor] Move fix_id_list to Retriever (#442) · 119bfd15
  Tong Gao authored Oct 06, 2023
```
* [Refactor] Move fix_id_list to Retriever

* update

* move to base

* fix
```
  119bfd15
08 Sep, 2023 1 commit
- [Fix] update bbh implement & fix bbh suffix (#371) · b48d0840
  Leymore authored Sep 08, 2023
  
  b48d0840
06 Sep, 2023 1 commit
- [Feat] support wizardcoder series (#344) · ddb81972
  Hubert authored Sep 06, 2023
```
* [Feat] support wizardcoder series

* minor fix
```
  ddb81972
31 Aug, 2023 1 commit
- [Feat] support codellama and preds collection tools (#335) · fd389e2d
  Hubert authored Aug 31, 2023
  
  fd389e2d
29 Aug, 2023 1 commit

[Feature] Support sample count in prompt_viewer (#273) · fa7978fe

cdpath authored Aug 29, 2023



* support sample count in prompt_viewer

* update

---------
Co-authored-by: Leymore <zfz-960727@163.com>

fa7978fe

28 Aug, 2023 1 commit

[Feature] Add and apply update suffix tool (#280) · c26ecdb1

Leymore authored Aug 28, 2023

* add and apply update suffix tool

* add dataset suffix updater as precommit hook

* update workflow

* update scripts

* update ci

* update

* ci with py3.8

* run in serial

* update bbh

* use py 3.10

* update pre commit zh cn

c26ecdb1

25 Aug, 2023 2 commits
- [Feature] Simplify entry script (#204) · 9058be07
  Tong Gao authored Aug 25, 2023
```
* [Feature] Simply entry script

* update
```
  9058be07
- [Docs] update descriptions for tools (#270) · 6df124d4
  cdpath authored Aug 25, 2023
  
  6df124d4
07 Aug, 2023 1 commit

[Script] Add scripts to evaluate MMBench (#161) · 6ca2be66

Haodong Duan authored Aug 07, 2023



* update

* update

* Update README.md
Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com>

* refine

* update default

* update CN README

---------
Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com>

6ca2be66

20 Jul, 2023 1 commit
- [Feature] Add heuristic size partitioner (#63) · 3fe5ee09
  Leymore authored Jul 20, 2023
```
* [Feature] Add heuristic size partitioner

* update
```
  3fe5ee09
06 Jul, 2023 2 commits
- Update configs (#9) · 86d5ec3d
  Leymore authored Jul 06, 2023
```
* Update implements

* Update
```
  86d5ec3d
- Enhance run.py (#7) · cd1bec5f
  Tong Gao authored Jul 06, 2023
```
* Enhance run.py

* update
```
  cd1bec5f
04 Jul, 2023 1 commit
- initial commit · 7d346000
  gaotongxiao authored Jul 04, 2023
  
  7d346000