Commits · ce777853ae828a6ad7a810c49cc44c55758e106d · OpenDAS / ColossalAI

24 Sep, 2023 1 commit

[feature] ColossalEval: Evaluation Pipeline for LLMs (#4786) · ce777853

Yuanchen authored Sep 24, 2023



* Add ColossalEval

* Delete evaluate in Chat

---------
Co-authored-by: Xu Yuanchen <yuanchen.xu00@gmail.com>
Co-authored-by: Tong Li <tong.li352711588@gmail.com>

ce777853

19 Sep, 2023 1 commit

[misc] update pre-commit and run all files (#4752) · 079bf3cb

Hongxin Liu authored Sep 19, 2023

* [misc] update pre-commit

* [misc] run pre-commit

* [misc] remove useless configuration files

* [misc] ignore cuda for clang-format

079bf3cb

15 Sep, 2023 1 commit
- Optimized some syntax errors in the documentation and code under applications/ (#4127) · e4fc57c3
  digger yu authored Sep 15, 2023
```
Co-authored-by: flybird11111 <1829166702@qq.com>
```
  e4fc57c3
19 Jun, 2023 1 commit
- [nfc] fix dim not defined and fix typo (#3991) · 727c4598
  digger yu authored Jun 19, 2023
  
  727c4598
13 Jun, 2023 1 commit
- [evaluate] support gpt evaluation with reference (#3972) · 2925f473
  Yuanchen authored Jun 13, 2023
```
Co-authored-by: Yuanchen Xu <yuanchen.xu00@gmail.com>
```
  2925f473
08 Jun, 2023 1 commit
- support UniEval and add CHRF metric (#3924) · 21c4c0b1
  Yuanchen authored Jun 08, 2023
```
Co-authored-by: Yuanchen Xu <yuanchen.xu00@gmail.com>
```
  21c4c0b1
05 Jun, 2023 1 commit
- support evaluation for english (#3880) · 57a6d768
  Yuanchen authored Jun 05, 2023
```
Co-authored-by: Yuanchen Xu <yuanchen.xu00@gmail.com>
```
  57a6d768
30 May, 2023 1 commit

[evaluation] improvement on evaluation (#3862) · 2506e275

Yuanchen authored May 30, 2023



* fix a bug when the config file contains one category but the answer file doesn't contains that category

* fix Chinese prompt file

* support gpt-3.5-turbo and gpt-4 evaluation

* polish and update README

* resolve pr comments

---------
Co-authored-by: Yuanchen Xu <yuanchen.xu00@gmail.com>

2506e275

24 May, 2023 1 commit

[evaluation] add automatic evaluation pipeline (#3821) · 34966378

Yuanchen authored May 24, 2023



* add functions for gpt evaluation

* add automatic eval

Update eval.py

* using jload and modify the type of answers1 and answers2

* Update eval.py

Update eval.py

* Update evaluator.py

* support gpt evaluation

* update readme.md

update README.md

update READNE.md

modify readme.md

* add Chinese example for config, battle prompt and evaluation prompt file

* remove GPT-4 config

* remove sample folder

---------
Co-authored-by: Yuanchen Xu <yuanchen.xu00@gmail.com>
Co-authored-by: Camille Zhong <44392324+Camille7777@users.noreply.github.com>

34966378