Commits · 8b163bd8e96934a9d0db44decc3bb6b9424c8441 · OpenDAS / opencompass

"vscode:/vscode.git/clone" did not exist on "22443f7aaec112080e9a884bb047bc01db1c9ffd"

01 Aug, 2023 3 commits
- [Feature] Several enhancements (#142) · 8b163bd8
  Tong Gao authored Aug 01, 2023
  
  8b163bd8
- [Feature] Evaluating acc based on minimum edit distance, update SIQA (#130) · c00179d4
  Tong Gao authored Aug 01, 2023
```
* [Feature] Support evaluating acc based on minimum edit distance, update SIQA

* update
```
  c00179d4
- [DOC] Add metric doc (#118) · e9b7b8ab
  Ezra-Yu authored Aug 01, 2023
```
* update

* update

* update metric docs

* update index.rst

* update metrics
```
  e9b7b8ab
31 Jul, 2023 1 commit

[Enhancement] Update README.md (#119) · d860b61d

Songyang Zhang authored Jul 31, 2023



* Update README.md

* update README_zh-CN.md

* update get_started

---------
Co-authored-by: Leymore <zfz-960727@163.com>

d860b61d

28 Jul, 2023 5 commits

[Docs] Update prompt docs (#46) · 262ab794

Leymore authored Jul 29, 2023



* [Docs] Update prompt docs

* update

* [Docs] Prompt docs (#112)

* update docs

* update

* update

* Update en prompt template

* Update en prompt doc

* fix

* fix

---------
Co-authored-by: Tong Gao <gaotongxiao@gmail.com>

262ab794

edit doc (#125) · e04f8842
Anakin Skywalker authored Jul 28, 2023

e04f8842

[Feature] Add SC (#126) · d862f570

Leymore authored Jul 28, 2023



* add self-consistency

* add CoT method Self-Consistency

* fix typo error and update openicl_eval

* add tydiQA-GoldP task

* fix sc

* rename gsm8k_sc

* fix sc

* add self-consistency doc

* refine sc

---------
Authored-by: liushz <qq1791167085@163.com>

d862f570

[Fix] Fix seed in HFEvaluator (#122) · 538b4393
Haodong Duan authored Jul 28, 2023

538b4393
[Feature] Allow explicitly setting the temperature for API model (#121) · 46c96457
Haodong Duan authored Jul 28, 2023
```
* allow explicitly setting the temperature

* update
```
46c96457

27 Jul, 2023 4 commits
- [Docs] Update issue templates for proper guidance to discussions (#116) · 80ce18f8
  Tong Gao authored Jul 27, 2023
  
  80ce18f8
- [Feature] Support intern lanuage model (#51) · 57fcfc97
  gowithme authored Jul 27, 2023
```
* support internLM

* support internLM

* simplify intern model files

* update storage_manager

* support internLM

* Modify the file organization structure

* support internLM

* support internLM

* support internLM

* support internLM

* change some details
```
  57fcfc97
- Doc: add twitter link (#111) · 8a4d0867
  vansin authored Jul 27, 2023
  
  8a4d0867
- [Doc] Update Readme and Fix failed links (#108) · d1ec6047
  Ezra-Yu authored Jul 27, 2023
```
* update reame and fix failed links

* update

* update review
```
  d1ec6047
26 Jul, 2023 2 commits
- [Feat] add auto assignee bot (#105) · aa130677
  Hubert authored Jul 26, 2023
```
* [Feat] add auto assignee bot

* minor fix
```
  aa130677
- [Refactor] Update crows-pairs evaluation (#98) · b7184e9d
  Hubert authored Jul 26, 2023
```
* [Refactor] Update crows-pairs evaluation

* [Refactor] Update crows-pairs evaluation

* minor
```
  b7184e9d
25 Jul, 2023 4 commits

[Fix] MMBench Doc Fix (#96) · 4b0aa804
Haodong Duan authored Jul 25, 2023
```
* update

* update

* fix lint
```
4b0aa804
[Fix] Fix llama configs (#72) · 3715be65
Tong Gao authored Jul 25, 2023
```
Co-authored-by: Leymore <zfz-960727@163.com>
```
3715be65

[Feature] Add CMMLU dataset (#91) · e9cdb24d

Haonan Li authored Jul 25, 2023



* add CMMLU

* debug cmmlu

* add slurm args `qos`

* fix format: space before comment

* remove unused variable

* change the location of `answer is`

---------
Co-authored-by: 李浩楠 <lihaonan@lihaonandeMacBook-Air.local>
Co-authored-by: 李浩楠 <haonan.li>
Co-authored-by: Leymore <zfz-960727@163.com>

e9cdb24d

force utf-8 encoding for all non-dataset fileios (#97) · 6e885d66
Haodong Duan authored Jul 25, 2023

6e885d66

20 Jul, 2023 1 commit
- [Feature] Add heuristic size partitioner (#63) · 3fe5ee09
  Leymore authored Jul 20, 2023
```
* [Feature] Add heuristic size partitioner

* update
```
  3fe5ee09
19 Jul, 2023 1 commit

[Feature] Add llama-2 models (#81) · eea8b044

Leymore authored Jul 19, 2023



* add llama-2 models

* update docs

---------
Co-authored-by: gaotongxiao <gaotongxiao@gmail.com>

eea8b044

18 Jul, 2023 4 commits
- [Feat] Support CValues Responsibility dataset (#78) · f83e125e
  Hubert authored Jul 18, 2023
```
* [Feat] support CValues

* minor fix
```
  f83e125e
- [Feature] Support load PEFT adapter for HuggingFace model (#74) · 26e2f171
  LZH authored Jul 18, 2023
```
* support peft for HuggingFace model

* add docstring
```
  26e2f171
- [Feature] Add tydiqa-goldp (#75) · f36c0496
  liushz authored Jul 18, 2023
```
Co-authored-by: liuhongwei <liuhongwei@pjlab.org.cn>
```
  f36c0496
- [Feat] add falcon-40b (#76) · 29598e36
  Hubert authored Jul 18, 2023
```
* [Feat] add falcon-40b

* minor fix
```
  29598e36
17 Jul, 2023 8 commits
- [Fix] Fix CI (#70) · 311bf0da
  Tong Gao authored Jul 17, 2023
```
* [Fix] Fix CI

* [Fix] Fix CI

* [Fix] Fix CI

* update
```
  311bf0da
- [Fix] Fix circular import of PromptTemplate (#71) · 29006e39
  Tong Gao authored Jul 17, 2023
  
  29006e39
- [Enhancement] Test linting in CI and fix existing linting errors (#69) · 1e445417
  Tong Gao authored Jul 17, 2023
```
* [Enhancement] Test linting in CI

* fix linting
```
  1e445417
- [Fix] eval_llama_7b (#68) · 9a164489
  Leymore authored Jul 17, 2023
  
  9a164489
- [Feature] Add baichuan13b model configs (#60) · edb23d15
  Leymore authored Jul 17, 2023
```
* [Feature] Add baichuan13b

* update num_gpus
```
  edb23d15
- [Feature] Add logger info and remove dataset bugs (#61) · 1326aff7
  Leymore authored Jul 17, 2023
```
* Add logger info and remove dataset bugs

* fix typo
```
  1326aff7
- [Docs] Update evaluation doc (#39) · 77a1cc44
  Tong Gao authored Jul 17, 2023
  
  77a1cc44
- [Feature] add --dry-run option (#59) · e19a0c1c
  Leymore authored Jul 17, 2023
  
  e19a0c1c
14 Jul, 2023 1 commit
- [Doc] add discord and wechat link (#64) · 840a8ebe
  vansin authored Jul 14, 2023
  
  840a8ebe
13 Jul, 2023 2 commits
- [Feature]: Add MMBench (#56) · f6c5a839
  Yuan Liu authored Jul 13, 2023
  
  f6c5a839
- [Docs] Polish docs (#43) · fd577869
  Tong Gao authored Jul 13, 2023
```
* [Docs] Polish docs

* apply suggestions

* apply suggestions
```
  fd577869
12 Jul, 2023 3 commits
- [Feature] Enhance OpenAI API, add example config for GPT evaluation (#53) · 7ee5a86f
  Tong Gao authored Jul 12, 2023
```
* [Feature] Enhance OpenAI API, add example config for GPT evaluation

* fix
```
  7ee5a86f
- [Feat] add bs for perspective api eval (#50) · f5103f93
  Hubert authored Jul 12, 2023
```
* [Feat] add bs for perspective api eval

* fix according to comments

* fix according to comments
```
  f5103f93
- [Fix] Fix errors caused by MMEngine 0.8.1 (#48) · 014b24dd
  Tong Gao authored Jul 12, 2023
  
  014b24dd
11 Jul, 2023 1 commit
- [Fix] fix clp inferencer (#44) · c8f1d513
  Hubert authored Jul 11, 2023
  
  c8f1d513