Commits · 987a7112323fdee8ed884ad1a61c10583e3825c6 · OpenDAS / opencompass

02 Nov, 2023 1 commit
- [Doc] Update README and FAQ (#535) · 987a7112
  Songyang Zhang authored Nov 02, 2023
```
* update readme

* update readme and faq
```
  987a7112
01 Nov, 2023 2 commits
- docs: fix typos in markdown files (#530) · e5ae8622
  Surav Shrestha authored Nov 01, 2023
```
* fix typos in configs/multimodal/llava/README.md

* fix typos in configs/multimodal/minigpt_4/README.md
```
  e5ae8622
- Update README.md (#531) · b562a136
  Himanshu Kumar Mahto authored Nov 01, 2023
  
  b562a136
31 Oct, 2023 1 commit
- Update README.md (#523) · 8cdd9f8e
  ayushrakesh authored Oct 31, 2023
  
  8cdd9f8e
30 Oct, 2023 3 commits

[Fix] Fix local debug mode not restrict the resources (#522) · b9270c3a
Hubert authored Oct 30, 2023
```
* [Fix] fix local debug mode not restrict the resources

* minor fix
```
b9270c3a
[Fix] Fix typo in WSC prompt (#520) · 229a65f3
Qing authored Oct 30, 2023
```
Co-authored-by: wq.chu <wq.chu@tianrang-inc.com>
```
229a65f3

[Feature] Add multi model viz (#509) · e2355a2e

Qing authored Oct 30, 2023



* add viz_multi_model.py tool

* Modify the viz_multi_model.py script according to the review

* highlight multiple optimal scores

---------
Co-authored-by: wq.chu <wq.chu@tianrang-inc.com>
Co-authored-by: Leymore <zfz-960727@163.com>

e2355a2e

27 Oct, 2023 7 commits
- Bump version to 0.1.7 (#518) · 6a398d17
  Fengzhe Zhou authored Oct 27, 2023
  
  6a398d17
- [Sync] update (#517) · dbb20b82
  Fengzhe Zhou authored Oct 27, 2023
  
  dbb20b82
- [Feat] Support local runner for windows (#515) · 6f07af30
  Hubert authored Oct 27, 2023
  
  6f07af30
- [Fix] Enforce `do_sample=False` in HF model (#506) · df07391e
  Fengzhe Zhou authored Oct 27, 2023
```
* update hf model wrapper

* patch llama

---------
Co-authored-by: bot <bot@bot.com>
```
  df07391e
- [Doc] Update Subjective docs (#510) · b6284233
  Wei Jueqi authored Oct 27, 2023
```
* rename

* add en subdoc

* fix name

* fix writing

* update

---------
Co-authored-by: Leymore <zfz-960727@163.com>
```
  b6284233
- [Feat] Add _set_model_kwargs_torch_dtype for HF model (#507) · e3d4901b
  Fengzhe Zhou authored Oct 27, 2023
```
* add _set_model_kwargs_torch_dtype for hf models

* add logger
```
  e3d4901b
- use example summarizer by default (#508) · 6405cd2d
  Fengzhe Zhou authored Oct 27, 2023
  
  6405cd2d
26 Oct, 2023 1 commit
- update owner (#504) · 46e7ede9
  Fengzhe Zhou authored Oct 26, 2023
```
Co-authored-by: bot <bot@bot.com>
```
  46e7ede9
25 Oct, 2023 3 commits
- [Feat] support math/gms8k agent config (#494) · b3f5d9e4
  Hubert authored Oct 25, 2023
```
* support math agent

* support gsm8k agent

* support gsm8k agent

* minor fix

* minor fix

* minor fix

* Update configs/eval_codeagent.py
```
  b3f5d9e4
- [Feat] local api speed up with fixed concurrent users (#497) · ac3a2c45
  Hubert authored Oct 25, 2023
```
* [Feat] local api speed up

* fix lint

* fix lint

* minor fix

* add example api
```
  ac3a2c45
- [Docs] update invalid link in docs (#499) · 44c8d6cc
  Hubert authored Oct 25, 2023
  
  44c8d6cc
23 Oct, 2023 1 commit
- Update README.md (#496) · 0809a563
  Sakshi Umredkar authored Oct 23, 2023
  
  0809a563
19 Oct, 2023 1 commit
- [Sync] sync with internal codes 20231019 (#488) · 4dd9a3fc
  Leymore authored Oct 18, 2023
  
  4dd9a3fc
18 Oct, 2023 1 commit

[Feature] Add mathbench dataset and circular evaluator (#408) · 2737249f

liushz authored Oct 18, 2023



* add_mathbench

* update mathbench

* support non circular eval dataset

---------
Co-authored-by: liuhongwei <liuhongwei@pjlab.org.cn>
Co-authored-by: yingfhu <yingfhu@gmail.com>

2737249f

17 Oct, 2023 1 commit
- fix summary default (#483) · fccfcb6f
  Leymore authored Oct 16, 2023
  
  fccfcb6f
13 Oct, 2023 4 commits
- Bump version to 0.1.6 (#478) · 6317da08
  Leymore authored Oct 13, 2023
  
  6317da08
- [Fix] Split if and only if complete eos string shows up (#477) · 7d9e3868
  Leymore authored Oct 13, 2023
  
  7d9e3868
- [Feature] Add lawbench (#460) · 861942ab
  Leymore authored Oct 13, 2023
```
* add lawbench

* update requirements

* update
```
  861942ab
- [Sync] update github token (#475) · fbf5089c
  Leymore authored Oct 13, 2023
  
  fbf5089c
12 Oct, 2023 1 commit
- fix jieba rouge (#467) · 362c33df
  Leymore authored Oct 11, 2023
  
  362c33df
09 Oct, 2023 1 commit
- [Fix] Use jieba rouge in lcsts (#459) · d7ff933a
  Leymore authored Oct 08, 2023
```
* use jieba rouge in lcsts

* use rouge_chinese
```
  d7ff933a
07 Oct, 2023 4 commits

[Docs] Fix dead links in readme (#455) · c903e7f6
Tong Gao authored Oct 07, 2023

c903e7f6
[Refactor] Move fix_id_list to Retriever (#442) · 119bfd15
Tong Gao authored Oct 06, 2023
```
* [Refactor] Move fix_id_list to Retriever

* update

* move to base

* fix
```
119bfd15

[Docs] update get_started (#435) · 767c12a6

Tong Gao authored Oct 06, 2023



* [Docs] update get_started

* [Docs] Refactor get_started

* update

* add zh FAQ

* add cn doc

* update

* fix dead links

---------
Co-authored-by: Leymore <zfz-960727@163.com>

767c12a6

Integrate turbomind inference via its RPC API instead of its python API (#414) · 67382471

Lyu Han authored Oct 07, 2023

* support tis

* integrate turbomind inference via its RPC API instead of its python API

* update guide

* update ip address spec

* update according to reviewer's comments

67382471

27 Sep, 2023 8 commits
- [Feature] re-implement ceval load dataset (#446) · 9db56526
  Leymore authored Sep 27, 2023
  
  9db56526
- [Fix] fix clp potential error and support bs>1 (#439) · d9f3e88d
  Hubert authored Sep 27, 2023
```
* [Fix] fix clp potential error and support bs>1

* [Fix] fix clp potential error and support bs>1

* minor fix

* minor fix
```
  d9f3e88d
- [Sync] Update LongEval (#443) · 3bb3d330
  philipwangOvO authored Sep 27, 2023
  
  3bb3d330
- [Fix] use eval field check (#441) · 2bb7beec
  Leymore authored Sep 27, 2023
  
  2bb7beec
- [Doc] Update dataset list (#437) · d6261e10
  Leymore authored Sep 27, 2023
```
* add new dataset list

* add new dataset list

* add new dataset list

* update

* update

* update readme

---------
Co-authored-by: gaotongxiao <gaotongxiao@gmail.com>
```
  d6261e10
- [SIG] add GLUE_MRPC dataset (#440) · dc1b82c3
  Kevin Wang authored Sep 27, 2023
  
  dc1b82c3
- [Dataset] add GLUE QQP dataset (#438) · 14fdecfe
  Kevin Wang authored Sep 27, 2023
  
  14fdecfe
- [SIG] add GLUE_CoLA dataset (#406) · d8354fe5
  Kevin Wang authored Sep 27, 2023
```
* [Dataset] add GLUE_CoLA dataset

* [update] use HFDataset to load glue/cola dataset

* update

---------
Co-authored-by: gaotongxiao <gaotongxiao@gmail.com>
```
  d8354fe5