Commits · ko · gaoqiong / lm-evaluation-harness

23 May, 2023 1 commit
- fix minor bug · 2e724896
  bzantium authored May 23, 2023
  
  2e724896
18 May, 2023 4 commits
- modify prompt for better evaluation · 786d612e
  bzantium authored May 18, 2023
  
  786d612e
- fix for merge from master · 1f8b7f79
  bzantium authored May 18, 2023
  
  1f8b7f79
- fix for merge from master · 0371f45c
  bzantium authored May 18, 2023
  
  0371f45c
- fix for merge from master · baa8b0d3
  bzantium authored May 18, 2023
  
  baa8b0d3
08 May, 2023 1 commit
- Fix typo · a956bc63
  ingyuseong authored May 08, 2023
  
  a956bc63
07 May, 2023 3 commits
- Merge pull request #430 from ingyuseong/feature/unsmile · 32ba1de8
  Stella Biderman authored May 07, 2023
```
Add `KorUnSmile` task
```
  32ba1de8
- Merge branch 'polyglot' into feature/unsmile · 35ff52e7
  Ingyu Seong authored May 07, 2023
  
  35ff52e7
- Resolve confilict on init file · e6ca2021
  ingyuseong authored May 07, 2023
  
  e6ca2021
06 May, 2023 3 commits
- Merge pull request #446 from cardy20/polyglot · c137dfa3
  Stella Biderman authored May 06, 2023
```
Add Korean Hate Speech evaluation, modify a key error in datasets/nsmc.py
```
  c137dfa3
- apeach update · 9569ee87
  cardy20 authored May 06, 2023
  
  9569ee87
- Modify the name of label 1 · dae050b4
  ingyuseong authored May 06, 2023
  
  dae050b4
05 May, 2023 1 commit
- Modify KorUnsmile as multi-class classification · c07ebd4d
  ingyuseong authored May 05, 2023
  
  c07ebd4d
01 May, 2023 2 commits
- class document modfied · 82906bdc
  cardy20 authored May 01, 2023
  
  82906bdc
- korean hate speech evaluation code updated. · 380cc18e
  cardy20 authored May 01, 2023
  
  380cc18e
30 Apr, 2023 1 commit
- datasets/nsmc.py key error modified · 0d94326e
  cardy20 authored Apr 30, 2023
  
  0d94326e
24 Apr, 2023 1 commit
- Add KorUnSmile task · 26f19561
  ingyuseong authored Apr 24, 2023
  
  26f19561
15 Apr, 2023 1 commit
- fix: add acc_norm in kobest_hellaswag · 1bf3c505
  kabbi159 authored Apr 15, 2023
  
  1bf3c505
27 Mar, 2023 4 commits
- Merge pull request #405 from ingyuseong/feature/klue-nli · cc7650d8
  Kevin Ko authored Mar 27, 2023
```
Add `KLUE-NLI` task
```
  cc7650d8
- Fix KLUE-STS Typo · 9d8f0cc1
  ingyuseong authored Mar 27, 2023
  
  9d8f0cc1
- Modify KLUE-NLI prompt · 6285b3ae
  ingyuseong authored Mar 27, 2023
  
  6285b3ae
- Fix typo · 5a213c78
  ingyuseong authored Mar 27, 2023
  
  5a213c78
26 Mar, 2023 1 commit
- Add KLUE-NLI task · a1a5a805
  ingyuseong authored Mar 26, 2023
  
  a1a5a805
20 Mar, 2023 1 commit
- Merge pull request #397 from ingyuseong/review-ko-tasks · f7072b3b
  Jiwung Hyun authored Mar 20, 2023
```
Refactor KLUE tasks
```
  f7072b3b
13 Mar, 2023 2 commits
- Refactor KLUE-STS calculating pred · 34c60176
  ingyuseong authored Mar 13, 2023
  
  34c60176
- Fix KLUE few-shot label · 26e55d33
  ingyuseong authored Mar 13, 2023
  
  26e55d33
18 Oct, 2022 1 commit
- Merge pull request #344 from jaesuny/kobest-label · 94c2c064
  Jiwung Hyun authored Oct 18, 2022
```
Fix KoBEST few-shot label
```
  94c2c064
21 Sep, 2022 1 commit
- Fix KOBEST few-shot label · e7852f4e
  Jaesun Park authored Sep 21, 2022
  
  e7852f4e
18 Sep, 2022 1 commit
- Remove f1 metric · 4604f458
  kabbi159 authored Sep 18, 2022
  
  4604f458
16 Sep, 2022 2 commits
- add accuracy and macro f1 score in kobest task · f60f1753
  kabbi159 authored Sep 17, 2022
  
  f60f1753
- resolve TypeError · 44e4196b
  kabbi159 authored Sep 17, 2022
  
  44e4196b
04 Sep, 2022 1 commit
- Update gpt2.py · e265bd7c
  Jiwung Hyun authored Sep 04, 2022
```
remove vocab size slicing for korean gpt2 model
```
  e265bd7c
02 Aug, 2022 1 commit
- Apply stderr for macro f1 score · 3670b32e
  kabbi159 authored Aug 02, 2022
  
  3670b32e
01 Aug, 2022 1 commit
- Modify prompt and add citation (#338) · 4bab5137
  Jiwung Hyun authored Aug 02, 2022
  
  4bab5137
27 Jun, 2022 1 commit
- Add ko-en translation task to eval Korean language task (#328) · 10c61137
  Seung-Moo Yang authored Jun 27, 2022
```
* feat: Add task for ko-en translation
Co-authored-by: Taekyoon <tgchoi03@gmail.com>
```
  10c61137
05 Jun, 2022 1 commit

Add kobest benchmark tasks to eval Korean language task (#329) · 7ce584bd

Jiwung Hyun authored Jun 05, 2022



* feat: add kobest task
    - kobest-boolq, kobest-wic, kobest-sentineg, kobest-copa, kobest-hellaswag
Co-authored-by: Taekyoon <tgchoi03@gmail.com>

7ce584bd

22 May, 2022 2 commits
- Add klue-ynat task to eval Korean language task (#310) · ff2e7aa1
  Jiwung Hyun authored May 22, 2022
```
- Add macro_f1_score for multi-class task
- Add klue-ynat task
Co-authored-by: Taekyoon <tgchoi03@gmail.com>
```
  ff2e7aa1
- Add korquad v1.0 task (#327) · 11fa0bf4
  Taekyoon authored May 22, 2022
```
- Add korquad task
```
  11fa0bf4
20 May, 2022 2 commits
- Add nsmc task (Korean language task) · cc88a0cf
  Taekyoon authored May 20, 2022
```
- Add nsmc dataset and task modules
```
  cc88a0cf
- Merge branch 'multilingual-ko' into feature/multilingual/eval-nsmc · 5e7738d7
  Hyung-jun Kim authored May 20, 2022
  
  5e7738d7