Commits · 35ff52e77435349f2c04a7eff701d6e34cd15d6e · gaoqiong / lm-evaluation-harness

07 May, 2023 2 commits
- Merge branch 'polyglot' into feature/unsmile · 35ff52e7
  Ingyu Seong authored May 07, 2023
  
  35ff52e7
- Resolve confilict on init file · e6ca2021
  ingyuseong authored May 07, 2023
  
  e6ca2021
06 May, 2023 3 commits
- Merge pull request #446 from cardy20/polyglot · c137dfa3
  Stella Biderman authored May 06, 2023
```
Add Korean Hate Speech evaluation, modify a key error in datasets/nsmc.py
```
  c137dfa3
- apeach update · 9569ee87
  cardy20 authored May 06, 2023
  
  9569ee87
- Modify the name of label 1 · dae050b4
  ingyuseong authored May 06, 2023
  
  dae050b4
05 May, 2023 1 commit
- Modify KorUnsmile as multi-class classification · c07ebd4d
  ingyuseong authored May 05, 2023
  
  c07ebd4d
01 May, 2023 2 commits
- class document modfied · 82906bdc
  cardy20 authored May 01, 2023
  
  82906bdc
- korean hate speech evaluation code updated. · 380cc18e
  cardy20 authored May 01, 2023
  
  380cc18e
30 Apr, 2023 1 commit
- datasets/nsmc.py key error modified · 0d94326e
  cardy20 authored Apr 30, 2023
  
  0d94326e
24 Apr, 2023 1 commit
- Add KorUnSmile task · 26f19561
  ingyuseong authored Apr 24, 2023
  
  26f19561
15 Apr, 2023 1 commit
- fix: add acc_norm in kobest_hellaswag · 1bf3c505
  kabbi159 authored Apr 15, 2023
  
  1bf3c505
27 Mar, 2023 4 commits
- Merge pull request #405 from ingyuseong/feature/klue-nli · cc7650d8
  Kevin Ko authored Mar 27, 2023
```
Add `KLUE-NLI` task
```
  cc7650d8
- Fix KLUE-STS Typo · 9d8f0cc1
  ingyuseong authored Mar 27, 2023
  
  9d8f0cc1
- Modify KLUE-NLI prompt · 6285b3ae
  ingyuseong authored Mar 27, 2023
  
  6285b3ae
- Fix typo · 5a213c78
  ingyuseong authored Mar 27, 2023
  
  5a213c78
26 Mar, 2023 1 commit
- Add KLUE-NLI task · a1a5a805
  ingyuseong authored Mar 26, 2023
  
  a1a5a805
20 Mar, 2023 1 commit
- Merge pull request #397 from ingyuseong/review-ko-tasks · f7072b3b
  Jiwung Hyun authored Mar 20, 2023
```
Refactor KLUE tasks
```
  f7072b3b
13 Mar, 2023 2 commits
- Refactor KLUE-STS calculating pred · 34c60176
  ingyuseong authored Mar 13, 2023
  
  34c60176
- Fix KLUE few-shot label · 26e55d33
  ingyuseong authored Mar 13, 2023
  
  26e55d33
18 Oct, 2022 1 commit
- Merge pull request #344 from jaesuny/kobest-label · 94c2c064
  Jiwung Hyun authored Oct 18, 2022
```
Fix KoBEST few-shot label
```
  94c2c064
21 Sep, 2022 1 commit
- Fix KOBEST few-shot label · e7852f4e
  Jaesun Park authored Sep 21, 2022
  
  e7852f4e
18 Sep, 2022 1 commit
- Remove f1 metric · 4604f458
  kabbi159 authored Sep 18, 2022
  
  4604f458
16 Sep, 2022 2 commits
- add accuracy and macro f1 score in kobest task · f60f1753
  kabbi159 authored Sep 17, 2022
  
  f60f1753
- resolve TypeError · 44e4196b
  kabbi159 authored Sep 17, 2022
  
  44e4196b
04 Sep, 2022 1 commit
- Update gpt2.py · e265bd7c
  Jiwung Hyun authored Sep 04, 2022
```
remove vocab size slicing for korean gpt2 model
```
  e265bd7c
02 Aug, 2022 1 commit
- Apply stderr for macro f1 score · 3670b32e
  kabbi159 authored Aug 02, 2022
  
  3670b32e
01 Aug, 2022 1 commit
- Modify prompt and add citation (#338) · 4bab5137
  Jiwung Hyun authored Aug 02, 2022
  
  4bab5137
27 Jun, 2022 1 commit
- Add ko-en translation task to eval Korean language task (#328) · 10c61137
  Seung-Moo Yang authored Jun 27, 2022
```
* feat: Add task for ko-en translation
Co-authored-by: Taekyoon <tgchoi03@gmail.com>
```
  10c61137
05 Jun, 2022 1 commit

Add kobest benchmark tasks to eval Korean language task (#329) · 7ce584bd

Jiwung Hyun authored Jun 05, 2022



* feat: add kobest task
    - kobest-boolq, kobest-wic, kobest-sentineg, kobest-copa, kobest-hellaswag
Co-authored-by: Taekyoon <tgchoi03@gmail.com>

7ce584bd

22 May, 2022 2 commits
- Add klue-ynat task to eval Korean language task (#310) · ff2e7aa1
  Jiwung Hyun authored May 22, 2022
```
- Add macro_f1_score for multi-class task
- Add klue-ynat task
Co-authored-by: Taekyoon <tgchoi03@gmail.com>
```
  ff2e7aa1
- Add korquad v1.0 task (#327) · 11fa0bf4
  Taekyoon authored May 22, 2022
```
- Add korquad task
```
  11fa0bf4
20 May, 2022 3 commits
- Add nsmc task (Korean language task) · cc88a0cf
  Taekyoon authored May 20, 2022
```
- Add nsmc dataset and task modules
```
  cc88a0cf
- Merge branch 'multilingual-ko' into feature/multilingual/eval-nsmc · 5e7738d7
  Hyung-jun Kim authored May 20, 2022
  
  5e7738d7
- fix: conflict with klue · 694c144c
  soqeue1 authored May 20, 2022
  
  694c144c
01 May, 2022 1 commit
- Merge pull request #307 from Taekyoon/multilingual-ko-korsts · 4887d9d3
  Jonathan Tow authored May 01, 2022
```
Add klue-sts task to eval Korean language task
```
  4887d9d3
17 Apr, 2022 2 commits
- Commented assertion lines in gpt2 class · 4a1041c1
  Ubuntu authored Apr 17, 2022
  
  4a1041c1
- Add klue-sts task · 4ddee6c8
  Ubuntu authored Apr 17, 2022
  
  4ddee6c8
04 Apr, 2022 2 commits
- fix: remove assert · 62976337
  soqeue1 authored Apr 04, 2022
  
  62976337
- feat: Add nsmc dataset and evaluation · 2987beb0
  soqeue1 authored Apr 04, 2022
  
  2987beb0
01 Apr, 2022 1 commit
- Merge pull request #300 from jon-tow/hf-dataset-refactor · 6caa0afd
  Leo Gao authored Apr 01, 2022
```
Refactor `Task` downloading to use `HuggingFace.datasets`
```
  6caa0afd