Commits · c155698f64563a46cdcd840850bc86415e2f8437 · gaoqiong / lm-evaluation-harness

14 Feb, 2021 14 commits
- Merge pull request #133 from EleutherAI/fazz/refactor-task-coqa · c155698f
  Leo Gao authored Feb 14, 2021
```
CoQa Task Initial Implementation
```
  c155698f
- Fix CoQA for tests · 431e53de
  Leo Gao authored Feb 14, 2021
  
  431e53de
- Add GPT2 greedy_until truncation · 8966289a
  Leo Gao authored Feb 14, 2021
  
  8966289a
- Merge branch 'master' of github.com:EleutherAI/lm_evaluation_harness into fazz/refactor-task-coqa · dbdba695
  Leo Gao authored Feb 14, 2021
  
  dbdba695
- Merge branch 'fazz/refactor-task-coqa' of... · 84774770
  Leo Gao authored Feb 14, 2021
```
Merge branch 'fazz/refactor-task-coqa' of github.com:EleutherAI/lm_evaluation_harness into fazz/refactor-task-coqa
```
  84774770
- Merge pull request #153 from EleutherAI/translation-v2 · 1e5194a2
  Leo Gao authored Feb 14, 2021
```
Translation v2
```
  1e5194a2
- fix metric iterable checks · d0a301cc
  & authored Feb 14, 2021
  
  d0a301cc
- move task list to init file · b1619834
  & authored Feb 14, 2021
  
  b1619834
- look at available pairs languages · b5bb7f6c
  & authored Feb 14, 2021
  
  b5bb7f6c
- Merge pull request #152 from zphang/record_fix · 758b9e3c
  Leo Gao authored Feb 14, 2021
```
ReCoRD Update
```
  758b9e3c
- update · 81ab3416
  Jason Phang authored Feb 13, 2021
  
  81ab3416
- ReCoRD fixup · 2cfdd80a
  Jason Phang authored Feb 13, 2021
  
  2cfdd80a
- Merge pull request #150 from zphang/record_update · 41eb4a65
  Leo Gao authored Feb 13, 2021
```
ReCoRD fix
```
  41eb4a65
- tweak doc format · 2719a522
  Jason Phang authored Feb 13, 2021
  
  2719a522
13 Feb, 2021 17 commits
- Merge remote-tracking branch 'origin/fazz/refactor-task-coqa' into fazz/refactor-task-coqa · 6a534600
  thefazzer authored Feb 13, 2021
  
  6a534600
- Merge remote-tracking branch 'origin/master' into fazz/refactor-task-coqa · fee14a6d
  thefazzer authored Feb 13, 2021
  
  fee14a6d
- Call greedy_until continuation, download fix · 68122ef4
  thefazzer authored Feb 13, 2021
  
  68122ef4
- ReCoRD fix · e4e9228e
  Jason Phang authored Feb 13, 2021
  
  e4e9228e
- Merge pull request #145 from EleutherAI/decontamination · 487b5313
  Leo Gao authored Feb 13, 2021
```
Train set decontamination 
```
  487b5313
- Merge branch 'master' into decontamination · 4d90dc8a
  Leo Gao authored Feb 13, 2021
  
  4d90dc8a
- Merge remote-tracking branch 'origin/master' into fazz/refactor-task-coqa · 37c3139d
  thefazzer authored Feb 13, 2021
  
  37c3139d
- Merge pull request #146 from EleutherAI/translation · 7ad6bf45
  Leo Gao authored Feb 13, 2021
```
Translation
```
  7ad6bf45
- Merge branch 'master' into translation · ac47d481
  Leo Gao authored Feb 13, 2021
  
  ac47d481
- Merge pull request #147 from jon-tow/headqa-refactor · 0601c909
  Leo Gao authored Feb 12, 2021
```
Refactor `HeadQA` as a `MultipleChoiceTask`
```
  0601c909
- Refactor `HeadQA` as a `MultipleChoiceTask` · 97174266
  Jonathan Tow authored Feb 13, 2021
  
  97174266
- Merge pull request #143 from EleutherAI/add_headqa_mathqa · d194d65c
  Leo Gao authored Feb 12, 2021
```
add headqa and mathqa datasets
```
  d194d65c
- Merge branch 'master' of github.com:EleutherAI/lm_evaluation_harness into add_headqa_mathqa · cc27e38a
  Leo Gao authored Feb 12, 2021
  
  cc27e38a
- Merge branch 'master' of github.com:EleutherAI/lm_evaluation_harness into translation · 404530d0
  Leo Gao authored Feb 12, 2021
  
  404530d0
- Update lambada data location · e5a9de80
  Leo Gao authored Feb 12, 2021
  
  e5a9de80
- small change to regex · b07ecab4
  Anthony DiPofi authored Feb 12, 2021
  
  b07ecab4
- change mathqa to use numeric answer strings instead of a,b,c,d,e as choices · 81e42932
  Anthony DiPofi authored Feb 12, 2021
  
  81e42932
12 Feb, 2021 9 commits
- Merge branch 'master' into translation · 97856354
  Leo Gao authored Feb 12, 2021
  
  97856354
- ... · e56381f4
  & authored Feb 12, 2021
  
  e56381f4
- adds missing task error · 1eb91d36
  & authored Feb 12, 2021
  
  1eb91d36
- Fixed metrics. Translation works · 61aa411b
  & authored Feb 12, 2021
  
  61aa411b
- add tasks to registry · 1297e342
  & authored Feb 12, 2021
  
  1297e342
- metrics · 12ba8426
  & authored Feb 12, 2021
  
  12ba8426
- refactor MathQA as MultipleChoiceTask, uses full words for Q. and A. · c6c67272
  Anthony DiPofi authored Feb 12, 2021
  
  c6c67272
- translation task draft 1. Not hooked up, no metrics · bd3fcce0
  & authored Feb 12, 2021
  
  bd3fcce0
- metrics file · 1fb90b91
  & authored Feb 12, 2021
  
  1fb90b91