Commits · 758b9e3c0f024284c2880bfc51cdc2b7e38216b2 · gaoqiong / lm-evaluation-harness

14 Feb, 2021 5 commits
- Merge pull request #152 from zphang/record_fix · 758b9e3c
  Leo Gao authored Feb 14, 2021
```
ReCoRD Update
```
  758b9e3c
- update · 81ab3416
  Jason Phang authored Feb 13, 2021
  
  81ab3416
- ReCoRD fixup · 2cfdd80a
  Jason Phang authored Feb 13, 2021
  
  2cfdd80a
- Merge pull request #150 from zphang/record_update · 41eb4a65
  Leo Gao authored Feb 13, 2021
```
ReCoRD fix
```
  41eb4a65
- tweak doc format · 2719a522
  Jason Phang authored Feb 13, 2021
  
  2719a522
13 Feb, 2021 13 commits
- ReCoRD fix · e4e9228e
  Jason Phang authored Feb 13, 2021
  
  e4e9228e
- Merge pull request #145 from EleutherAI/decontamination · 487b5313
  Leo Gao authored Feb 13, 2021
```
Train set decontamination 
```
  487b5313
- Merge branch 'master' into decontamination · 4d90dc8a
  Leo Gao authored Feb 13, 2021
  
  4d90dc8a
- Merge pull request #146 from EleutherAI/translation · 7ad6bf45
  Leo Gao authored Feb 13, 2021
```
Translation
```
  7ad6bf45
- Merge branch 'master' into translation · ac47d481
  Leo Gao authored Feb 13, 2021
  
  ac47d481
- Merge pull request #147 from jon-tow/headqa-refactor · 0601c909
  Leo Gao authored Feb 12, 2021
```
Refactor `HeadQA` as a `MultipleChoiceTask`
```
  0601c909
- Refactor `HeadQA` as a `MultipleChoiceTask` · 97174266
  Jonathan Tow authored Feb 13, 2021
  
  97174266
- Merge pull request #143 from EleutherAI/add_headqa_mathqa · d194d65c
  Leo Gao authored Feb 12, 2021
```
add headqa and mathqa datasets
```
  d194d65c
- Merge branch 'master' of github.com:EleutherAI/lm_evaluation_harness into add_headqa_mathqa · cc27e38a
  Leo Gao authored Feb 12, 2021
  
  cc27e38a
- Merge branch 'master' of github.com:EleutherAI/lm_evaluation_harness into translation · 404530d0
  Leo Gao authored Feb 12, 2021
  
  404530d0
- Update lambada data location · e5a9de80
  Leo Gao authored Feb 12, 2021
  
  e5a9de80
- small change to regex · b07ecab4
  Anthony DiPofi authored Feb 12, 2021
  
  b07ecab4
- change mathqa to use numeric answer strings instead of a,b,c,d,e as choices · 81e42932
  Anthony DiPofi authored Feb 12, 2021
  
  81e42932
12 Feb, 2021 13 commits
- Merge branch 'master' into translation · 97856354
  Leo Gao authored Feb 12, 2021
  
  97856354
- ... · e56381f4
  & authored Feb 12, 2021
  
  e56381f4
- adds missing task error · 1eb91d36
  & authored Feb 12, 2021
  
  1eb91d36
- Fixed metrics. Translation works · 61aa411b
  & authored Feb 12, 2021
  
  61aa411b
- add tasks to registry · 1297e342
  & authored Feb 12, 2021
  
  1297e342
- metrics · 12ba8426
  & authored Feb 12, 2021
  
  12ba8426
- refactor MathQA as MultipleChoiceTask, uses full words for Q. and A. · c6c67272
  Anthony DiPofi authored Feb 12, 2021
  
  c6c67272
- translation task draft 1. Not hooked up, no metrics · bd3fcce0
  & authored Feb 12, 2021
  
  bd3fcce0
- metrics file · 1fb90b91
  & authored Feb 12, 2021
  
  1fb90b91
- Merge pull request #144 from jon-tow/arc-refactor · e26dc4d3
  Leo Gao authored Feb 11, 2021
```
Refactor `ARC` as a `MultipleChoiceTask`
```
  e26dc4d3
- Refactor `ARC` as a `MultipleChoiceTask` · 24ac76df
  Jon Tow authored Feb 11, 2021
  
  24ac76df
- add headqa and mathqa datasets · 742b5df2
  Anthony DiPofi authored Feb 11, 2021
  
  742b5df2
- Moving over training data decontamination code · 4de29dca
  & authored Feb 11, 2021
  
  4de29dca
11 Feb, 2021 5 commits
- Merge branch 'master' of github.com:EleutherAI/lm_evaluation_harness · f7992789
  Leo Gao authored Feb 10, 2021
  
  f7992789
- Fixes to make greedy_until work · 432bd44c
  Leo Gao authored Feb 10, 2021
```
# Conflicts:
#	lm_eval/models/gpt2.py
#	lm_eval/tasks/squad.py
```
  432bd44c
- Merge pull request #142 from jon-tow/hellaswag-refactor · f63bc658
  Leo Gao authored Feb 10, 2021
```
Refactor `HellaSwag` as a `MultipleChoiceTask`
```
  f63bc658
- Implement GPT2 greedy_until · e8f9dc71
  Leo Gao authored Feb 10, 2021
  
  e8f9dc71
- Remove test set from `HellaSwag` · a2b108b9
  Jon Tow authored Feb 10, 2021
  
  a2b108b9
10 Feb, 2021 4 commits
- Refactor `HellaSwag` as a `MultipleChoiceTask` · 43ffe351
  Jon Tow authored Feb 10, 2021
  
  43ffe351
- Merge pull request #141 from jon-tow/winograd-fixes2 · 9adf18b1
  Leo Gao authored Feb 10, 2021
```
Fix context orderings in `Winograds` to match label positioning
```
  9adf18b1
- Rename list of loglikelihoods for consistency · 155aeee9
  Jon Tow authored Feb 10, 2021
  
  155aeee9
- Fix context orderings to match label positioning · 43e274f8
  Jon Tow authored Feb 10, 2021
  
  43e274f8