Commits · c32a13e8deeb08accd2c28a2fd2d9478ec622a7d · gaoqiong / lm-evaluation-harness

02 Feb, 2021 1 commit
- Implement `WSC273` evaluation and data processing · c32a13e8
  Jonathan Tow authored Feb 02, 2021
  
  c32a13e8
01 Feb, 2021 13 commits
- Add badges · 826d90e2
  Leo Gao authored Feb 01, 2021
  
  826d90e2
- Fix coverage again again again again again · 5b6182d5
  Leo Gao authored Feb 01, 2021
  
  5b6182d5
- Fix coverage again again again again · 2d6102c4
  Leo Gao authored Feb 01, 2021
  
  2d6102c4
- Fix coverage again again again · 2708ae4c
  Leo Gao authored Feb 01, 2021
  
  2708ae4c
- Add unit tests · a3a2152c
  Leo Gao authored Feb 01, 2021
  
  a3a2152c
- Fix coverage again again · 8bd843c0
  Leo Gao authored Feb 01, 2021
  
  8bd843c0
- Fix coverage again · b7da653c
  Leo Gao authored Feb 01, 2021
  
  b7da653c
- Fix pytest path · 1033bab6
  Leo Gao authored Feb 01, 2021
  
  1033bab6
- Upload to codecov · 12067538
  Leo Gao authored Feb 01, 2021
  
  12067538
- Make linter happy · 31863cde
  Leo Gao authored Feb 01, 2021
  
  31863cde
- Fix linting problems · fe4a1efd
  Leo Gao authored Feb 01, 2021
  
  fe4a1efd
- Merge pull request #110 from EleutherAI/leogao2-patch-2 · 7ab3f8ca
  Stella Biderman authored Feb 01, 2021
```
Add CI pipeline
```
  7ab3f8ca
- Add CI pipeline · 8dd1983b
  Leo Gao authored Feb 01, 2021
  
  8dd1983b
30 Jan, 2021 10 commits
- Merge pull request #106 from jon-tow/anli-evaluation · 6598967b
  Leo Gao authored Jan 30, 2021
```
Implement `ANLI` evaluations
```
  6598967b
- Merge pull request #108 from EleutherAI/leogao2-patch-2 · ec45d0aa
  Stella Biderman authored Jan 30, 2021
```
Make *_docs not abstract
```
  ec45d0aa
- Merge pull request #107 from EleutherAI/triviaqa_evaluation · 66558b35
  Leo Gao authored Jan 30, 2021
```
add evaluation for TriviaQA dataset based on loglikelihood method
```
  66558b35
- Merge branch 'master' into triviaqa_evaluation · c8032a1a
  Leo Gao authored Jan 30, 2021
  
  c8032a1a
- Handle aliases correctly in TriviaQA · b2b5a122
  Leo Gao authored Jan 30, 2021
  
  b2b5a122
- Merge pull request #104 from jon-tow/race-evaluation · 0f30237a
  Leo Gao authored Jan 30, 2021
```
Implement `RACE` evaluation
```
  0f30237a
- Make *_docs not abstract · 1bf97c9e
  Leo Gao authored Jan 30, 2021
  
  1bf97c9e
- add evaluation for TriviaQA dataset based on loglikelihood · 0601d0bb
  Anthony DiPofi authored Jan 30, 2021
  
  0601d0bb
- Merge pull request #105 from jon-tow/dependency-updates · e48b6082
  Leo Gao authored Jan 30, 2021
```
Update dependencies
```
  e48b6082
- Implement `ANLI` evaluations · 0a53c06e
  Jonathan Tow authored Jan 30, 2021
  
  0a53c06e
29 Jan, 2021 12 commits
- Merge branch 'master' into race-evaluation · 48358352
  Jonathan Tow authored Jan 29, 2021
  
  48358352
- Fix versioning · 33ab4a29
  Jon Tow authored Jan 29, 2021
  
  33ab4a29
- Update dependencies · f37dcab6
  Jon Tow authored Jan 29, 2021
  
  f37dcab6
- Implement `RACE` evaluation · 6e1a76f0
  Jon Tow authored Jan 29, 2021
  
  6e1a76f0
- Merge pull request #99 from jon-tow/hellaswag-evaluation · 0f536808
  Stella Biderman authored Jan 29, 2021
```
Add `HellaSwag` evaluation implementation
```
  0f536808
- Merge pull request #103 from EleutherAI/piqa · 2d61b3ce
  Stella Biderman authored Jan 29, 2021
```
Implement PiQA
```
  2d61b3ce
- Implement PiQA · 63854c10
  Leo Gao authored Jan 29, 2021
  
  63854c10
- Remove brackets from documents · 97b88570
  Jonathan Tow authored Jan 29, 2021
  
  97b88570
- Merge pull request #101 from EleutherAI/lambada · a2f5b74b
  Stella Biderman authored Jan 29, 2021
```
Implement LAMBADA (#6)
```
  a2f5b74b
- Implement LAMBADA · 822fcc6f
  Leo Gao authored Jan 28, 2021
  
  822fcc6f
- Revert "Update `doc_to_text` to show candidate fill-ins" · da016758
  Jonathan Tow authored Jan 29, 2021
```
This reverts commit 5d431ba9.
```
  da016758
- Update `doc_to_text` to show candidate fill-ins · 5d431ba9
  Jon Tow authored Jan 28, 2021
  
  5d431ba9
28 Jan, 2021 4 commits
- Add `HellaSwag` evaluation implementation · 65c46d22
  Jon Tow authored Jan 28, 2021
  
  65c46d22
- Merge pull request #98 from zphang/wsc · 7031c324
  Leo Gao authored Jan 28, 2021
```
SGWinogradSchemaChallenge
```
  7031c324
- Add space before target · 21d527d4
  Leo Gao authored Jan 28, 2021
  
  21d527d4
- wsc · 63e32f9c
  Jason Phang authored Jan 28, 2021
  
  63e32f9c