Commits · 8e4ff678193ba620a73e0d5c06915cebe219921d · gaoqiong / lm-evaluation-harness

24 Oct, 2020 17 commits
- update lambada for new dataset class · 8e4ff678
  Anish Thite authored Oct 24, 2020
  
  8e4ff678
- add rte text · d4daf44c
  Anish Thite authored Oct 24, 2020
  
  d4daf44c
- add no target for triviaqa · 171f2924
  Anish Thite authored Oct 24, 2020
  
  171f2924
- add no target for storycloze · c9f3b113
  Anish Thite authored Oct 24, 2020
  
  c9f3b113
- add include target for coqa · e3c2e692
  Anish Thite authored Oct 24, 2020
  
  e3c2e692
- add piqa text · 7c55e46b
  Anish Thite authored Oct 24, 2020
  
  7c55e46b
- add storycloze · 042e2926
  Anish Thite authored Oct 24, 2020
  
  042e2926
- update triviaqa download · 0f2b9317
  Anish Thite authored Oct 24, 2020
  
  0f2b9317
- add triviaqa data · 8bfaaa50
  Anish Thite authored Oct 24, 2020
  
  8bfaaa50
- update coqa dev set · 97e5a566
  Anish Thite authored Oct 24, 2020
  
  97e5a566
- update coqa dev set · db3fe0d6
  Anish Thite authored Oct 24, 2020
  
  db3fe0d6
- update coqa to be consistent with gpt3 paper · 5d601e14
  Anish Thite authored Oct 24, 2020
  
  5d601e14
- Merge branch 'master' of https://github.com/EleutherAI/lm_evaluation_harness · 01608cf4
  Anish Thite authored Oct 24, 2020
  
  01608cf4
- make drop text consistent with gpt3 paper · 43fc77a2
  Anish Thite authored Oct 24, 2020
  
  43fc77a2
- Merge pull request #51 from anishthite/master · 00abc99a
  Stella Biderman authored Oct 23, 2020
```
add Wikitext2 + wikitext103 data
```
  00abc99a
- Merge pull request #50 from cfoster0/winograd · b0db32bc
  Stella Biderman authored Oct 23, 2020
```
Winograd changes
```
  b0db32bc
- add Wikitext2 + wikitext103 data · 262fe250
  Anish Thite authored Oct 23, 2020
  
  262fe250
23 Oct, 2020 14 commits
- Renamed WSC to make distinction between SuperGLUE Winograd Schemas... · 05bd05e9
  Charles Foster authored Oct 23, 2020
```
Renamed WSC to make distinction between SuperGLUE Winograd Schemas (SGWinogradSchemaChallenge) and WSC273 (WinogradSchemaChallenge273) clearer. Also, added WSC273.
```
  05bd05e9
- Merge pull request #2 from EleutherAI/master · ca24b52f
  Charles Foster authored Oct 23, 2020
```
Bring up to speed with Eleuther
```
  ca24b52f
- Update README.md · b8a3edaf
  Stella Biderman authored Oct 23, 2020
  
  b8a3edaf
- Update README.md · 8cb71ef7
  Stella Biderman authored Oct 23, 2020
  
  8cb71ef7
- Update README.md · a78996bc
  Stella Biderman authored Oct 23, 2020
  
  a78996bc
- Merge pull request #45 from cfoster0/winogrande · eb9a5224
  Stella Biderman authored Oct 23, 2020
```
Add Winogrande dataset
```
  eb9a5224
- Merge branch 'master' into winogrande · 0e0e37f4
  Stella Biderman authored Oct 23, 2020
  
  0e0e37f4
- Merge pull request #48 from cfoster0/quac · 80f5fc3b
  Stella Biderman authored Oct 23, 2020
```
Add QuAC dataset
```
  80f5fc3b
- Merge branch 'master' into quac · a543cc5d
  Stella Biderman authored Oct 23, 2020
  
  a543cc5d
- Merge pull request #43 from cfoster0/hellaswag · 2b64cae6
  Stella Biderman authored Oct 23, 2020
```
Add HellaSwag dataset
```
  2b64cae6
- Merge branch 'master' into hellaswag · b14f3d1d
  Stella Biderman authored Oct 23, 2020
  
  b14f3d1d
- Merge pull request #42 from cfoster0/openbookqa · bbc29a93
  Stella Biderman authored Oct 23, 2020
```
Add OpenBookQA dataset
```
  bbc29a93
- Merge branch 'master' into openbookqa · efc4310c
  Stella Biderman authored Oct 23, 2020
  
  efc4310c
- Merge branch 'master' into quac · 9017bb36
  Charles Foster authored Oct 22, 2020
  
  9017bb36
22 Oct, 2020 9 commits
- Merge pull request #41 from zphang/copa_update · 2338188f
  Stella Biderman authored Oct 22, 2020
```
Update COPA cause/effect
```
  2338188f
- Merge pull request #46 from cfoster0/nlp_name_fix · 3d5d794a
  Stella Biderman authored Oct 22, 2020
```
Updated RACE to use datasets instead of nlp package.
```
  3d5d794a
- Merge pull request #47 from cfoster0/squad · c7e7a050
  Stella Biderman authored Oct 22, 2020
```
Add SQuAD v2 dataset
```
  c7e7a050
- Added QuAC dataset. · 40cc4e28
  Charles Foster authored Oct 22, 2020
  
  40cc4e28
- Clarified that SQuaD does not include a test set. · 76b08133
  Charles Foster authored Oct 21, 2020
  
  76b08133
- Added SQuAD v2 dataset · 5c58b267
  Charles Foster authored Oct 21, 2020
  
  5c58b267
- Updated RACE to use datasets instead of nlp package. · b106e4f7
  Charles Foster authored Oct 21, 2020
  
  b106e4f7
- Add Winogrande dataset. · dbe43ec3
  Charles Foster authored Oct 21, 2020
  
  dbe43ec3
- Add HellaSwag dataset. · a245d2e4
  Charles Foster authored Oct 21, 2020
  
  a245d2e4