Commits · 4a294d8afb4520ded2a340a11c4808fc5caf926f · gaoqiong / lm-evaluation-harness

25 Oct, 2020 1 commit
- Merge pull request #3 from EleutherAI/master · 4a294d8a
  Charles Foster authored Oct 25, 2020
```
Sync up to EAI
```
  4a294d8a
24 Oct, 2020 29 commits
- Merge pull request #56 from anishthite/master · 946cb2bc
  Stella Biderman authored Oct 24, 2020
```
add rte text
```
  946cb2bc
- update lambada for new dataset class · 8e4ff678
  Anish Thite authored Oct 24, 2020
  
  8e4ff678
- add rte text · d4daf44c
  Anish Thite authored Oct 24, 2020
  
  d4daf44c
- Merge pull request #52 from cfoster0/natural_questions · dcadfa7c
  Stella Biderman authored Oct 24, 2020
```
Add Natural Questions
```
  dcadfa7c
- Merge pull request #55 from anishthite/master · 9eec7ce8
  Stella Biderman authored Oct 24, 2020
```
Add piqa and implement include_target for triviqa, storycloze, coqa
```
  9eec7ce8
- add no target for triviaqa · 171f2924
  Anish Thite authored Oct 24, 2020
  
  171f2924
- add no target for storycloze · c9f3b113
  Anish Thite authored Oct 24, 2020
  
  c9f3b113
- add include target for coqa · e3c2e692
  Anish Thite authored Oct 24, 2020
  
  e3c2e692
- add piqa text · 7c55e46b
  Anish Thite authored Oct 24, 2020
  
  7c55e46b
- Merge pull request #54 from zphang/mnli_mismatched · 3c480b61
  Stella Biderman authored Oct 24, 2020
```
Adding mnli_mismatched
```
  3c480b61
- Merge pull request #53 from anishthite/master · b278e42d
  Stella Biderman authored Oct 24, 2020
```
Update drop to be consistent with gpt3 paper
```
  b278e42d
- Fixes to natural questions. · c013679d
  Charles Foster authored Oct 24, 2020
  
  c013679d
- Updates to natural questions answer handling. Now uses long answers alwasy. · dc3560d0
  Charles Foster authored Oct 24, 2020
  
  dc3560d0
- Small typos · d51f3e7f
  Charles Foster authored Oct 24, 2020
  
  d51f3e7f
- Updates to natural questions to deal with memory issues. · 9291edaa
  Charles Foster authored Oct 24, 2020
  
  9291edaa
- Removed apache_beam dependency. · 0dda9f63
  Charles Foster authored Oct 24, 2020
  
  0dda9f63
- add storycloze · 042e2926
  Anish Thite authored Oct 24, 2020
  
  042e2926
- mnli_mismatched · 25131aa7
  Jason Phang authored Oct 24, 2020
  
  25131aa7
- update triviaqa download · 0f2b9317
  Anish Thite authored Oct 24, 2020
  
  0f2b9317
- add triviaqa data · 8bfaaa50
  Anish Thite authored Oct 24, 2020
  
  8bfaaa50
- update coqa dev set · 97e5a566
  Anish Thite authored Oct 24, 2020
  
  97e5a566
- update coqa dev set · db3fe0d6
  Anish Thite authored Oct 24, 2020
  
  db3fe0d6
- update coqa to be consistent with gpt3 paper · 5d601e14
  Anish Thite authored Oct 24, 2020
  
  5d601e14
- Merge branch 'master' of https://github.com/EleutherAI/lm_evaluation_harness · 01608cf4
  Anish Thite authored Oct 24, 2020
  
  01608cf4
- make drop text consistent with gpt3 paper · 43fc77a2
  Anish Thite authored Oct 24, 2020
  
  43fc77a2
- Added natural questions. Not yet validated or tested with a call to write. · 9426db16
  Charles Foster authored Oct 23, 2020
  
  9426db16
- Merge pull request #51 from anishthite/master · 00abc99a
  Stella Biderman authored Oct 23, 2020
```
add Wikitext2 + wikitext103 data
```
  00abc99a
- Merge pull request #50 from cfoster0/winograd · b0db32bc
  Stella Biderman authored Oct 23, 2020
```
Winograd changes
```
  b0db32bc
- add Wikitext2 + wikitext103 data · 262fe250
  Anish Thite authored Oct 23, 2020
  
  262fe250
23 Oct, 2020 10 commits
- Renamed WSC to make distinction between SuperGLUE Winograd Schemas... · 05bd05e9
  Charles Foster authored Oct 23, 2020
```
Renamed WSC to make distinction between SuperGLUE Winograd Schemas (SGWinogradSchemaChallenge) and WSC273 (WinogradSchemaChallenge273) clearer. Also, added WSC273.
```
  05bd05e9
- Merge pull request #2 from EleutherAI/master · ca24b52f
  Charles Foster authored Oct 23, 2020
```
Bring up to speed with Eleuther
```
  ca24b52f
- Merge pull request #1 from EleutherAI/master · 302ca3d6
  Charles Foster authored Oct 22, 2020
```
Bringing up to date with Eleuther repo.
```
  302ca3d6
- Update README.md · b8a3edaf
  Stella Biderman authored Oct 23, 2020
  
  b8a3edaf
- Update README.md · 8cb71ef7
  Stella Biderman authored Oct 23, 2020
  
  8cb71ef7
- Update README.md · a78996bc
  Stella Biderman authored Oct 23, 2020
  
  a78996bc
- Merge pull request #45 from cfoster0/winogrande · eb9a5224
  Stella Biderman authored Oct 23, 2020
```
Add Winogrande dataset
```
  eb9a5224
- Merge branch 'master' into winogrande · 0e0e37f4
  Stella Biderman authored Oct 23, 2020
  
  0e0e37f4
- Merge pull request #48 from cfoster0/quac · 80f5fc3b
  Stella Biderman authored Oct 23, 2020
```
Add QuAC dataset
```
  80f5fc3b
- Merge branch 'master' into quac · a543cc5d
  Stella Biderman authored Oct 23, 2020
  
  a543cc5d