Commits · 9f4682a33c330a8d1e53e6efdfd55bc4bfd0c39e · gaoqiong / lm-evaluation-harness

16 Aug, 2023 16 commits
- fixed typos · 9f4682a3
  lintangsutawika authored Aug 16, 2023
  
  9f4682a3
- reformat · 5a973941
  lintangsutawika authored Aug 16, 2023
  
  5a973941
- Merge branch 'big-refactor' into mgsm · 9e9327bc
  Lintang Sutawika authored Aug 16, 2023
  
  9e9327bc
- Merge pull request #786 from EleutherAI/fix-doc_to_target · 73912efb
  Lintang Sutawika authored Aug 16, 2023
```
[Refactor] fix doc_to_target processing
```
  73912efb
- raise SystemExit 0 · 13f84b83
  lintangsutawika authored Aug 16, 2023
  
  13f84b83
- changed raise variable · 2fcd4298
  lintangsutawika authored Aug 16, 2023
  
  2fcd4298
- Merge pull request #782 from EleutherAI/truthfulqa · e8825ef6
  Lintang Sutawika authored Aug 16, 2023
```
[Refactor] Truthfulqa
```
  e8825ef6
- Update utils.py · 5b4f175f
  Lintang Sutawika authored Aug 16, 2023
  
  5b4f175f
- Merge pull request #783 from EleutherAI/mctaco · d53a81b0
  Lintang Sutawika authored Aug 16, 2023
```
[Refactor] MC Taco
```
  d53a81b0
- reformat · 579c9db9
  lintangsutawika authored Aug 16, 2023
  
  579c9db9
- change process to not require googleapi library · 60007dcf
  lintangsutawika authored Aug 16, 2023
  
  60007dcf
- reformat · d6030e12
  lintangsutawika authored Aug 16, 2023
  
  d6030e12
- fix doc_to_target processing · db37024b
  lintangsutawika authored Aug 16, 2023
  
  db37024b
- add task variants · 83f95961
  lintangsutawika authored Aug 16, 2023
  
  83f95961
- fix doc_to_choice being called when target is digit · d99e6cf4
  lintangsutawika authored Aug 16, 2023
  
  d99e6cf4
- add mgsm yamls · 3e9c9a95
  lintangsutawika authored Aug 16, 2023
  
  3e9c9a95
15 Aug, 2023 19 commits
- add mgsm · 416a3ca1
  lintangsutawika authored Aug 15, 2023
  
  416a3ca1
- update readme docs · da8af971
  lintangsutawika authored Aug 15, 2023
  
  da8af971
- add mc taco · cfbc5a8a
  lintangsutawika authored Aug 15, 2023
  
  cfbc5a8a
- format · 135b41ce
  lintangsutawika authored Aug 15, 2023
  
  135b41ce
- edit readme · 0436b5d6
  lintangsutawika authored Aug 15, 2023
  
  0436b5d6
- add all truthfulqa tasks · b990b756
  lintangsutawika authored Aug 15, 2023
  
  b990b756
- Merge pull request #779 from EleutherAI/pawsx · 8eab2a58
  Lintang Sutawika authored Aug 15, 2023
```
[Refactor] Paws-X
```
  8eab2a58
- Merge pull request #758 from EleutherAI/add_triviaqa · 30aa9c33
  Lintang Sutawika authored Aug 15, 2023
```
[Refactor] Add triviaqa
```
  30aa9c33
- Update README.md · 4b0ab122
  Lintang Sutawika authored Aug 15, 2023
  
  4b0ab122
- Merge pull request #761 from EleutherAI/glue · 0629a8bf
  Lintang Sutawika authored Aug 15, 2023
```
[Refactor] Glue
```
  0629a8bf
- merge big-refactor · b78a0045
  lintangsutawika authored Aug 15, 2023
  
  b78a0045
- Merge pull request #759 from EleutherAI/xstorycloze · e85ca1a9
  Lintang Sutawika authored Aug 15, 2023
```
[Refactor] XStoryCloze
```
  e85ca1a9
- Update README.md · 55749b9b
  Lintang Sutawika authored Aug 15, 2023
  
  55749b9b
- Merge pull request #725 from aflah02/RealToxicityPrompts · a68a3092
  Lintang Sutawika authored Aug 15, 2023
```
[Refactor] Real Toxicity Prompts
```
  a68a3092
- minor formating · 3e636f5b
  lintangsutawika authored Aug 15, 2023
  
  3e636f5b
- Merge pull request #1 from EleutherAI/toxicity-test · 35a24652
  Aflah authored Aug 15, 2023
```
Toxicity test
```
  35a24652
- format readme · 4a9b3786
  lintangsutawika authored Aug 15, 2023
  
  4a9b3786
- update · 6c587ba9
  lintangsutawika authored Aug 15, 2023
  
  6c587ba9
- add paws-x · e9377f72
  lintangsutawika authored Aug 15, 2023
  
  e9377f72
14 Aug, 2023 5 commits
- Merge branch 'RealToxicityPrompts' into toxicity-test · 0021de21
  Lintang Sutawika authored Aug 15, 2023
  
  0021de21
- adjustments · 4c22a521
  lintangsutawika authored Aug 14, 2023
  
  4c22a521
- Merge branch 'big-refactor' of https://github.com/EleutherAI/lm-evaluation-harness into toxicity · c478e20a
  lintangsutawika authored Aug 14, 2023
  
  c478e20a
- reformat · 88511112
  lintangsutawika authored Aug 03, 2023
  
  88511112
- pull and modified input args to metric · 33273d6e
  lintangsutawika authored Aug 03, 2023
  
  33273d6e