Commits · b78a0045e0cf35bf6a2d7f5facd72a1556220eb9 · gaoqiong / lm-evaluation-harness

15 Aug, 2023 5 commits
- merge big-refactor · b78a0045
  lintangsutawika authored Aug 15, 2023
  
  b78a0045
- Merge pull request #759 from EleutherAI/xstorycloze · e85ca1a9
  Lintang Sutawika authored Aug 15, 2023
```
[Refactor] XStoryCloze
```
  e85ca1a9
- Merge pull request #725 from aflah02/RealToxicityPrompts · a68a3092
  Lintang Sutawika authored Aug 15, 2023
```
[Refactor] Real Toxicity Prompts
```
  a68a3092
- minor formating · 3e636f5b
  lintangsutawika authored Aug 15, 2023
  
  3e636f5b
- Merge pull request #1 from EleutherAI/toxicity-test · 35a24652
  Aflah authored Aug 15, 2023
```
Toxicity test
```
  35a24652
14 Aug, 2023 24 commits
- Merge branch 'RealToxicityPrompts' into toxicity-test · 0021de21
  Lintang Sutawika authored Aug 15, 2023
  
  0021de21
- adjustments · 4c22a521
  lintangsutawika authored Aug 14, 2023
  
  4c22a521
- Merge branch 'big-refactor' of https://github.com/EleutherAI/lm-evaluation-harness into toxicity · c478e20a
  lintangsutawika authored Aug 14, 2023
  
  c478e20a
- reformat · 88511112
  lintangsutawika authored Aug 03, 2023
  
  88511112
- pull and modified input args to metric · 33273d6e
  lintangsutawika authored Aug 03, 2023
  
  33273d6e
- Removed Implementation from metrics.py · 60763408
  Aflah authored Aug 03, 2023
  
  60763408
- Delete realtoxicityprompts_yaml · bdc23326
  Aflah authored Aug 03, 2023
  
  bdc23326
- Addressed Review Comments · ce7eb7b6
  Aflah authored Aug 03, 2023
  
  ce7eb7b6
- Fixed Wrong File Push · 67bbc5b4
  Aflah authored Aug 03, 2023
  
  67bbc5b4
- Improved DocString · 57bcb4d6
  Aflah authored Aug 02, 2023
  
  57bcb4d6
- CMD Line Works · b221531a
  Aflah authored Aug 02, 2023
  
  b221531a
- Added Metric and Seems to Run but some Errors · d857e539
  Aflah authored Aug 02, 2023
  
  d857e539
- Base Template · 94ccc429
  Aflah authored Aug 02, 2023
  
  94ccc429
- Merge pull request #747 from EleutherAI/haileyschoelkopf-patch-2 · 64c76fc3
  Lintang Sutawika authored Aug 14, 2023
```
[WIP] Update API docs in README
```
  64c76fc3
- Added info on `lm-eval` command. · 725d7e3e
  Lintang Sutawika authored Aug 14, 2023
  
  725d7e3e
- Merge pull request #777 from EleutherAI/benchmark · be79a281
  Lintang Sutawika authored Aug 14, 2023
```
[Refactor] Update Benchmark
```
  be79a281
- Merge pull request #776 from EleutherAI/xnli · f918c8fd
  Lintang Sutawika authored Aug 14, 2023
```
[Refactor] XNLI
```
  f918c8fd
- Update with task list. · 1768f118
  Lintang Sutawika authored Aug 14, 2023
  
  1768f118
- adjustments to have `task` to modify a task name in benchmark · 3de2c0e7
  lintangsutawika authored Aug 14, 2023
  
  3de2c0e7
- explain how to use benchmarks · cccb294f
  lintangsutawika authored Aug 14, 2023
  
  cccb294f
- return fewshot_delimiter if we get "" · 7758d16a
  lintangsutawika authored Aug 14, 2023
  
  7758d16a
- add warning log if prompt returns empty string · 1701c4e2
  lintangsutawika authored Aug 14, 2023
  
  1701c4e2
- add warning log if prompt returns empty string · 722b8974
  lintangsutawika authored Aug 14, 2023
  
  722b8974
- add warning log if prompt returns empty string · bc951ac1
  lintangsutawika authored Aug 14, 2023
  
  bc951ac1
13 Aug, 2023 11 commits
- formate · ce8c2b14
  lintangsutawika authored Aug 13, 2023
  
  ce8c2b14
- update and fixes · 5ddabc29
  lintangsutawika authored Aug 13, 2023
  
  5ddabc29
- reformat · c523063d
  lintangsutawika authored Aug 13, 2023
  
  c523063d
- check readme · 81a6cbfa
  lintangsutawika authored Aug 13, 2023
  
  81a6cbfa
- xnli reformat · 2d54f2c9
  lintangsutawika authored Aug 13, 2023
  
  2d54f2c9
- xnli reformat · ac98d9e1
  lintangsutawika authored Aug 13, 2023
  
  ac98d9e1
- Merge pull request #766 from EleutherAI/patch-crowspairs · 054ed37f
  Hailey Schoelkopf authored Aug 13, 2023
```
[Refactor] Patch crowspairs higher_is_better
```
  054ed37f
- Merge pull request #774 from EleutherAI/speedup-hellaswag · 4f27f0b9
  Hailey Schoelkopf authored Aug 13, 2023
```
[Refactor] Speedup hellaswag context building
```
  4f27f0b9
- update in task guide · db0c46b0
  lintangsutawika authored Aug 13, 2023
  
  db0c46b0
- uncommented tasks · 22ece14a
  lintangsutawika authored Aug 13, 2023
  
  22ece14a
- moved to a new dir · f4813cfc
  lintangsutawika authored Aug 13, 2023
  
  f4813cfc