Commits · e3077dcf4b0008c84dcc6b1b45cdb30dead4b4ff · gaoqiong / lm-evaluation-harness

15 Aug, 2023 17 commits
- Merge branch 'big-refactor' into wmt · e3077dcf
  Hailey Schoelkopf authored Aug 15, 2023
  
  e3077dcf
- Merge pull request #779 from EleutherAI/pawsx · 8eab2a58
  Lintang Sutawika authored Aug 15, 2023
```
[Refactor] Paws-X
```
  8eab2a58
- rename var · 21aa92d2
  haileyschoelkopf authored Aug 15, 2023
  
  21aa92d2
- add translation tasks · 40f81c42
  haileyschoelkopf authored Aug 15, 2023
  
  40f81c42
- make pycountry optional dep · 39bd5caf
  haileyschoelkopf authored Aug 15, 2023
  
  39bd5caf
- Merge pull request #758 from EleutherAI/add_triviaqa · 30aa9c33
  Lintang Sutawika authored Aug 15, 2023
```
[Refactor] Add triviaqa
```
  30aa9c33
- Update README.md · 4b0ab122
  Lintang Sutawika authored Aug 15, 2023
  
  4b0ab122
- Merge pull request #761 from EleutherAI/glue · 0629a8bf
  Lintang Sutawika authored Aug 15, 2023
```
[Refactor] Glue
```
  0629a8bf
- merge big-refactor · b78a0045
  lintangsutawika authored Aug 15, 2023
  
  b78a0045
- Merge pull request #759 from EleutherAI/xstorycloze · e85ca1a9
  Lintang Sutawika authored Aug 15, 2023
```
[Refactor] XStoryCloze
```
  e85ca1a9
- Update README.md · 55749b9b
  Lintang Sutawika authored Aug 15, 2023
  
  55749b9b
- Merge pull request #725 from aflah02/RealToxicityPrompts · a68a3092
  Lintang Sutawika authored Aug 15, 2023
```
[Refactor] Real Toxicity Prompts
```
  a68a3092
- minor formating · 3e636f5b
  lintangsutawika authored Aug 15, 2023
  
  3e636f5b
- Merge pull request #1 from EleutherAI/toxicity-test · 35a24652
  Aflah authored Aug 15, 2023
```
Toxicity test
```
  35a24652
- format readme · 4a9b3786
  lintangsutawika authored Aug 15, 2023
  
  4a9b3786
- update · 6c587ba9
  lintangsutawika authored Aug 15, 2023
  
  6c587ba9
- add paws-x · e9377f72
  lintangsutawika authored Aug 15, 2023
  
  e9377f72
14 Aug, 2023 23 commits
- Merge branch 'big-refactor' into wmt · adde09b3
  haileyschoelkopf authored Aug 14, 2023
  
  adde09b3
- Merge branch 'RealToxicityPrompts' into toxicity-test · 0021de21
  Lintang Sutawika authored Aug 15, 2023
  
  0021de21
- adjustments · 4c22a521
  lintangsutawika authored Aug 14, 2023
  
  4c22a521
- Merge branch 'big-refactor' of https://github.com/EleutherAI/lm-evaluation-harness into toxicity · c478e20a
  lintangsutawika authored Aug 14, 2023
  
  c478e20a
- reformat · 88511112
  lintangsutawika authored Aug 03, 2023
  
  88511112
- pull and modified input args to metric · 33273d6e
  lintangsutawika authored Aug 03, 2023
  
  33273d6e
- Removed Implementation from metrics.py · 60763408
  Aflah authored Aug 03, 2023
  
  60763408
- Delete realtoxicityprompts_yaml · bdc23326
  Aflah authored Aug 03, 2023
  
  bdc23326
- Addressed Review Comments · ce7eb7b6
  Aflah authored Aug 03, 2023
  
  ce7eb7b6
- Fixed Wrong File Push · 67bbc5b4
  Aflah authored Aug 03, 2023
  
  67bbc5b4
- Improved DocString · 57bcb4d6
  Aflah authored Aug 02, 2023
  
  57bcb4d6
- CMD Line Works · b221531a
  Aflah authored Aug 02, 2023
  
  b221531a
- Added Metric and Seems to Run but some Errors · d857e539
  Aflah authored Aug 02, 2023
  
  d857e539
- Base Template · 94ccc429
  Aflah authored Aug 02, 2023
  
  94ccc429
- Merge pull request #747 from EleutherAI/haileyschoelkopf-patch-2 · 64c76fc3
  Lintang Sutawika authored Aug 14, 2023
```
[WIP] Update API docs in README
```
  64c76fc3
- Added info on `lm-eval` command. · 725d7e3e
  Lintang Sutawika authored Aug 14, 2023
  
  725d7e3e
- Merge pull request #777 from EleutherAI/benchmark · be79a281
  Lintang Sutawika authored Aug 14, 2023
```
[Refactor] Update Benchmark
```
  be79a281
- Update default.yaml · 416b198e
  Lintang Sutawika authored Aug 14, 2023
  
  416b198e
- Merge pull request #776 from EleutherAI/xnli · f918c8fd
  Lintang Sutawika authored Aug 14, 2023
```
[Refactor] XNLI
```
  f918c8fd
- Update with task list. · 1768f118
  Lintang Sutawika authored Aug 14, 2023
  
  1768f118
- adjustments to have `task` to modify a task name in benchmark · 3de2c0e7
  lintangsutawika authored Aug 14, 2023
  
  3de2c0e7
- explain how to use benchmarks · cccb294f
  lintangsutawika authored Aug 14, 2023
  
  cccb294f
- return fewshot_delimiter if we get "" · 7758d16a
  lintangsutawika authored Aug 14, 2023
  
  7758d16a