Commits · ca821452e989c20df9e72f6143fc4604b04bfb36 · gaoqiong / lm-evaluation-harness

13 Jul, 2023 4 commits
- Merge branch 'big-refactor' into revamp-process · ca821452
  Lintang Sutawika authored Jul 13, 2023
  
  ca821452
- minor change · 9657b04c
  lintangsutawika authored Jul 13, 2023
  
  9657b04c
- update winogrande format · 5699c7ab
  lintangsutawika authored Jul 13, 2023
  
  5699c7ab
- process focuses on doc_to_text, doc_to_target, and doc_to_choice · b7449cd9
  lintangsutawika authored Jul 13, 2023
  
  b7449cd9
12 Jul, 2023 5 commits
- superglue add yamls · 5978dc4e
  lintangsutawika authored Jul 12, 2023
  
  5978dc4e
- Update README.md · 027efa00
  Hailey Schoelkopf authored Jul 12, 2023
  
  027efa00
- Merge pull request #660 from EleutherAI/unscramble+toxigen · 1610d548
  Hailey Schoelkopf authored Jul 12, 2023
```
[Refactor] Add Unscramble ; Toxigen ; Hendrycks_Ethics ; MathQA
```
  1610d548
- Merge branch 'big-refactor' into unscramble+toxigen · e0417b3b
  Hailey Schoelkopf authored Jul 12, 2023
  
  e0417b3b
- Update evaluator.py · 907c99c0
  Hailey Schoelkopf authored Jul 12, 2023
  
  907c99c0
11 Jul, 2023 12 commits
- updated yamls · 622bdda1
  lintangsutawika authored Jul 11, 2023
  
  622bdda1
- added doc_to_choice · 499a4468
  lintangsutawika authored Jul 11, 2023
  
  499a4468
- fixed arc · 31c52f55
  lintangsutawika authored Jul 11, 2023
  
  31c52f55
- add ast.literal_eval to doc_to_choice · 155160a1
  lintangsutawika authored Jul 11, 2023
  
  155160a1
- process multiple_output · c37ad6ec
  lintangsutawika authored Jul 11, 2023
  
  c37ad6ec
- multiple_output option for greedy_until · 4c363ef8
  lintangsutawika authored Jul 11, 2023
  
  4c363ef8
- added error message · f09f3ab8
  lintangsutawika authored Jul 11, 2023
  
  f09f3ab8
- typo · 4054ab84
  lintangsutawika authored Jul 11, 2023
  
  4054ab84
- modified yamls · fc5a114f
  lintangsutawika authored Jul 11, 2023
  
  fc5a114f
- update choice process · 9b20e2d0
  lintangsutawika authored Jul 11, 2023
  
  9b20e2d0
- process update to process doc_to_target variety · 656c310e
  lintangsutawika authored Jul 11, 2023
  
  656c310e
- updated winogrande · 3b50b941
  lintangsutawika authored Jul 11, 2023
  
  3b50b941
10 Jul, 2023 5 commits
- Merge pull request #659 from EleutherAI/headqa · 7d4e92fa
  Hailey Schoelkopf authored Jul 10, 2023
```
[Refactor] Add Headqa
```
  7d4e92fa
- Merge branch 'big-refactor' into headqa · 287f7efc
  Hailey Schoelkopf authored Jul 10, 2023
  
  287f7efc
- Testing for multiple inputs from doc_to_text · f33c6c9b
  Lintang Sutawika authored Jul 10, 2023
  
  f33c6c9b
- template aliase process update. · 552b09e0
  Lintang Sutawika authored Jul 10, 2023
  
  552b09e0
- Changes in winogrande yaml · 9383f49e
  Lintang Sutawika authored Jul 10, 2023
  
  9383f49e
09 Jul, 2023 3 commits
- post_init to test if multple_choice has doc_to_text return list or str · 49a116ee
  Lintang Sutawika authored Jul 09, 2023
  
  49a116ee
- multple_choice handles 2 cases · 003c2581
  Lintang Sutawika authored Jul 09, 2023
  
  003c2581
- use prediction and prediction index · 87d93e99
  Lintang Sutawika authored Jul 09, 2023
  
  87d93e99
08 Jul, 2023 1 commit
- Very rough draft and scribbles · 3aeb95b6
  Lintang Sutawika authored Jul 09, 2023
  
  3aeb95b6
07 Jul, 2023 3 commits
- add MWP tag to mathQA · 76bf11c5
  haileyschoelkopf authored Jul 07, 2023
  
  76bf11c5
- add mathqa · 255f4c6e
  haileyschoelkopf authored Jul 07, 2023
  
  255f4c6e
- Update README.md · 884ba785
  Hailey Schoelkopf authored Jul 07, 2023
  
  884ba785
06 Jul, 2023 7 commits
- add hendrycks ethics · aa60d2b6
  haileyschoelkopf authored Jul 06, 2023
  
  aa60d2b6
- revert change to template_aliases · 6fc2e148
  haileyschoelkopf authored Jul 06, 2023
  
  6fc2e148
- Merge pull request #661 from fattorib/race-update-hf · 71305a78
  Hailey Schoelkopf authored Jul 06, 2023
```
[Refactor] Move race dataset on HF to EleutherAI group
```
  71305a78
- move race on HF to EleutherAI group · 31250b07
  ben authored Jul 06, 2023
  
  31250b07
- Update task statuses · fdcdc494
  Hailey Schoelkopf authored Jul 06, 2023
  
  fdcdc494
- Merge pull request #657 from EleutherAI/Processing-`generation_kwargs` · 94c465fd
  Hailey Schoelkopf authored Jul 06, 2023
```
Update `generation_kwargs`
```
  94c465fd
- Merge pull request #651 from farzanehnakhaee70/add-qa4mre-config · 557e6779
  Hailey Schoelkopf authored Jul 06, 2023
```
[refactor] Add qa4mre config
```
  557e6779