Commits · 248b45dace4eae0d521315e2fbcfcebf278f778a · gaoqiong / lm-evaluation-harness

14 Jul, 2023 5 commits
- config fixes · 248b45da
  lintangsutawika authored Jul 14, 2023
  
  248b45da
- adjustments · 70e3ed25
  lintangsutawika authored Jul 14, 2023
  
  70e3ed25
- Merge branch 'big-refactor' of... · 457c4262
  lintangsutawika authored Jul 14, 2023
```
Merge branch 'big-refactor' of https://github.com/EleutherAI/lm-evaluation-harness into revamp-process
```
  457c4262
- fixes to boolq · f4efb8e5
  lintangsutawika authored Jul 14, 2023
  
  f4efb8e5
- fixes to bollq · ae41f67c
  lintangsutawika authored Jul 14, 2023
  
  ae41f67c
13 Jul, 2023 19 commits
- Update README.md · 98c85d73
  Hailey Schoelkopf authored Jul 13, 2023
  
  98c85d73
- doc_to_choice can run when a promptsource template is defined · ce5ec854
  lintangsutawika authored Jul 13, 2023
  
  ce5ec854
- adjust wsc · 5288813a
  lintangsutawika authored Jul 13, 2023
  
  5288813a
- process condition for doc_to_text · 82d57f65
  lintangsutawika authored Jul 13, 2023
  
  82d57f65
- Merge pull request #666 from nopperl/truthfulqa · 24864d24
  Hailey Schoelkopf authored Jul 13, 2023
```
[Refactor] Port TruthfulQA (mc1 only)
```
  24864d24
- Merge branch 'big-refactor' into truthfulqa · a410f2bd
  Hailey Schoelkopf authored Jul 13, 2023
  
  a410f2bd
- fixed doc_to_choice in race · e9432fad
  lintangsutawika authored Jul 13, 2023
  
  e9432fad
- adjust headqa · 9218bcff
  lintangsutawika authored Jul 13, 2023
  
  9218bcff
- adjust mathqa · f7a3cf20
  lintangsutawika authored Jul 13, 2023
  
  f7a3cf20
- adjust mathqa · a83874e5
  lintangsutawika authored Jul 13, 2023
  
  a83874e5
- fixes and added decontaminate args · 5dd41ebe
  lintangsutawika authored Jul 13, 2023
  
  5dd41ebe
- doc_to_target should also be able to output str instead of solely int · f2b52d26
  lintangsutawika authored Jul 13, 2023
  
  f2b52d26
- Merge branch 'revamp-process' of... · e454df7f
  lintangsutawika authored Jul 13, 2023
```
Merge branch 'revamp-process' of https://github.com/EleutherAI/lm-evaluation-harness into revamp-process
```
  e454df7f
- reformat · c827e4ce
  lintangsutawika authored Jul 13, 2023
  
  c827e4ce
- removed gold_alias for greedy_until · d1bb50e0
  lintangsutawika authored Jul 13, 2023
  
  d1bb50e0
- Merge branch 'big-refactor' into revamp-process · ca821452
  Lintang Sutawika authored Jul 13, 2023
  
  ca821452
- minor change · 9657b04c
  lintangsutawika authored Jul 13, 2023
  
  9657b04c
- update winogrande format · 5699c7ab
  lintangsutawika authored Jul 13, 2023
  
  5699c7ab
- process focuses on doc_to_text, doc_to_target, and doc_to_choice · b7449cd9
  lintangsutawika authored Jul 13, 2023
  
  b7449cd9
12 Jul, 2023 5 commits
- superglue add yamls · 5978dc4e
  lintangsutawika authored Jul 12, 2023
  
  5978dc4e
- Update README.md · 027efa00
  Hailey Schoelkopf authored Jul 12, 2023
  
  027efa00
- Merge pull request #660 from EleutherAI/unscramble+toxigen · 1610d548
  Hailey Schoelkopf authored Jul 12, 2023
```
[Refactor] Add Unscramble ; Toxigen ; Hendrycks_Ethics ; MathQA
```
  1610d548
- Merge branch 'big-refactor' into unscramble+toxigen · e0417b3b
  Hailey Schoelkopf authored Jul 12, 2023
  
  e0417b3b
- Update evaluator.py · 907c99c0
  Hailey Schoelkopf authored Jul 12, 2023
  
  907c99c0
11 Jul, 2023 11 commits
- updated yamls · 622bdda1
  lintangsutawika authored Jul 11, 2023
  
  622bdda1
- added doc_to_choice · 499a4468
  lintangsutawika authored Jul 11, 2023
  
  499a4468
- fixed arc · 31c52f55
  lintangsutawika authored Jul 11, 2023
  
  31c52f55
- add ast.literal_eval to doc_to_choice · 155160a1
  lintangsutawika authored Jul 11, 2023
  
  155160a1
- process multiple_output · c37ad6ec
  lintangsutawika authored Jul 11, 2023
  
  c37ad6ec
- multiple_output option for greedy_until · 4c363ef8
  lintangsutawika authored Jul 11, 2023
  
  4c363ef8
- added error message · f09f3ab8
  lintangsutawika authored Jul 11, 2023
  
  f09f3ab8
- typo · 4054ab84
  lintangsutawika authored Jul 11, 2023
  
  4054ab84
- modified yamls · fc5a114f
  lintangsutawika authored Jul 11, 2023
  
  fc5a114f
- update choice process · 9b20e2d0
  lintangsutawika authored Jul 11, 2023
  
  9b20e2d0
- process update to process doc_to_target variety · 656c310e
  lintangsutawika authored Jul 11, 2023
  
  656c310e