Commits · 1c27e3713eb2f039a4f12f2f551eb7c9a12aa015 · gaoqiong / lm-evaluation-harness

14 Jul, 2023 24 commits
- typo · 1c27e371
  baberabb authored Jul 14, 2023
  
  1c27e371
- Merge remote-tracking branch 'origin/big-refactor_testtasks' into big-refactor_testeval · 58aa729f
  baberabb authored Jul 14, 2023
  
  58aa729f
- updated test_tasks · fae09c2c
  baberabb authored Jul 14, 2023
  
  fae09c2c
- fix · 1ec0a129
  baberabb authored Jul 14, 2023
  
  1ec0a129
- fix · 708bc65f
  baberabb authored Jul 14, 2023
  
  708bc65f
- fix · d4ef6e5b
  baberabb authored Jul 14, 2023
  
  d4ef6e5b
- fix · 82c12e9b
  baberabb authored Jul 14, 2023
  
  82c12e9b
- fix · b182d1b4
  baberabb authored Jul 14, 2023
  
  b182d1b4
- unstop flake8 · 10103d5d
  baberabb authored Jul 14, 2023
  
  10103d5d
- fix typo · 455c52c9
  baberabb authored Jul 14, 2023
  
  455c52c9
- Add CI setup · 94cba287
  baberabb authored Jul 14, 2023
  
  94cba287
- Update python-package.yml · 0a48d7c5
  baberabb authored Jul 14, 2023
```
pytest only on test_evaluator
```
  0a48d7c5
- Merge pull request #676 from EleutherAI/new-flags · 6862fa7d
  Lintang Sutawika authored Jul 14, 2023
```
[Refactor] Miscellaneous fixes
```
  6862fa7d
- formatted · f7dde0c3
  lintangsutawika authored Jul 14, 2023
  
  f7dde0c3
- fix typehints in Instance() · 7684bfa9
  haileyschoelkopf authored Jul 14, 2023
  
  7684bfa9
- don't log samples if not requested · 04c81e7d
  haileyschoelkopf authored Jul 14, 2023
  
  04c81e7d
- fix random seed issue, log_samples optional · 5fbc3f86
  haileyschoelkopf authored Jul 14, 2023
  
  5fbc3f86
- fix · 64c15e41
  baberabb authored Jul 14, 2023
  
  64c15e41
- Create python-package.yml · 9c26a957
  baberabb authored Jul 14, 2023
```
testing
```
  9c26a957
- fix · e7047626
  baberabb authored Jul 14, 2023
  
  e7047626
- fix · 2f386a9d
  baberabb authored Jul 14, 2023
  
  2f386a9d
- Merge remote-tracking branch 'origin/big-refactor_testeval' into big-refactor_testeval · a8b32e86
  baberabb authored Jul 14, 2023
  
  a8b32e86
- test pythia-70m and pytest only test_evaluator.py · 196fbbb8
  baberabb authored Jul 14, 2023
  
  196fbbb8
- test pythia-70m and pytest only test_evaluator.py · 4225df50
  baberabb authored Jul 14, 2023
  
  4225df50
13 Jul, 2023 6 commits
- log all arguments per doc · 09a71562
  haileyschoelkopf authored Jul 13, 2023
  
  09a71562
- add fast tokenizer flag · 165f8493
  haileyschoelkopf authored Jul 13, 2023
  
  165f8493
- Update README.md · 98c85d73
  Hailey Schoelkopf authored Jul 13, 2023
  
  98c85d73
- Merge pull request #666 from nopperl/truthfulqa · 24864d24
  Hailey Schoelkopf authored Jul 13, 2023
```
[Refactor] Port TruthfulQA (mc1 only)
```
  24864d24
- Merge branch 'big-refactor' into truthfulqa · a410f2bd
  Hailey Schoelkopf authored Jul 13, 2023
  
  a410f2bd
- fix test_evaluator.py · d9b547b7
  baberabb authored Jul 13, 2023
  
  d9b547b7
12 Jul, 2023 4 commits
- Update README.md · 027efa00
  Hailey Schoelkopf authored Jul 12, 2023
  
  027efa00
- Merge pull request #660 from EleutherAI/unscramble+toxigen · 1610d548
  Hailey Schoelkopf authored Jul 12, 2023
```
[Refactor] Add Unscramble ; Toxigen ; Hendrycks_Ethics ; MathQA
```
  1610d548
- Merge branch 'big-refactor' into unscramble+toxigen · e0417b3b
  Hailey Schoelkopf authored Jul 12, 2023
  
  e0417b3b
- Update evaluator.py · 907c99c0
  Hailey Schoelkopf authored Jul 12, 2023
  
  907c99c0
10 Jul, 2023 2 commits
- Merge pull request #659 from EleutherAI/headqa · 7d4e92fa
  Hailey Schoelkopf authored Jul 10, 2023
```
[Refactor] Add Headqa
```
  7d4e92fa
- Merge branch 'big-refactor' into headqa · 287f7efc
  Hailey Schoelkopf authored Jul 10, 2023
  
  287f7efc
08 Jul, 2023 2 commits
- Update task checklist · a09e04bc
  nopperl authored Jul 08, 2023
  
  a09e04bc
- Port truthfulqa mc1 task · 5af4a867
  nopperl authored Jul 08, 2023
  
  5af4a867
07 Jul, 2023 2 commits
- add MWP tag to mathQA · 76bf11c5
  haileyschoelkopf authored Jul 07, 2023
  
  76bf11c5
- add mathqa · 255f4c6e
  haileyschoelkopf authored Jul 07, 2023
  
  255f4c6e