Commits · 31995161845e6352d2ef903fdcfe8fef076759ab · gaoqiong / lm-evaluation-harness

14 Jul, 2023 40 commits
- Merge remote-tracking branch 'origin/big-refactor' into big-refactor_testeval · 31995161
  baberabb authored Jul 14, 2023
  
  31995161
- typo · 1c27e371
  baberabb authored Jul 14, 2023
  
  1c27e371
- Merge remote-tracking branch 'origin/big-refactor_testtasks' into big-refactor_testeval · 58aa729f
  baberabb authored Jul 14, 2023
  
  58aa729f
- updated test_tasks · fae09c2c
  baberabb authored Jul 14, 2023
  
  fae09c2c
- fix · 1ec0a129
  baberabb authored Jul 14, 2023
  
  1ec0a129
- fix · 708bc65f
  baberabb authored Jul 14, 2023
  
  708bc65f
- fix · d4ef6e5b
  baberabb authored Jul 14, 2023
  
  d4ef6e5b
- fix · 82c12e9b
  baberabb authored Jul 14, 2023
  
  82c12e9b
- fix · b182d1b4
  baberabb authored Jul 14, 2023
  
  b182d1b4
- unstop flake8 · 10103d5d
  baberabb authored Jul 14, 2023
  
  10103d5d
- fix typo · 455c52c9
  baberabb authored Jul 14, 2023
  
  455c52c9
- Add CI setup · 94cba287
  baberabb authored Jul 14, 2023
  
  94cba287
- Update main.py · 283cad70
  Hailey Schoelkopf authored Jul 14, 2023
  
  283cad70
- Merge pull request #671 from EleutherAI/revamp-process · 2c20cd1f
  Lintang Sutawika authored Jul 14, 2023
```
Revamp process
```
  2c20cd1f
- Merge branch 'big-refactor' into revamp-process · 0dadc92a
  Lintang Sutawika authored Jul 14, 2023
  
  0dadc92a
- Merge pull request #678 from EleutherAI/fix-generative-multitarget · bfa57719
  Lintang Sutawika authored Jul 14, 2023
```
[Refactor] Patch to revamp-process
```
  bfa57719
- make sure boolq works · d70f7134
  haileyschoelkopf authored Jul 14, 2023
  
  d70f7134
- override target_delimiter · a36348fa
  lintangsutawika authored Jul 14, 2023
  
  a36348fa
- fixed whitespace for target · addada53
  lintangsutawika authored Jul 14, 2023
  
  addada53
- fix error · 60acbde2
  lintangsutawika authored Jul 14, 2023
  
  60acbde2
- remove info · 1ca2c0ba
  lintangsutawika authored Jul 14, 2023
  
  1ca2c0ba
- adjustments for super_glue · b0597a94
  lintangsutawika authored Jul 14, 2023
  
  b0597a94
- Update python-package.yml · 0a48d7c5
  baberabb authored Jul 14, 2023
```
pytest only on test_evaluator
```
  0a48d7c5
- Merge pull request #676 from EleutherAI/new-flags · 6862fa7d
  Lintang Sutawika authored Jul 14, 2023
```
[Refactor] Miscellaneous fixes
```
  6862fa7d
- formatted · f7dde0c3
  lintangsutawika authored Jul 14, 2023
  
  f7dde0c3
- fix typehints in Instance() · 7684bfa9
  haileyschoelkopf authored Jul 14, 2023
  
  7684bfa9
- don't log samples if not requested · 04c81e7d
  haileyschoelkopf authored Jul 14, 2023
  
  04c81e7d
- fix random seed issue, log_samples optional · 5fbc3f86
  haileyschoelkopf authored Jul 14, 2023
  
  5fbc3f86
- fix · 64c15e41
  baberabb authored Jul 14, 2023
  
  64c15e41
- Create python-package.yml · 9c26a957
  baberabb authored Jul 14, 2023
```
testing
```
  9c26a957
- fix · e7047626
  baberabb authored Jul 14, 2023
  
  e7047626
- fix · 2f386a9d
  baberabb authored Jul 14, 2023
  
  2f386a9d
- Merge remote-tracking branch 'origin/big-refactor_testeval' into big-refactor_testeval · a8b32e86
  baberabb authored Jul 14, 2023
  
  a8b32e86
- test pythia-70m and pytest only test_evaluator.py · 196fbbb8
  baberabb authored Jul 14, 2023
  
  196fbbb8
- test pythia-70m and pytest only test_evaluator.py · 4225df50
  baberabb authored Jul 14, 2023
  
  4225df50
- updates, corrections, and fixes to match big-refactor · ee633332
  lintangsutawika authored Jul 14, 2023
  
  ee633332
- doc_to_target and doc_to_text should also accept int · 94a49f70
  lintangsutawika authored Jul 14, 2023
  
  94a49f70
- config fixes · 248b45da
  lintangsutawika authored Jul 14, 2023
  
  248b45da
- adjustments · 70e3ed25
  lintangsutawika authored Jul 14, 2023
  
  70e3ed25
- Merge branch 'big-refactor' of... · 457c4262
  lintangsutawika authored Jul 14, 2023
```
Merge branch 'big-refactor' of https://github.com/EleutherAI/lm-evaluation-harness into revamp-process
```
  457c4262