Commits · 705e57c76ebc12c2a4933b876df9470228df62df · gaoqiong / lm-evaluation-harness

17 Jul, 2023 6 commits
- fix new_tasks function · 705e57c7
  baberabb authored Jul 17, 2023
  
  705e57c7
- fix typos · 8c0db2ac
  baberabb authored Jul 17, 2023
  
  8c0db2ac
- add CI test case if api/* files changed then pytest more tasks · 80b84321
  baberabb authored Jul 17, 2023
  
  80b84321
- Update and rename __innit__.py to __init__.py · 8e3f1a49
  Hailey Schoelkopf authored Jul 17, 2023
  
  8e3f1a49
- Delete test file · fa660ad8
  baberabb authored Jul 17, 2023
  
  fa660ad8
- edited test_tasks.py and workflow files · 4c250860
  baberabb authored Jul 15, 2023
  
  4c250860
14 Jul, 2023 34 commits
- Merge remote-tracking branch 'origin/big-refactor' into big-refactor_testeval · 31995161
  baberabb authored Jul 14, 2023
  
  31995161
- typo · 1c27e371
  baberabb authored Jul 14, 2023
  
  1c27e371
- Merge remote-tracking branch 'origin/big-refactor_testtasks' into big-refactor_testeval · 58aa729f
  baberabb authored Jul 14, 2023
  
  58aa729f
- updated test_tasks · fae09c2c
  baberabb authored Jul 14, 2023
  
  fae09c2c
- fix · 1ec0a129
  baberabb authored Jul 14, 2023
  
  1ec0a129
- fix · 708bc65f
  baberabb authored Jul 14, 2023
  
  708bc65f
- fix · d4ef6e5b
  baberabb authored Jul 14, 2023
  
  d4ef6e5b
- fix · 82c12e9b
  baberabb authored Jul 14, 2023
  
  82c12e9b
- fix · b182d1b4
  baberabb authored Jul 14, 2023
  
  b182d1b4
- unstop flake8 · 10103d5d
  baberabb authored Jul 14, 2023
  
  10103d5d
- fix typo · 455c52c9
  baberabb authored Jul 14, 2023
  
  455c52c9
- Add CI setup · 94cba287
  baberabb authored Jul 14, 2023
  
  94cba287
- Update main.py · 283cad70
  Hailey Schoelkopf authored Jul 14, 2023
  
  283cad70
- Merge pull request #671 from EleutherAI/revamp-process · 2c20cd1f
  Lintang Sutawika authored Jul 14, 2023
```
Revamp process
```
  2c20cd1f
- Merge branch 'big-refactor' into revamp-process · 0dadc92a
  Lintang Sutawika authored Jul 14, 2023
  
  0dadc92a
- Merge pull request #678 from EleutherAI/fix-generative-multitarget · bfa57719
  Lintang Sutawika authored Jul 14, 2023
```
[Refactor] Patch to revamp-process
```
  bfa57719
- make sure boolq works · d70f7134
  haileyschoelkopf authored Jul 14, 2023
  
  d70f7134
- override target_delimiter · a36348fa
  lintangsutawika authored Jul 14, 2023
  
  a36348fa
- fixed whitespace for target · addada53
  lintangsutawika authored Jul 14, 2023
  
  addada53
- fix error · 60acbde2
  lintangsutawika authored Jul 14, 2023
  
  60acbde2
- remove info · 1ca2c0ba
  lintangsutawika authored Jul 14, 2023
  
  1ca2c0ba
- adjustments for super_glue · b0597a94
  lintangsutawika authored Jul 14, 2023
  
  b0597a94
- Update python-package.yml · 0a48d7c5
  baberabb authored Jul 14, 2023
```
pytest only on test_evaluator
```
  0a48d7c5
- Merge pull request #676 from EleutherAI/new-flags · 6862fa7d
  Lintang Sutawika authored Jul 14, 2023
```
[Refactor] Miscellaneous fixes
```
  6862fa7d
- formatted · f7dde0c3
  lintangsutawika authored Jul 14, 2023
  
  f7dde0c3
- fix typehints in Instance() · 7684bfa9
  haileyschoelkopf authored Jul 14, 2023
  
  7684bfa9
- don't log samples if not requested · 04c81e7d
  haileyschoelkopf authored Jul 14, 2023
  
  04c81e7d
- fix random seed issue, log_samples optional · 5fbc3f86
  haileyschoelkopf authored Jul 14, 2023
  
  5fbc3f86
- fix · 64c15e41
  baberabb authored Jul 14, 2023
  
  64c15e41
- Create python-package.yml · 9c26a957
  baberabb authored Jul 14, 2023
```
testing
```
  9c26a957
- fix · e7047626
  baberabb authored Jul 14, 2023
  
  e7047626
- fix · 2f386a9d
  baberabb authored Jul 14, 2023
  
  2f386a9d
- Merge remote-tracking branch 'origin/big-refactor_testeval' into big-refactor_testeval · a8b32e86
  baberabb authored Jul 14, 2023
  
  a8b32e86
- test pythia-70m and pytest only test_evaluator.py · 196fbbb8
  baberabb authored Jul 14, 2023
  
  196fbbb8