Commits · b2f6bce86c62a40498d863d103bd3c25c6d7f672 · gaoqiong / lm-evaluation-harness

08 Jan, 2022 1 commit
- Fix fewshot_context method handling · b2f6bce8
  Leo Gao authored Jan 08, 2022
  
  b2f6bce8
04 Jan, 2022 3 commits
- Merge branch 'evaluator-description-option' of... · c3bec45f
  Jonathan Tow authored Jan 04, 2022
```
Merge branch 'evaluator-description-option' of https://github.com/jon-tow/lm-evaluation-harness into evaluator-description-option
```
  c3bec45f
- Enforce `rnd` args with assertions · d2636b4e
  Jonathan Tow authored Jan 04, 2022
  
  d2636b4e
- Update description_guide.md · d09561fe
  Leo Gao authored Jan 03, 2022
  
  d09561fe
24 Dec, 2021 5 commits
- Update new `task` arg and task dict getter · 0e232f7a
  Jonathan Tow authored Dec 24, 2021
  
  0e232f7a
- Remove all `provide_description` argument uses · 57d0718a
  Jonathan Tow authored Dec 24, 2021
  
  57d0718a
- Remove more `provide_description` uses · a34bbe69
  Jonathan Tow authored Dec 24, 2021
  
  a34bbe69
- more changes · d86aabc4
  Leo Gao authored Dec 23, 2021
  
  d86aabc4
- Make simple_evaluate take LM and Task objects directly too · 7b2b2a23
  Leo Gao authored Dec 23, 2021
  
  7b2b2a23
21 Dec, 2021 3 commits
- Format for consistency · aea963a1
  Jonathan Tow authored Dec 21, 2021
  
  aea963a1
- Add positional arg deprecation decorator · 8ebe36b2
  Jonathan Tow authored Dec 21, 2021
  
  8ebe36b2
- Add `description_dict` to results config · d34ae3cf
  Jonathan Tow authored Dec 21, 2021
  
  d34ae3cf
17 Dec, 2021 2 commits
- Fix doc reference · 70f92733
  Jonathan Tow authored Dec 17, 2021
  
  70f92733
- Add `description_dict` docs and update `task-guide` · acf76b50
  Jonathan Tow authored Dec 16, 2021
  
  acf76b50
16 Dec, 2021 12 commits
- Add type info to doc-string · 1bc6cdb1
  Jonathan Tow authored Dec 16, 2021
  
  1bc6cdb1
- Fix task example link · 744482bb
  Jonathan Tow authored Dec 16, 2021
  
  744482bb
- Fix task example link · e54380d8
  Jonathan Tow authored Dec 16, 2021
  
  e54380d8
- Remove unused import · 3f06b603
  Jonathan Tow authored Dec 16, 2021
  
  3f06b603
- Fix assertion error message · 09e1de93
  Jonathan Tow authored Dec 16, 2021
  
  09e1de93
- Remove needless call · e3ddcfc2
  Jonathan Tow authored Dec 16, 2021
  
  e3ddcfc2
- Make `evaluate` and `simple_evaluate` description args consistent · 10dd7d38
  Jonathan Tow authored Dec 15, 2021
  
  10dd7d38
- Add newline to end of file · d1319950
  Jonathan Tow authored Dec 15, 2021
  
  d1319950
- Fix assertion error string · 09cd76c7
  Jonathan Tow authored Dec 15, 2021
  
  09cd76c7
- Remove `print` from test · 3fdff22f
  Jonathan Tow authored Dec 15, 2021
  
  3fdff22f
- Add basic `description_dict` · d7a8ab24
  Jonathan Tow authored Dec 15, 2021
```
test
```
  d7a8ab24
- Add `provide_description` arg for backward compat · ee53be21
  Jonathan Tow authored Dec 15, 2021
  
  ee53be21
15 Dec, 2021 3 commits
- Merge branch 'evaluator-description-option' of... · 7a357971
  Jonathan Tow authored Dec 15, 2021
```
Merge branch 'evaluator-description-option' of https://github.com/jon-tow/lm-evaluation-harness into evaluator-description-option
```
  7a357971
- Merge · 1d04c42d
  Jonathan Tow authored Dec 15, 2021
  
  1d04c42d
- Merge branch 'master' of https://github.com/EleutherAI/lm-evaluation-harness... · ff314d62
  Jonathan Tow authored Dec 15, 2021
```
Merge branch 'master' of https://github.com/EleutherAI/lm-evaluation-harness into evaluator-description-option
```
  ff314d62
09 Dec, 2021 3 commits
- Merge pull request #229 from EleutherAI/lm_refactor · df5d7cf0
  Leo Gao authored Dec 08, 2021
```
Refactor LM organization for more reuse
```
  df5d7cf0
- Bump version to 0.1.0 · 9590f366
  Leo Gao authored Dec 08, 2021
  
  9590f366
- Update evaluator.py · c7ae6df1
  Leo Gao authored Dec 08, 2021
  
  c7ae6df1
06 Dec, 2021 1 commit
- Merge branch 'master' of https://github.com/EleutherAI/lm-evaluation-harness... · 564e0612
  Jonathan Tow authored Dec 06, 2021
```
Merge branch 'master' of https://github.com/EleutherAI/lm-evaluation-harness into evaluator-description-option
```
  564e0612
05 Dec, 2021 3 commits
- Update test_gpt3.py · a6bb79b4
  Leo Gao authored Dec 05, 2021
  
  a6bb79b4
- Update test_gpt3.py · 01b98d2d
  Leo Gao authored Dec 05, 2021
  
  01b98d2d
- Get rid of get_token_logprobs · 7c011370
  Leo Gao authored Dec 05, 2021
  
  7c011370
01 Dec, 2021 1 commit
- Merge pull request #232 from zphang/lm_refactor_update1 · ae63eeb7
  Leo Gao authored Nov 30, 2021
```
Additional clean-up of LM Refactor
```
  ae63eeb7
29 Nov, 2021 3 commits
- Merge pull request #234 from EleutherAI/race_fix · 67e2bf8b
  Leo Gao authored Nov 29, 2021
```
Pin datasets to 1.15.1 to fix RACE
```
  67e2bf8b
- Pin datasets to 1.15.1 · 784a5c54
  Leo Gao authored Nov 28, 2021
  
  784a5c54
- Update req_type to request_type · 6b6e6d77
  Leo Gao authored Nov 28, 2021
  
  6b6e6d77