Commits · cf074822dfe044103eef02ac285dd906dda29a7d · gaoqiong / lm-evaluation-harness

29 Apr, 2022 1 commit
- Revert "Merge branch 'master' into master" · 7585ec56
  jon-tow authored Apr 29, 2022
```
This reverts commit 5fe7e2c0, reversing
changes made to 14b8ec7e.
```
  7585ec56
28 Apr, 2022 1 commit
- adding challenge sets · d42d5423
  jordiclive authored Apr 28, 2022
  
  d42d5423
27 Apr, 2022 2 commits
- Add `"\n###\n"` example separator · 597bf747
  jon-tow authored Apr 27, 2022
  
  597bf747
- webnlg · afcea267
  jordiclive authored Apr 27, 2022
  
  afcea267
25 Apr, 2022 1 commit
- Fix prompt source rank choice accuracy · 2bfa4518
  jon-tow authored Apr 25, 2022
  
  2bfa4518
24 Dec, 2021 1 commit
- Remove more `provide_description` uses · a34bbe69
  Jonathan Tow authored Dec 24, 2021
  
  a34bbe69
15 Dec, 2021 1 commit
- Merge · 1d04c42d
  Jonathan Tow authored Dec 15, 2021
  
  1d04c42d
30 Oct, 2021 1 commit
- Replace the `fewshot_description` API with a `description_dict` based interface · 8ac99269
  Jonathan Tow authored Oct 30, 2021
  
  8ac99269
28 Mar, 2021 2 commits
- Update write_out.py · 0d663b6b
  Leo Gao authored Mar 27, 2021
  
  0d663b6b
- Add `Random` argument to `write_out` `fewshot_context` · d96b991d
  Jonathan Tow authored Mar 28, 2021
  
  d96b991d
27 Mar, 2021 1 commit
- Remove unused imports and format imports outside of `lm_eval` module · 9a9c8e3c
  Jonathan Tow authored Mar 27, 2021
  
  9a9c8e3c
06 Feb, 2021 1 commit
- Fix `write_out.py` training set bug · 990d5e31
  Jonathan Tow authored Feb 05, 2021
  
  990d5e31
05 Feb, 2021 1 commit
- Add task table · c0fbf9e8
  Leo Gao authored Feb 04, 2021
  
  c0fbf9e8
02 Feb, 2021 1 commit
- pubmedqa · 1b35f6b9
  jeffhsu3 authored Feb 02, 2021
  
  1b35f6b9
30 Nov, 2020 2 commits
- Allow specifying sets for write_out · 49cc6f5d
  Leo Gao authored Nov 29, 2020
  
  49cc6f5d
- Allow specifying sets for write_out · d4ae0c00
  Leo Gao authored Nov 29, 2020
  
  d4ae0c00
29 Nov, 2020 1 commit
- Allow num_examples to fetch all if num_examples < 0 · a1ef56aa
  Leo Gao authored Nov 29, 2020
  
  a1ef56aa
05 Oct, 2020 1 commit
- write_out: fallover to training data if no validation · 6c816cb7
  Leo Gao authored Oct 05, 2020
  
  6c816cb7
14 Sep, 2020 2 commits
- cleanup · a85ad214
  Jason Phang authored Sep 14, 2020
  
  a85ad214
- SuperGLUE, and truncation · 8161c22e
  Jason Phang authored Sep 14, 2020
  
  8161c22e
07 Sep, 2020 4 commits
- seed · 9987203f
  Jason Phang authored Sep 07, 2020
  
  9987203f
- lib · f88bb827
  Jason Phang authored Sep 07, 2020
  
  f88bb827
- glue tasks · cf80f340
  Jason Phang authored Sep 07, 2020
  
  cf80f340
- gpt3 · 12e12bc0
  Jason Phang authored Sep 07, 2020
  
  12e12bc0
28 Aug, 2020 1 commit
- Initial Commit · 1c7fb748
  Leo Gao authored Aug 27, 2020
  
  1c7fb748