Commits · cf074822dfe044103eef02ac285dd906dda29a7d · gaoqiong / lm-evaluation-harness

"vscode:/vscode.git/clone" did not exist on "4142c3ef7c4c543bf9735cdddb99d4570071c5bd"

29 Apr, 2022 1 commit
- Revert "Merge branch 'master' into master" · 7585ec56
  jon-tow authored Apr 29, 2022
```
This reverts commit 5fe7e2c0, reversing
changes made to 14b8ec7e.
```
  7585ec56
28 Apr, 2022 1 commit
- adding challenge sets · d42d5423
  jordiclive authored Apr 28, 2022
  
  d42d5423
27 Apr, 2022 2 commits
- Add `"\n###\n"` example separator · 597bf747
  jon-tow authored Apr 27, 2022
  
  597bf747
- webnlg · afcea267
  jordiclive authored Apr 27, 2022
  
  afcea267
25 Apr, 2022 1 commit
- Fix prompt source rank choice accuracy · 2bfa4518
  jon-tow authored Apr 25, 2022
  
  2bfa4518
24 Dec, 2021 2 commits
- Remove all `provide_description` argument uses · 57d0718a
  Jonathan Tow authored Dec 24, 2021
  
  57d0718a
- Remove more `provide_description` uses · a34bbe69
  Jonathan Tow authored Dec 24, 2021
  
  a34bbe69
21 Dec, 2021 1 commit
- Add positional arg deprecation decorator · 8ebe36b2
  Jonathan Tow authored Dec 21, 2021
  
  8ebe36b2
16 Dec, 2021 1 commit
- Add `provide_description` arg for backward compat · ee53be21
  Jonathan Tow authored Dec 15, 2021
  
  ee53be21
15 Dec, 2021 1 commit
- Merge · 1d04c42d
  Jonathan Tow authored Dec 15, 2021
  
  1d04c42d
30 Oct, 2021 1 commit
- Replace the `fewshot_description` API with a `description_dict` based interface · 8ac99269
  Jonathan Tow authored Oct 30, 2021
  
  8ac99269
01 Oct, 2021 1 commit
- UPdate cost estimate · 7f8d6676
  Leo Gao authored Oct 01, 2021
  
  7f8d6676
13 May, 2021 1 commit
- Add column to task table · 47e3ae6c
  Leo Gao authored May 12, 2021
  
  47e3ae6c
12 May, 2021 4 commits
- Add inits · 7549befa
  researcher2 authored May 12, 2021
  
  7549befa
- Update janitor.py · d0277a3f
  researcher2 authored May 12, 2021
```
Comment out cpp tests.
```
  d0277a3f
- Janitor testing and changes · 7cb91943
  researcher2 authored May 12, 2021
```
Small fixes to python version of Janitor, cpp version named properly for import but code doesn't work - may or may not fix in the future.

Add unit tests for python version of Janitor.
```
  7cb91943
- Add pile 13gram processing. · 2a11129d
  researcher2 authored May 12, 2021
  
  2a11129d
11 Apr, 2021 1 commit
- Add more gpt2 tests · eec18018
  Leo Gao authored Apr 11, 2021
  
  eec18018
28 Mar, 2021 2 commits
- Update write_out.py · 0d663b6b
  Leo Gao authored Mar 27, 2021
  
  0d663b6b
- Add `Random` argument to `write_out` `fewshot_context` · d96b991d
  Jonathan Tow authored Mar 28, 2021
  
  d96b991d
27 Mar, 2021 1 commit
- Remove unused imports and format imports outside of `lm_eval` module · 9a9c8e3c
  Jonathan Tow authored Mar 27, 2021
  
  9a9c8e3c
27 Feb, 2021 1 commit
- Implement fewshot description experiment · 879aabd6
  Leo Gao authored Feb 27, 2021
  
  879aabd6
14 Feb, 2021 1 commit
- Add a bunch of scripts · ea08242e
  Leo Gao authored Feb 14, 2021
  
  ea08242e
12 Feb, 2021 1 commit
- Moving over training data decontamination code · 4de29dca
  & authored Feb 11, 2021
  
  4de29dca
06 Feb, 2021 1 commit
- Fix `write_out.py` training set bug · 990d5e31
  Jonathan Tow authored Feb 05, 2021
  
  990d5e31
05 Feb, 2021 1 commit
- Add task table · c0fbf9e8
  Leo Gao authored Feb 04, 2021
  
  c0fbf9e8