Commits · 1f8a8c1dc95a475f0b6fd3cc082e89a674c072d7 · gaoqiong / lm-evaluation-harness

03 May, 2022 1 commit
- add pre-commit · 121b7096
  Fabrizio Milo authored May 02, 2022
  
  121b7096
29 Apr, 2022 2 commits
- Revert "Merge branch 'master' into master" · 7585ec56
  jon-tow authored Apr 29, 2022
```
This reverts commit 5fe7e2c0, reversing
changes made to 14b8ec7e.
```
  7585ec56
- Fix max generation limit · eda365f6
  jon-tow authored Apr 28, 2022
  
  eda365f6
28 Apr, 2022 1 commit
- Update stopping criteria for few-shot · b62d1bec
  Tian Yun authored Apr 28, 2022
  
  b62d1bec
26 Apr, 2022 8 commits
- Rename task specific to · b2838b8d
  cjlovering authored Apr 26, 2022
  
  b2838b8d
- Rename task specific to · f39c27c2
  cjlovering authored Apr 26, 2022
  
  f39c27c2
- Turned off generation tasks for now. Changed process to look at the metrics.... · 0cdcc989
  jon-tow authored Apr 25, 2022
```
Turned off generation tasks for now. Changed process to look at the metrics. Only accuracy implemented.
```
  0cdcc989
- QQP with PS integration. · b1a3c6e3
  cjlovering authored Apr 25, 2022
  
  b1a3c6e3
- MRPC with PS integration. · 26e94211
  cjlovering authored Apr 25, 2022
  
  26e94211
- QNLI with PS integration. · b44aa554
  cjlovering authored Apr 25, 2022
  
  b44aa554
- SST with PS integration. (It was already done.) · 4c201b97
  cjlovering authored Apr 25, 2022
  
  4c201b97
- SST with PS integration. (It was already done.) · e49cf8da
  cjlovering authored Apr 25, 2022
  
  e49cf8da
25 Apr, 2022 2 commits
- Add multiple tasks · 34f591af
  jon-tow authored Apr 25, 2022
  
  34f591af
- Fix prompt source rank choice accuracy · 2bfa4518
  jon-tow authored Apr 25, 2022
  
  2bfa4518
18 Mar, 2022 1 commit
- Refactor `Task` download · 7c9da714
  Jonathan Tow authored Mar 11, 2022
  
  7c9da714
28 Feb, 2022 2 commits
- Make citations module-level constants · 3f13d15f
  Jonathan Tow authored Feb 28, 2022
  
  3f13d15f
- Add citations and descriptions to all tasks · a1aceacd
  Jonathan Tow authored Feb 28, 2022
  
  a1aceacd
05 Feb, 2022 1 commit
- Added decontamination to remaining evals · dae7b868
  Quentin Gregory Anthony authored Feb 05, 2022
  
  dae7b868
23 Dec, 2021 2 commits
- Bump version · a48e3cf2
  thomasw21 authored Dec 23, 2021
  
  a48e3cf2
- FIX wnli · 682e5c44
  thomasw21 authored Dec 23, 2021
  
  682e5c44
30 Oct, 2021 1 commit
- Replace the `fewshot_description` API with a `description_dict` based interface · 8ac99269
  Jonathan Tow authored Oct 30, 2021
  
  8ac99269
05 Jun, 2021 1 commit
- Add task versioning · 105fa974
  Leo Gao authored Jun 04, 2021
  
  105fa974
27 Mar, 2021 3 commits
- Mark GLUE and SuperGLUE tasks without labelled test docs as not having test docs at all · fa7b9643
  Leo Gao authored Mar 26, 2021
  
  fa7b9643
- Remove unused imports and format imports · d5d19219
  Jonathan Tow authored Mar 26, 2021
  
  d5d19219
- Fix stuff and make tests pass · c971fa82
  Leo Gao authored Mar 26, 2021
  
  c971fa82
12 Feb, 2021 1 commit
- metrics file · 1fb90b91
  & authored Feb 12, 2021
  
  1fb90b91
09 Feb, 2021 3 commits
- More task changes · 9b14235d
  Leo Gao authored Feb 08, 2021
  
  9b14235d
- Fix · 96157fc7
  Leo Gao authored Feb 08, 2021
  
  96157fc7
- Change glue and superglue prompts · c3f724cf
  Leo Gao authored Feb 08, 2021
  
  c3f724cf
22 Jan, 2021 2 commits
- Remove rewrite reminder comment from everything except SuperGLUE · f4120e59
  Leo Gao authored Jan 21, 2021
  
  f4120e59
- Clean up code, remove some footguns · e31b4b31
  Leo Gao authored Jan 21, 2021
  
  e31b4b31
21 Jan, 2021 1 commit
- Adopt new framework for `glue` · 36467c0e
  Jonathan Tow authored Jan 21, 2021
  
  36467c0e
13 Jan, 2021 1 commit
- Move `doc_to_text` target code into `doc_to_target` · d77241eb
  Jonathan Tow authored Jan 13, 2021
  
  d77241eb
06 Jan, 2021 1 commit
- Add comments to remind that evaluation needs to be written for the new framework · 2d2dbf96
  Leo Gao authored Jan 05, 2021
  
  2d2dbf96
05 Jan, 2021 1 commit
- Add reminder to rewrite · 08dc67ea
  Leo Gao authored Jan 05, 2021
  
  08dc67ea
30 Nov, 2020 3 commits
- Undo MNLI changes · ff3adfe2
  Leo Gao authored Nov 29, 2020
  
  ff3adfe2
- Fix MNLIMismatched · 26d59f34
  Leo Gao authored Nov 29, 2020
  
  26d59f34
- Fix MNLI train set · 1c9432de
  Leo Gao authored Nov 29, 2020
  
  1c9432de
24 Oct, 2020 1 commit
- mnli_mismatched · 25131aa7
  Jason Phang authored Oct 24, 2020
  
  25131aa7
05 Oct, 2020 1 commit
- change HF_Dataset to HFTask · 5a6c172e
  sdtblck authored Oct 05, 2020
  
  5a6c172e