Commits · 7c9da71441aab0670663a18336488143b1ddf9b8 · gaoqiong / lm-evaluation-harness

18 Mar, 2022 1 commit
- Refactor `Task` download · 7c9da714
  Jonathan Tow authored Mar 11, 2022
  
  7c9da714
28 Feb, 2022 2 commits
- Make citations module-level constants · 3f13d15f
  Jonathan Tow authored Feb 28, 2022
  
  3f13d15f
- Add citations and descriptions to all tasks · a1aceacd
  Jonathan Tow authored Feb 28, 2022
  
  a1aceacd
08 Jan, 2022 1 commit
- Actually it shouldn't be hard to fix it to be compatible with future version · c65412e5
  thomasw21 authored Jan 08, 2022
  
  c65412e5
30 Oct, 2021 1 commit
- Replace the `fewshot_description` API with a `description_dict` based interface · 8ac99269
  Jonathan Tow authored Oct 30, 2021
  
  8ac99269
12 Jun, 2021 3 commits
- Actually do things correctly this time · f14571fb
  Leo Gao authored Jun 11, 2021
  
  f14571fb
- Bump CoQA version · 278863b5
  Leo Gao authored Jun 11, 2021
  
  278863b5
- Make CoQA take the first line of output excluding any leading whitespace · 2078adba
  Leo Gao authored Jun 11, 2021
  
  2078adba
10 Jun, 2021 1 commit
- Change generate until sequence in coqa to be \nQ: · cc474a94
  sdtblck authored Jun 11, 2021
  
  cc474a94
05 Jun, 2021 2 commits
- convert all enabled tasks to use best_download for better download robustness · 20229183
  Leo Gao authored Jun 04, 2021
  
  20229183
- Add task versioning · 105fa974
  Leo Gao authored Jun 04, 2021
  
  105fa974
27 Mar, 2021 1 commit
- Remove unused imports and format imports · d5d19219
  Jonathan Tow authored Mar 26, 2021
  
  d5d19219
14 Feb, 2021 1 commit
- Fix CoQA for tests · 431e53de
  Leo Gao authored Feb 14, 2021
  
  431e53de
13 Feb, 2021 1 commit
- Call greedy_until continuation, download fix · 68122ef4
  thefazzer authored Feb 13, 2021
  
  68122ef4
08 Feb, 2021 2 commits
- Remove stray space · f9750990
  Leo Gao authored Feb 07, 2021
  
  f9750990
- Bugfixes, answer mapping, comments · b9b3159b
  thefazzer authored Feb 08, 2021
  
  b9b3159b
06 Feb, 2021 1 commit
- HFTask -> Task, line break correction · 222027b9
  thefazzer authored Feb 06, 2021
  
  222027b9
03 Feb, 2021 2 commits
- Refactor `Dataset` naming and `HFTask` properties · a60ef6fa
  Jonathan Tow authored Feb 02, 2021
  
  a60ef6fa
- Score computation, use squad metrics · efa810f0
  thefazzer authored Feb 03, 2021
  
  efa810f0
31 Jan, 2021 2 commits
- Text & target impl, support fns, refactoring · c0862026
  thefazzer authored Jan 31, 2021
  
  c0862026
- Initial skeleton refactoring · 12880f1c
  thefazzer authored Jan 31, 2021
  
  12880f1c
22 Jan, 2021 1 commit
- Clean up code, remove some footguns · e31b4b31
  Leo Gao authored Jan 21, 2021
  
  e31b4b31
05 Jan, 2021 1 commit
- Add reminder to rewrite · 08dc67ea
  Leo Gao authored Jan 05, 2021
  
  08dc67ea
24 Oct, 2020 4 commits
- add include target for coqa · e3c2e692
  Anish Thite authored Oct 24, 2020
  
  e3c2e692
- update coqa dev set · 97e5a566
  Anish Thite authored Oct 24, 2020
  
  97e5a566
- update coqa dev set · db3fe0d6
  Anish Thite authored Oct 24, 2020
  
  db3fe0d6
- update coqa to be consistent with gpt3 paper · 5d601e14
  Anish Thite authored Oct 24, 2020
  
  5d601e14
05 Oct, 2020 1 commit
- add download method to base class · ff2d2ada
  sdtblck authored Oct 05, 2020
  
  ff2d2ada
17 Sep, 2020 1 commit
- refactor to explicit registries · 515d78b3
  Jason Phang authored Sep 17, 2020
  
  515d78b3
14 Sep, 2020 1 commit
- SuperGLUE, and truncation · 8161c22e
  Jason Phang authored Sep 14, 2020
  
  8161c22e
07 Sep, 2020 3 commits
- lib · f88bb827
  Jason Phang authored Sep 07, 2020
  
  f88bb827
- gpt3 · 12e12bc0
  Jason Phang authored Sep 07, 2020
  
  12e12bc0
- add generate docs and generate text for coqa · a2871d9c
  Anish Thite authored Sep 06, 2020
  
  a2871d9c