Commits · 78824d7faee422c8ce55432612a20c71925d3481 · gaoqiong / lm-evaluation-harness

29 Dec, 2021 2 commits
- Pretty sure questions need to be paragraph dependent also · d7e32489
  thomasw21 authored Dec 29, 2021
  
  d7e32489
- Revert "Add capital letters" · 0bde7589
  thomasw21 authored Dec 29, 2021
```
This reverts commit 23a42067.
```
  0bde7589
27 Dec, 2021 1 commit
- Questions in BoolQ don't have interrogation punctuation at the end · 440216db
  thomasw21 authored Dec 27, 2021
  
  440216db
26 Dec, 2021 2 commits
- Add capital letters · 23a42067
  thomasw21 authored Dec 26, 2021
  
  23a42067
- Fix multirc · df1fc6c3
  thomasw21 authored Dec 26, 2021
  
  df1fc6c3
30 Oct, 2021 1 commit
- Replace the `fewshot_description` API with a `description_dict` based interface · 8ac99269
  Jonathan Tow authored Oct 30, 2021
  
  8ac99269
05 Jun, 2021 1 commit
- Add task versioning · 105fa974
  Leo Gao authored Jun 04, 2021
  
  105fa974
28 Mar, 2021 1 commit
- Update superglue winograd has_test_docs · 5643f20f
  Leo Gao authored Mar 28, 2021
  
  5643f20f
27 Mar, 2021 2 commits
- Mark GLUE and SuperGLUE tasks without labelled test docs as not having test docs at all · fa7b9643
  Leo Gao authored Mar 26, 2021
  
  fa7b9643
- Remove unused imports and format imports · d5d19219
  Jonathan Tow authored Mar 26, 2021
  
  d5d19219
14 Feb, 2021 2 commits
- ReCoRD fixup · 2cfdd80a
  Jason Phang authored Feb 13, 2021
  
  2cfdd80a
- tweak doc format · 2719a522
  Jason Phang authored Feb 13, 2021
  
  2719a522
13 Feb, 2021 1 commit
- ReCoRD fix · e4e9228e
  Jason Phang authored Feb 13, 2021
  
  e4e9228e
12 Feb, 2021 1 commit
- metrics file · 1fb90b91
  & authored Feb 12, 2021
  
  1fb90b91
10 Feb, 2021 1 commit
- Add missing space in MultiRC · e9e5d0a2
  Leo Gao authored Feb 09, 2021
  
  e9e5d0a2
09 Feb, 2021 2 commits
- Fix · 96157fc7
  Leo Gao authored Feb 08, 2021
  
  96157fc7
- Change glue and superglue prompts · c3f724cf
  Leo Gao authored Feb 08, 2021
  
  c3f724cf
06 Feb, 2021 1 commit
- Fix `doc_to_text` passage bug · 715dc759
  Jonathan Tow authored Feb 05, 2021
  
  715dc759
05 Feb, 2021 1 commit
- Add test to make sure right space conventions are used · 049dfa34
  Leo Gao authored Feb 04, 2021
  
  049dfa34
04 Feb, 2021 1 commit

Leo Gao authored Feb 03, 2021

- Extract evaluator (still needs work to clean up)
- Add tests for evaluator
- Fix all the things that break on the new tests
- Misc cleanup

778e0f91

03 Feb, 2021 2 commits
- Fix naming convention to avoid `pytest` name mangling invocation · 5cfb7308
  Jonathan Tow authored Feb 02, 2021
  
  5cfb7308
- Refactor `Dataset` naming and `HFTask` properties · a60ef6fa
  Jonathan Tow authored Feb 02, 2021
  
  a60ef6fa
28 Jan, 2021 3 commits
- Add space before target · 21d527d4
  Leo Gao authored Jan 28, 2021
  
  21d527d4
- wsc · 63e32f9c
  Jason Phang authored Jan 28, 2021
  
  63e32f9c
- Implement unit testing and fix lots of problems with tasks · 60a6fd8c
  Leo Gao authored Jan 27, 2021
  
  60a6fd8c
24 Jan, 2021 1 commit
- superglue ex wsc · 2e707b87
  Jason Phang authored Jan 23, 2021
  
  2e707b87
22 Jan, 2021 1 commit
- Clean up code, remove some footguns · e31b4b31
  Leo Gao authored Jan 21, 2021
  
  e31b4b31
16 Jan, 2021 1 commit
- Replace tab with spaces, formatting · 173b33a4
  thefazzer authored Jan 16, 2021
  
  173b33a4
13 Jan, 2021 1 commit
- Move `doc_to_text` target code into `doc_to_target` · d77241eb
  Jonathan Tow authored Jan 13, 2021
  
  d77241eb
12 Jan, 2021 2 commits
- Add MultiRC Implementation · a538a1ad
  thefazzer authored Jan 12, 2021
  
  a538a1ad
- Add COPA implementation · 2c6ff0d5
  thefazzer authored Jan 12, 2021
  
  2c6ff0d5
10 Jan, 2021 2 commits
- Added F1_score metric · 5165bd38
  thefazzer authored Jan 10, 2021
  
  5165bd38
- CommitmentBank framework refactor · 68a8790c
  thefazzer authored Jan 10, 2021
  
  68a8790c
09 Jan, 2021 2 commits
- Move higher_is_better and aggregation into their own functions · a18104a4
  Leo Gao authored Jan 08, 2021
  
  a18104a4
- Refactor and implement SAT evaluation · 0f9c1624
  Leo Gao authored Jan 08, 2021
  
  0f9c1624
06 Jan, 2021 1 commit
- Add comments to remind that evaluation needs to be written for the new framework · 2d2dbf96
  Leo Gao authored Jan 05, 2021
  
  2d2dbf96
05 Jan, 2021 1 commit
- Add reminder to rewrite · 08dc67ea
  Leo Gao authored Jan 05, 2021
  
  08dc67ea
02 Jan, 2021 1 commit
- Fix typo · fb176b57
  Leo Gao authored Jan 02, 2021
  
  fb176b57
28 Dec, 2020 1 commit
- Update · e41a082c
  Leo Gao authored Dec 27, 2020
  
  e41a082c
24 Oct, 2020 1 commit
- add rte text · d4daf44c
  Anish Thite authored Oct 24, 2020
  
  d4daf44c