Commits · 39c8c87f94e5c7fe351353446986dfd339e3bc6d · gaoqiong / lm-evaluation-harness

31 Mar, 2022 1 commit
- Adopt `_process_doc` method · 39c8c87f
  Jon Tow authored Mar 31, 2022
  
  39c8c87f
18 Mar, 2022 2 commits
- Fix training docs caching · 13317f8c
  Jon Tow authored Mar 18, 2022
  
  13317f8c
- Refactor `Task` download · 7c9da714
  Jonathan Tow authored Mar 11, 2022
  
  7c9da714
28 Feb, 2022 2 commits
- Make citations module-level constants · 3f13d15f
  Jonathan Tow authored Feb 28, 2022
  
  3f13d15f
- Add citations and descriptions to all tasks · a1aceacd
  Jonathan Tow authored Feb 28, 2022
  
  a1aceacd
30 Oct, 2021 1 commit
- Replace the `fewshot_description` API with a `description_dict` based interface · 8ac99269
  Jonathan Tow authored Oct 30, 2021
  
  8ac99269
05 Jun, 2021 1 commit
- Add task versioning · 105fa974
  Leo Gao authored Jun 04, 2021
  
  105fa974
11 Apr, 2021 1 commit
- Factor _convert_standard into MultipleChoiceTask · ec16d81d
  Leo Gao authored Apr 10, 2021
  
  ec16d81d
11 Feb, 2021 1 commit
- Remove test set from `HellaSwag` · a2b108b9
  Jon Tow authored Feb 10, 2021
  
  a2b108b9
10 Feb, 2021 1 commit
- Refactor `HellaSwag` as a `MultipleChoiceTask` · 43ffe351
  Jon Tow authored Feb 10, 2021
  
  43ffe351
05 Feb, 2021 1 commit
- Add test to make sure right space conventions are used · 049dfa34
  Leo Gao authored Feb 04, 2021
  
  049dfa34
29 Jan, 2021 3 commits
- Remove brackets from documents · 97b88570
  Jonathan Tow authored Jan 29, 2021
  
  97b88570
- Revert "Update `doc_to_text` to show candidate fill-ins" · da016758
  Jonathan Tow authored Jan 29, 2021
```
This reverts commit 5d431ba9.
```
  da016758
- Update `doc_to_text` to show candidate fill-ins · 5d431ba9
  Jon Tow authored Jan 28, 2021
  
  5d431ba9
28 Jan, 2021 1 commit
- Add `HellaSwag` evaluation implementation · 65c46d22
  Jon Tow authored Jan 28, 2021
  
  65c46d22
22 Jan, 2021 2 commits
- Remove rewrite reminder comment from everything except SuperGLUE · f4120e59
  Leo Gao authored Jan 21, 2021
  
  f4120e59
- Clean up code, remove some footguns · e31b4b31
  Leo Gao authored Jan 21, 2021
  
  e31b4b31
13 Jan, 2021 1 commit
- Move `doc_to_text` target code into `doc_to_target` · d77241eb
  Jonathan Tow authored Jan 13, 2021
  
  d77241eb
06 Jan, 2021 1 commit
- Add comments to remind that evaluation needs to be written for the new framework · 2d2dbf96
  Leo Gao authored Jan 05, 2021
  
  2d2dbf96
05 Jan, 2021 1 commit
- Add reminder to rewrite · 08dc67ea
  Leo Gao authored Jan 05, 2021
  
  08dc67ea
22 Oct, 2020 1 commit
- Add HellaSwag dataset. · a245d2e4
  Charles Foster authored Oct 21, 2020
  
  a245d2e4