Commits · 48c6bd6580d03005f67e87015bb1e172a4b0f76d · gaoqiong / lm-evaluation-harness

12 May, 2023 1 commit
- fix mmlu task, set updated dataset name and make the prompt identical to the original eval code · 48c6bd65
  Oleh Shliazhko authored May 13, 2023
  
  48c6bd65
03 May, 2022 1 commit
- add pre-commit · 121b7096
  Fabrizio Milo authored May 02, 2022
  
  121b7096
11 Apr, 2022 1 commit
- Merge changes · 9b4bfb6a
  jon-tow authored Apr 11, 2022
  
  9b4bfb6a
31 Mar, 2022 1 commit
- Adopt `_process_doc` method · 39c8c87f
  Jon Tow authored Mar 31, 2022
  
  39c8c87f
18 Mar, 2022 1 commit
- Refactor `Task` download · 7c9da714
  Jonathan Tow authored Mar 11, 2022
  
  7c9da714
28 Feb, 2022 2 commits
- Make citations module-level constants · 3f13d15f
  Jonathan Tow authored Feb 28, 2022
  
  3f13d15f
- Add citations and descriptions to all tasks · a1aceacd
  Jonathan Tow authored Feb 28, 2022
  
  a1aceacd
05 Feb, 2022 1 commit
- Added decontamination to remaining evals · dae7b868
  Quentin Gregory Anthony authored Feb 05, 2022
  
  dae7b868
08 Jan, 2022 1 commit
- Actually it shouldn't be hard to fix it to be compatible with future version · c65412e5
  thomasw21 authored Jan 08, 2022
  
  c65412e5
16 Dec, 2021 1 commit
- Add `provide_description` arg for backward compat · ee53be21
  Jonathan Tow authored Dec 15, 2021
  
  ee53be21
05 Jun, 2021 2 commits
- convert all enabled tasks to use best_download for better download robustness · 20229183
  Leo Gao authored Jun 04, 2021
  
  20229183
- Add task versioning · 105fa974
  Leo Gao authored Jun 04, 2021
  
  105fa974
31 Mar, 2021 1 commit
- Add "choices" to logiqa, hendrycksTest · 2ced79f5
  Leo Gao authored Mar 30, 2021
  
  2ced79f5
27 Mar, 2021 2 commits
- Minor updates · bc5478a1
  Leo Gao authored Mar 26, 2021
  
  bc5478a1
- Pass random state around to fewshot_examples and fewshot_context · 3b2d5f6c
  Leo Gao authored Mar 26, 2021
  
  3b2d5f6c
25 Mar, 2021 1 commit
- Update fewshot_examples · e2112196
  Leo Gao authored Mar 25, 2021
  
  e2112196
22 Mar, 2021 4 commits
- Include `auxiliary_train` and all `dev` sets in `training_docs` · e3769082
  Jonathan Tow authored Mar 22, 2021
  
  e3769082
- Split `dev` and `val` sets and cleanup prompt spacing · 364e54d4
  Jonathan Tow authored Mar 22, 2021
  
  364e54d4
- Restore proper prompt formatting · b2bab740
  Jonathan Tow authored Mar 22, 2021
  
  b2bab740
- Refactor and simple formatting · 806b022b
  Jonathan Tow authored Mar 21, 2021
  
  806b022b
21 Mar, 2021 4 commits
- minor · 13b97626
  Andy Zou authored Mar 21, 2021
  
  13b97626
- added training · 7989168d
  Andy Zou authored Mar 21, 2021
  
  7989168d
- adjusted naming · 8888a6be
  Andy Zou authored Mar 20, 2021
  
  8888a6be
- add hendrycksTest · a6b01474
  Andy Zou authored Mar 20, 2021
  
  a6b01474