Commits · a1aceacd607fd0fb7fe8f871567270edeb0a6954 · gaoqiong / lm-evaluation-harness

"lm_eval/datasets/bigbench_resources/snarks.json" did not exist on "e47e01beea79cfe87421e2dac49e64d499c240b4"

28 Feb, 2022 1 commit
- Add citations and descriptions to all tasks · a1aceacd
  Jonathan Tow authored Feb 28, 2022
  
  a1aceacd
08 Jan, 2022 1 commit
- Actually it shouldn't be hard to fix it to be compatible with future version · c65412e5
  thomasw21 authored Jan 08, 2022
  
  c65412e5
16 Dec, 2021 1 commit
- Add `provide_description` arg for backward compat · ee53be21
  Jonathan Tow authored Dec 15, 2021
  
  ee53be21
05 Jun, 2021 2 commits
- convert all enabled tasks to use best_download for better download robustness · 20229183
  Leo Gao authored Jun 04, 2021
  
  20229183
- Add task versioning · 105fa974
  Leo Gao authored Jun 04, 2021
  
  105fa974
31 Mar, 2021 1 commit
- Add "choices" to logiqa, hendrycksTest · 2ced79f5
  Leo Gao authored Mar 30, 2021
  
  2ced79f5
27 Mar, 2021 2 commits
- Minor updates · bc5478a1
  Leo Gao authored Mar 26, 2021
  
  bc5478a1
- Pass random state around to fewshot_examples and fewshot_context · 3b2d5f6c
  Leo Gao authored Mar 26, 2021
  
  3b2d5f6c
25 Mar, 2021 1 commit
- Update fewshot_examples · e2112196
  Leo Gao authored Mar 25, 2021
  
  e2112196
22 Mar, 2021 4 commits
- Include `auxiliary_train` and all `dev` sets in `training_docs` · e3769082
  Jonathan Tow authored Mar 22, 2021
  
  e3769082
- Split `dev` and `val` sets and cleanup prompt spacing · 364e54d4
  Jonathan Tow authored Mar 22, 2021
  
  364e54d4
- Restore proper prompt formatting · b2bab740
  Jonathan Tow authored Mar 22, 2021
  
  b2bab740
- Refactor and simple formatting · 806b022b
  Jonathan Tow authored Mar 21, 2021
  
  806b022b
21 Mar, 2021 4 commits
- minor · 13b97626
  Andy Zou authored Mar 21, 2021
  
  13b97626
- added training · 7989168d
  Andy Zou authored Mar 21, 2021
  
  7989168d
- adjusted naming · 8888a6be
  Andy Zou authored Mar 20, 2021
  
  8888a6be
- add hendrycksTest · a6b01474
  Andy Zou authored Mar 20, 2021
  
  a6b01474