Commits · d95a433304c50ccdf526cc1efe309fe202bee00d · gaoqiong / lm-evaluation-harness

03 May, 2022 2 commits
- fix codespell · d95a4333
  Fabrizio Milo authored May 02, 2022
  
  d95a4333
- add pre-commit · 121b7096
  Fabrizio Milo authored May 02, 2022
  
  121b7096
21 Apr, 2022 1 commit
- There is no point in passing in a RNG if you're re-seeding it every time anyways. · aeb7e846
  Dirk Groeneveld authored Apr 21, 2022
  
  aeb7e846
11 Apr, 2022 1 commit
- Merge changes · 9b4bfb6a
  jon-tow authored Apr 11, 2022
  
  9b4bfb6a
31 Mar, 2022 1 commit
- Adopt `_process_doc` method · 39c8c87f
  Jon Tow authored Mar 31, 2022
  
  39c8c87f
18 Mar, 2022 1 commit
- Refactor `Task` download · 7c9da714
  Jonathan Tow authored Mar 11, 2022
  
  7c9da714
28 Feb, 2022 2 commits
- Make citations module-level constants · 3f13d15f
  Jonathan Tow authored Feb 28, 2022
  
  3f13d15f
- Add citations and descriptions to all tasks · a1aceacd
  Jonathan Tow authored Feb 28, 2022
  
  a1aceacd
05 Feb, 2022 1 commit
- Added decontamination to remaining evals · dae7b868
  Quentin Gregory Anthony authored Feb 05, 2022
  
  dae7b868
08 Jan, 2022 1 commit
- Actually it shouldn't be hard to fix it to be compatible with future version · c65412e5
  thomasw21 authored Jan 08, 2022
  
  c65412e5
16 Dec, 2021 1 commit
- Add `provide_description` arg for backward compat · ee53be21
  Jonathan Tow authored Dec 15, 2021
  
  ee53be21
05 Jun, 2021 2 commits
- convert all enabled tasks to use best_download for better download robustness · 20229183
  Leo Gao authored Jun 04, 2021
  
  20229183
- Add task versioning · 105fa974
  Leo Gao authored Jun 04, 2021
  
  105fa974
31 Mar, 2021 2 commits
- Add note on accuracy reporting · d78917a7
  Jon Tow authored Mar 31, 2021
  
  d78917a7
- Clean up `Ethics` few-shot prompts · 48ae5457
  Jon Tow authored Mar 31, 2021
  
  48ae5457
28 Mar, 2021 1 commit
- Rename hendrycks ethics and math · 42659c34
  Leo Gao authored Mar 28, 2021
  
  42659c34
27 Mar, 2021 2 commits
- Remove unused imports and format imports · d5d19219
  Jonathan Tow authored Mar 26, 2021
  
  d5d19219
- Pass random state around to fewshot_examples and fewshot_context · 3b2d5f6c
  Leo Gao authored Mar 26, 2021
  
  3b2d5f6c
07 Mar, 2021 2 commits
- Minor tweaks · f1ac6435
  Leo Gao authored Mar 07, 2021
  
  f1ac6435
- Address the `EthicsUtilitarianism` `TODO`s · ab4939d3
  Jonathan Tow authored Mar 07, 2021
  
  ab4939d3
06 Mar, 2021 1 commit
- Flag down a bunch of todos · 491283c5
  Leo Gao authored Mar 05, 2021
  
  491283c5
01 Mar, 2021 2 commits
- Cleanups · 90b56db5
  Muennighoff authored Mar 01, 2021
  
  90b56db5
- Mimic original Ethics Util procedure · 001c0a05
  Muennighoff authored Mar 01, 2021
  
  001c0a05
27 Feb, 2021 3 commits
- Fix splitting · d6f6ff1d
  Muennighoff authored Feb 27, 2021
  
  d6f6ff1d
- Reasonable & Unreasonable loglikelihood · 90f1709b
  Muennighoff authored Feb 27, 2021
  
  90f1709b
- Swap .index for .split · 5b06573e
  Muennighoff authored Feb 27, 2021
  
  5b06573e
26 Feb, 2021 1 commit
- Make some very minor changes to the prompt · 35323047
  Leo Gao authored Feb 26, 2021
  
  35323047
18 Feb, 2021 2 commits
- Adapt prompts to Ethics paper · 86c4115d
  Muennighoff authored Feb 18, 2021
  
  86c4115d
- Add Exact Match Metric · a7564ff3
  Muennighoff authored Feb 18, 2021
  
  a7564ff3
16 Feb, 2021 4 commits
- Correct Scoring · e3bdca80
  Muennighoff authored Feb 16, 2021
  
  e3bdca80
- Correct Path · 7c73f3c8
  Muennighoff authored Feb 16, 2021
  
  7c73f3c8
- Add Ethics Tasks · 400f812c
  Muennighoff authored Feb 16, 2021
  
  400f812c
- Add Virtue · d4606d27
  Muennighoff authored Feb 16, 2021
  
  d4606d27
15 Feb, 2021 4 commits
- Add Utilitarianism & Justice · b5c2952a
  Muennighoff authored Feb 15, 2021
  
  b5c2952a
- Label fixes · c9aad57f
  Muennighoff authored Feb 15, 2021
  
  c9aad57f
- Syntax · f123ce39
  Muennighoff authored Feb 15, 2021
  
  f123ce39
- Add Ethics CM & Deontology · 5c92d629
  Muennighoff authored Feb 15, 2021
  
  5c92d629